-- Logs begin at Sun 2022-06-26 02:17:01 UTC, end at Sun 2022-06-26 03:26:52 UTC. -- Jun 26 02:50:42.987585 dv-cinder-846842-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jun 26 02:50:42 2022] *** Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: nodename: dv-cinder-846842-4-smb Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: machine: x86_64 Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: clock source: unix Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: pcre jit disabled Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: detected number of CPU cores: 4 Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: current working directory: / Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: detected binary path: /usr/bin/uwsgi-core Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: your processes number limit is 47680 Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: your memory page size is 4096 bytes Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: detected max file descriptor number: 2048 Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: lock engine: pthread robust mutexes Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: thunder lock: enabled Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 26 02:50:43.000953 dv-cinder-846842-4-smb devstack@keystone.service[80118]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 26 02:50:43.042443 dv-cinder-846842-4-smb devstack@keystone.service[80118]: Python main interpreter initialized at 0x55646cf489c0 Jun 26 02:50:43.042443 dv-cinder-846842-4-smb devstack@keystone.service[80118]: python threads support enabled Jun 26 02:50:43.042443 dv-cinder-846842-4-smb devstack@keystone.service[80118]: your server socket listen backlog is limited to 100 connections Jun 26 02:50:43.042443 dv-cinder-846842-4-smb devstack@keystone.service[80118]: your mercy for graceful operations on workers is 90 seconds Jun 26 02:50:43.042776 dv-cinder-846842-4-smb devstack@keystone.service[80118]: mapped 403077 bytes (393 KB) for 2 cores Jun 26 02:50:43.042850 dv-cinder-846842-4-smb devstack@keystone.service[80118]: *** Operational MODE: preforking *** Jun 26 02:50:43.043149 dv-cinder-846842-4-smb devstack@keystone.service[80118]: *** uWSGI is running in multiple interpreter mode *** Jun 26 02:50:43.043149 dv-cinder-846842-4-smb devstack@keystone.service[80118]: spawned uWSGI master process (pid: 80118) Jun 26 02:50:43.043337 dv-cinder-846842-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 26 02:50:43.044832 dv-cinder-846842-4-smb devstack@keystone.service[80118]: spawned uWSGI worker 1 (pid: 80128, cores: 1) Jun 26 02:50:43.044832 dv-cinder-846842-4-smb devstack@keystone.service[80118]: spawned uWSGI worker 2 (pid: 80129, cores: 1) Jun 26 02:50:43.044832 dv-cinder-846842-4-smb devstack@keystone.service[80118]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 26 02:50:48.382030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 02:50:48.382030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: from cryptography.utils import int_from_bytes Jun 26 02:50:48.382862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 02:50:48.382862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: from cryptography.utils import int_from_bytes Jun 26 02:50:48.383314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 02:50:48.383314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: from cryptography.utils import int_from_bytes Jun 26 02:50:48.383422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 26 02:50:48.383422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: from cryptography.utils import int_from_bytes Jun 26 02:50:48.430564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 26 02:50:48.430756 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 26 02:50:48.430839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 26 02:50:48.430913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] command line args: [] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 26 02:50:48.430973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 26 02:50:48.431167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] command line args: [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 26 02:50:48.431259 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 26 02:50:48.431326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ================================================================================ {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 26 02:50:48.431445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 26 02:50:48.431564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] admin_token = **** {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.431647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ================================================================================ {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 26 02:50:48.431837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] config_dir = [] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.431975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] admin_token = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.432058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.432126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] config_dir = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.432185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] config_source = [] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.432247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.432307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] debug = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.432513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] config_source = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.432648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.432849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] debug = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.432849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.433001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.433064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.433126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.433263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.433338 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.433520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.433639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.433707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] list_limit = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.433764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.433919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] log_config_append = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.434028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.434110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.434178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] log_config_append = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.434242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] log_dir = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.434305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.434368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] log_file = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.434430 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] log_dir = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.434625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.434746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] log_file = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.434813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.434876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.435113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.435230 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.435322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.435401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.435466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.435658 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.435809 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.435901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.435984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.436065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.436145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.436216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.436321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.436436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.436515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.436575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.436759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.436847 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.436984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.437075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.437231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.437319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.437472 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.437560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.437718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.437813 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.437967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.438190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.438371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] publish_errors = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.438468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.438596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.438683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] publish_errors = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.438819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.438905 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.439000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.439129 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.439249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.439328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.439475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.439562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.439703 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] standard_threads = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.439782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.439929 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] standard_threads = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440247 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440394 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] use_journal = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440667 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] use_json = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] use_journal = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] use_stderr = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440887 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] use_json = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.440959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] use_syslog = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.441042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] use_stderr = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.441162 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.441241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] use_syslog = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.441400 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 26 02:50:48.441484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.441631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.441716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.441877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.441954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.442105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.442190 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.442348 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.442438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.442581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.442659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.442817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.442896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.443068 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.443162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.443311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.443394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.443551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.443628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.443795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.443881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.444019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.444097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.444262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.444347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.444495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.444583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.444736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.444820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.444979 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.445056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.445212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.445372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.445455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.445527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.445683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.445768 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.445919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.446021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.446147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.446228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.446385 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.446462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.446636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.446721 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.446883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.446962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.447153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.447232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.447381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.447472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.447606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.447684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.447832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.447910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.448090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.448182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.448335 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.448559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.448643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.448790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.448990 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.449070 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.449243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.449432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.449510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.449701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.449842 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.449946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.450174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.450251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.450403 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.450631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.450720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.450856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.451103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.451184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.451331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.451556 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.451716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.451793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.452017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.452101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.452243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.452448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.452534 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.452688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.452893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.452970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.453302 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.453384 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.453695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.453774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.453943 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.454154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.454233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.454413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.454579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.454659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.454902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.455055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.455168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.455412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.455498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.455648 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.455839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.455917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.456114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.456280 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.456378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.456513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.456619 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.456765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.456869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.457001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.457117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.457312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.457420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.457500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.457723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.457805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.457938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.458191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.458270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.458428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.458640 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.458761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.458884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.459109 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.459206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.459394 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.459627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.459711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.459864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.459942 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.460136 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.460218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.460374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.460625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.460703 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.460872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.461094 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.461175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.461329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.461542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.461627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.461793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.462018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.462099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.462253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.462472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.462551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.462712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.462923 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.463052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.463194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.463399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.463478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.463728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.463898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.463979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.464160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.464246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.464401 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.464489 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.464638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.464717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.464873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.464953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.465112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.465199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.465348 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.465427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.465587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.465717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.465857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.466099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.466237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.466371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.466493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.466625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.466725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.466812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.466894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.467011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.467088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.467236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.467475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.467554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.467706 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.467922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.468005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.468154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.468358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.468437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.468606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.468818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.468898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.469074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.469275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.469355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.469549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.469735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.469822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.470061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.470278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.470377 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.470517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.external = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.470608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.470748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.470829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] auth.external = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.470978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.471081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.471289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.471378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.471519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.471606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.password = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.471746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.token = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.471825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] auth.password = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.471972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] auth.token = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.472059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.472207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.472288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.472436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.472540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.472673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.472766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.472897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.472978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.473140 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.473220 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.473371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.473605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.473698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.473853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.473934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.474102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.474183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] credential.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.474345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.474434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.474579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.474658 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.474822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.474901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.475076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.475176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.475321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.475401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.475555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.475635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.475815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.475902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.476063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.476142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.476301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.476378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.476551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.476642 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] federation.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.479994 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480777 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.480961 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481022 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.481961 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.482019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.482222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.482753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.482884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.483045 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.483117 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.483246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.483341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.483465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.483544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.483604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.483720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.483836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.483923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.483999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.484977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.485154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.485280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.485361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.485435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.485604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.485730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.485811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.485886 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.486051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.486177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.486272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.486350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.486527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.486666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.486749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.486824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.486971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.487098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.487173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.487245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.487441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.487567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.487668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.487747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.487906 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.488033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.488114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.488187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.488364 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.488491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.488572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.488645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.488807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.488934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.489030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.489107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.489262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.489389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.489470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.489544 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.489718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.489843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.489936 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.490012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.490169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.490296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.490394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.490472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.490616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.490701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.490839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.490922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.491104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.491192 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.491342 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.491427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.491578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.491663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.491812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.491896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.492037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.492121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.492265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.492348 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.492492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.492577 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.492725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.492811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.492973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.493064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.493195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.493278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.493436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.493520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.493672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.493763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.493883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.493967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.494127 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.494254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.494356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.494464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.494565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.494662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.494767 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.494866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.495106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.495230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.495333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.495432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.495566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.495673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.495807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.495930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.496031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.496129 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.496267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.496378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.496510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.496621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.496721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.496818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.496965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.497070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.497196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.497308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.497415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.497512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.497640 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.497746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.497851 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.497957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.498094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.498199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.498334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.498446 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.498566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.498680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.499320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.500599 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.500682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.500744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.501177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.501405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.501493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.501558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.501558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.501681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.501753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.501824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.501885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.501944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502003 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502192 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] resource.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.502937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503109 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503230 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503369 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] role.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] role.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503778 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.503992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.504052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] role.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.504052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] role.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.504156 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.504223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.504302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.504365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.504423 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.504567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.504722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.504806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.504878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.505064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.505199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.505268 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.505328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.505520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.505646 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.505715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.505775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.505990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.506119 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.506202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.506281 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.506455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.506586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.506655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.506909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.507078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.507151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.507228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.507411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.507643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.507783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.507931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.508058 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.508185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.508312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.508444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.508570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.508718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.508846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.508974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.509100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.509225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.509352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.509510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.509635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.509762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.509889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.510016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.510142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.510285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.510429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.510557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.510682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.510807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.510933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511254 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511399 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] token.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.511925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.512000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] token.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.512073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.512145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.512291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.512424 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.512518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.512596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.512764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.512891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.512973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.513048 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.513229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.513317 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.513480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.513565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.513716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.513800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.513954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.514038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.514186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.514270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.514418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.514500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.514649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.514735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.514886 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.514969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.515153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.515237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.515381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.515467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.515620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.515704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.connection = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.515909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.516003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.516157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.516241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.connection = **** {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.516395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.516493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.516637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.516722 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.516868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.516951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.517085 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.517178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.517314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.517394 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.517547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.517627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.517781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.517868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.518014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.518093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.518252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.518330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.518485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.518572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.518731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.518810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.518965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.519095 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.519234 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.519326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.519465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.519545 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.519707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.519785 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.519932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.520020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.520096 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 26 02:50:48.520168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.520386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 26 02:50:48.520554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 26 02:50:48.551282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.551457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.551526 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.551587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.551768 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.551863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.560357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.560448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.588012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.588211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.588344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.588601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.733237 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.733429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.781072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.781313 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.782094 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.782340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.845105 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.845292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.845379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.845458 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.845578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.845659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.845737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.845811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.845948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.846165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.846254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.846319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.870726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.870924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.871066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.871207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.871282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.871351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.871514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.871655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.871794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.871878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.871999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.872078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.872142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.872301 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.882956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.883208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.896131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.896343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.896443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.896560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.896638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.896780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.897672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.897672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.897672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80129) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.897848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.897976 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.898201 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.898411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.898623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 26 02:50:48.914456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.914634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 26 02:50:48.914829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.914964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.915154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 26 02:50:48.915239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 26 02:50:48.915383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.915509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.915645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 26 02:50:48.916121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.916218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.916325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.916407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.916502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.916657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.916972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.927349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.927623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.927747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.927931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.928056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.928214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.928298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.928562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.936355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.936797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.939630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.939903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.940082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.940180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.940355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.940466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.940631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.940722 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.940928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.941054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.941206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.941290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.941438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.941564 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.941702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.941783 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.941915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.941995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.942187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.942313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.942441 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.942718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.968507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.969092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.970098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.970375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.970702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.970978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.975587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.975976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.976229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.976355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.976621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.976894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.983556 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.983774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.984215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.984471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.988220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.988501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.988781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.988906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:48.989054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.989260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.989385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.989513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.989598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.989759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.989898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.990037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.990113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.990289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.990558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:48.990817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.008659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.008923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.009539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.009811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.013594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.014395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.017228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.017621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.018026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.018426 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.022607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.023482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.026322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.027297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.029966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.030257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.030532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.030805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.030929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.031096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.031282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.031408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.031544 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.031810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.032080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.032351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.050547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.050822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.051104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.051372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.051881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.052158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.052425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.052694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.059347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.060616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.061027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.061300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.062318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.062594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.064527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.064816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.065109 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.065401 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.065729 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.065854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.066088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.066366 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.066641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.066911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.078897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.079192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.079472 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.079743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.080202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.080478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.080752 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.081030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.081242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.081533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.081809 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.082532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.082833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.083152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.099526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.101028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.102800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.104350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.106121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.107667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.107834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.109404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.109532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.109733 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.109984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.111019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.111326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.111606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.117300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.118869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.119015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.120589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.122180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.122458 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.122844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.123140 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.123832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.124120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.124505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.124778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.132193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.132474 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.132746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.133837 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.134120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.134399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.140589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80129) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.140861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.141137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.141406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.141672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.142044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.142275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 26 02:50:49.142377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.142572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.142697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.142857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.143004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.143156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.143268 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.143453 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.143580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.143676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.143811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.143891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.144042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.144171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80129) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.144303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.144579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.144848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.145117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.145387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.145650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.145919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 26 02:50:49.182266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55646cf489c0 pid: 80129 (default app) Jun 26 02:50:49.184711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55646cf489c0 pid: 80128 (default app) Jun 26 02:50:49.186065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14cae-43a2-4e76-ab35-068e91f4ffae None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:50:49.186527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14cae-43a2-4e76-ab35-068e91f4ffae None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:50:49.187012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14cae-43a2-4e76-ab35-068e91f4ffae None None] PATH_INFO: `/v3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:50:49.193460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Sun Jun 26 02:50:49 2022] GET /identity/v3/ => generated 255 bytes in 11 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:50:56.893600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4174ef-74d4-4892-9e31-ae6f6c5d70e6 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:50:56.894525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4174ef-74d4-4892-9e31-ae6f6c5d70e6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:50:56.894525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4174ef-74d4-4892-9e31-ae6f6c5d70e6 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:50:56.901739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:50:56 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:50:56.907544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9fa0d-cd76-4edc-a5c9-7ee60eb6b1ca None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:50:56.908002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9fa0d-cd76-4edc-a5c9-7ee60eb6b1ca None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:50:56.908088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9fa0d-cd76-4edc-a5c9-7ee60eb6b1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:50:56.975571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: INFO dbcounter [None req-5bc9fa0d-cd76-4edc-a5c9-7ee60eb6b1ca None None] Registered counter for database keystone Jun 26 02:50:56.999916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG oslo_db.sqlalchemy.engines [None req-5bc9fa0d-cd76-4edc-a5c9-7ee60eb6b1ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 02:50:57.008289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writer thread running {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 02:50:57.189749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG passlib.handlers.bcrypt [None req-5bc9fa0d-cd76-4edc-a5c9-7ee60eb6b1ca None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80129) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 26 02:50:57.190088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG passlib.handlers.bcrypt [None req-5bc9fa0d-cd76-4edc-a5c9-7ee60eb6b1ca None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80129) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 26 02:50:57.246976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5bc9fa0d-cd76-4edc-a5c9-7ee60eb6b1ca None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:50:57.248620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5bc9fa0d-cd76-4edc-a5c9-7ee60eb6b1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:50:57.381817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:50:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 26 02:50:57.533792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4174ef-74d4-4892-9e31-ae6f6c5d70e6 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:50:57.606973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: INFO dbcounter [None req-fa4174ef-74d4-4892-9e31-ae6f6c5d70e6 None None] Registered counter for database keystone Jun 26 02:50:57.629320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4174ef-74d4-4892-9e31-ae6f6c5d70e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 26 02:50:57.640087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writer thread running {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 26 02:50:57.759428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4174ef-74d4-4892-9e31-ae6f6c5d70e6 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:50:57.764958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d198d-bc49-4d48-ae1b-1aeaaa6a22a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:50:57.765620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d198d-bc49-4d48-ae1b-1aeaaa6a22a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:50:57.765905 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d198d-bc49-4d48-ae1b-1aeaaa6a22a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:50:57.766180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d198d-bc49-4d48-ae1b-1aeaaa6a22a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:50:57.775316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d198d-bc49-4d48-ae1b-1aeaaa6a22a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:50:57.826199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7b1d198d-bc49-4d48-ae1b-1aeaaa6a22a3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 26 02:50:57.826530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d198d-bc49-4d48-ae1b-1aeaaa6a22a3 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:50:57.836713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Sun Jun 26 02:50:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 02:50:57.843850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9fa0d-cd76-4edc-a5c9-7ee60eb6b1ca None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:50:57.863490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9fa0d-cd76-4edc-a5c9-7ee60eb6b1ca None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:50:57.869926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7582b-f453-4999-a35d-4c5da8273c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:50:57.871102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7582b-f453-4999-a35d-4c5da8273c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:50:57.871397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7582b-f453-4999-a35d-4c5da8273c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:50:57.871676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7582b-f453-4999-a35d-4c5da8273c84 admin admin] PATH_INFO: `/v3/projects/898f4bc074784aa394c0f3456d694f9e` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:50:57.876044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7582b-f453-4999-a35d-4c5da8273c84 admin admin] RBAC: Authorizing `identity:get_project(project_id=898f4bc074784aa394c0f3456d694f9e)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:50:57.926351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: WARNING keystone.common.rbac_enforcer.enforcer [None req-05a7582b-f453-4999-a35d-4c5da8273c84 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 26 02:50:57.926937 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7582b-f453-4999-a35d-4c5da8273c84 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:50:57.931356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Sun Jun 26 02:50:57 2022] GET /identity/v3/projects/898f4bc074784aa394c0f3456d694f9e => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:50:59.931873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dffb1-45fc-4282-8af4-f26ddf945fbd None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:50:59.932443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dffb1-45fc-4282-8af4-f26ddf945fbd None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:50:59.932443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dffb1-45fc-4282-8af4-f26ddf945fbd None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:50:59.936704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:50:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:50:59.946073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968314-b168-45c9-972d-67a9e300c629 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:50:59.946777 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968314-b168-45c9-972d-67a9e300c629 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:50:59.946919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0968314-b168-45c9-972d-67a9e300c629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:50:59.968643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d0968314-b168-45c9-972d-67a9e300c629 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:50:59.970174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d0968314-b168-45c9-972d-67a9e300c629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:50:59.978713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:50:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 26 02:51:00.001243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dffb1-45fc-4282-8af4-f26ddf945fbd None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:00.014204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dffb1-45fc-4282-8af4-f26ddf945fbd None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:00.018971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fa338-e0b9-4498-8734-2ea391d4997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:00.019634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa338-e0b9-4498-8734-2ea391d4997d admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:00.019916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa338-e0b9-4498-8734-2ea391d4997d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:00.020205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa338-e0b9-4498-8734-2ea391d4997d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:00.028652 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fa338-e0b9-4498-8734-2ea391d4997d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:00.030452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fa338-e0b9-4498-8734-2ea391d4997d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:00.040699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Sun Jun 26 02:51:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 26 02:51:00.047126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0968314-b168-45c9-972d-67a9e300c629 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:00.057067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0968314-b168-45c9-972d-67a9e300c629 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:00.062819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c5ae0-2965-4fb1-aa7b-a8b3019d2b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:00.063738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5ae0-2965-4fb1-aa7b-a8b3019d2b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:00.064021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5ae0-2965-4fb1-aa7b-a8b3019d2b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:00.064296 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5ae0-2965-4fb1-aa7b-a8b3019d2b88 admin admin] PATH_INFO: `/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:00.065844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c5ae0-2965-4fb1-aa7b-a8b3019d2b88 admin admin] RBAC: Authorizing `identity:get_user(user_id=7e9333f1aa1b4eae9a0f479d3c29fb15)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:00.067751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c5ae0-2965-4fb1-aa7b-a8b3019d2b88 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:00.069343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Sun Jun 26 02:51:00 2022] GET /identity/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:02.118866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca25f6-1538-4530-b3a7-2dcb40894f6e None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:02.119469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca25f6-1538-4530-b3a7-2dcb40894f6e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:02.119469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca25f6-1538-4530-b3a7-2dcb40894f6e None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:02.120819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:02.126165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d940bae-b2e8-4a41-9871-f0ccc367fe41 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:02.126578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d940bae-b2e8-4a41-9871-f0ccc367fe41 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:02.126764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d940bae-b2e8-4a41-9871-f0ccc367fe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:02.144464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-9d940bae-b2e8-4a41-9871-f0ccc367fe41 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:02.145638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9d940bae-b2e8-4a41-9871-f0ccc367fe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:02.180341 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5993a9-ff96-40ff-89d5-13c5935eed6e None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:02.180671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5993a9-ff96-40ff-89d5-13c5935eed6e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:02.181006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5993a9-ff96-40ff-89d5-13c5935eed6e None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:02.182594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:02.187623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261b8e5-b3d3-4b38-b0b0-ae0391f4aa4f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:02.187987 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261b8e5-b3d3-4b38-b0b0-ae0391f4aa4f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:02.188260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261b8e5-b3d3-4b38-b0b0-ae0391f4aa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:02.228270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG passlib.handlers.bcrypt [None req-0261b8e5-b3d3-4b38-b0b0-ae0391f4aa4f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80128) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 26 02:51:02.228655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG passlib.handlers.bcrypt [None req-0261b8e5-b3d3-4b38-b0b0-ae0391f4aa4f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80128) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 26 02:51:02.230011 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:02.253049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d940bae-b2e8-4a41-9871-f0ccc367fe41 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:02.273769 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0261b8e5-b3d3-4b38-b0b0-ae0391f4aa4f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:02.275417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0261b8e5-b3d3-4b38-b0b0-ae0391f4aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:02.276839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:02.358832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d940bae-b2e8-4a41-9871-f0ccc367fe41 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:02.373626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:02.393092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a071-7433-4cd8-b648-1eaac0cf3f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:02.393904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a071-7433-4cd8-b648-1eaac0cf3f0e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:02.394194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a071-7433-4cd8-b648-1eaac0cf3f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:02.394547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a071-7433-4cd8-b648-1eaac0cf3f0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:02.395517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261b8e5-b3d3-4b38-b0b0-ae0391f4aa4f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:02.405710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676a071-7433-4cd8-b648-1eaac0cf3f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-4676a071-7433-4cd8-b648-1eaac0cf3f0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:02.417330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:02.418415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:02.419397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:51:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:51:02.424737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a071-7433-4cd8-b648-1eaac0cf3f0e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:02.506416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261b8e5-b3d3-4b38-b0b0-ae0391f4aa4f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:02.507846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:02.509637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:02.526818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a071-7433-4cd8-b648-1eaac0cf3f0e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:02.545174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fed8c1-f056-4db9-b236-69fd672fc029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:02.546100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed8c1-f056-4db9-b236-69fd672fc029 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:02.546393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed8c1-f056-4db9-b236-69fd672fc029 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:02.546682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed8c1-f056-4db9-b236-69fd672fc029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:02.560541 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db4c47-54e7-4b43-a3b0-de968c6fdad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:02.561211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db4c47-54e7-4b43-a3b0-de968c6fdad1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:02.561499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db4c47-54e7-4b43-a3b0-de968c6fdad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:02.561788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db4c47-54e7-4b43-a3b0-de968c6fdad1 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:02.562546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db4c47-54e7-4b43-a3b0-de968c6fdad1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:02.562860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db4c47-54e7-4b43-a3b0-de968c6fdad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:02.564314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db4c47-54e7-4b43-a3b0-de968c6fdad1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:02.576051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:02.581616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db4c47-54e7-4b43-a3b0-de968c6fdad1 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:02.616046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fed8c1-f056-4db9-b236-69fd672fc029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:02.617590 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fed8c1-f056-4db9-b236-69fd672fc029 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:02.677587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db4c47-54e7-4b43-a3b0-de968c6fdad1 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:02.712553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba753c-43b9-40cb-9c73-826b7502267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:02.713427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba753c-43b9-40cb-9c73-826b7502267f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:02.713708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba753c-43b9-40cb-9c73-826b7502267f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:02.714007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba753c-43b9-40cb-9c73-826b7502267f None admin] PATH_INFO: `/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:02.715306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba753c-43b9-40cb-9c73-826b7502267f None admin] RBAC: Authorizing `identity:get_user(user_id=7e9333f1aa1b4eae9a0f479d3c29fb15)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:02.716772 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba753c-43b9-40cb-9c73-826b7502267f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:02.718308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 26 02:51:02.718700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:02 2022] GET /identity/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:02.723774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fed8c1-f056-4db9-b236-69fd672fc029 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:02.723991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba753c-43b9-40cb-9c73-826b7502267f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:02.726971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:02.738237 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:02.820519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba753c-43b9-40cb-9c73-826b7502267f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:02.823926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fed8c1-f056-4db9-b236-69fd672fc029 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:02.856126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f3672-d47b-42de-a989-0ec550c14f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:02.856737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8853716-9743-408b-8a6e-ada23c7b1cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:02.856921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f3672-d47b-42de-a989-0ec550c14f47 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:02.857199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f3672-d47b-42de-a989-0ec550c14f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:02.857472 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f3672-d47b-42de-a989-0ec550c14f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:02.857556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853716-9743-408b-8a6e-ada23c7b1cfb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:02.857816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853716-9743-408b-8a6e-ada23c7b1cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:02.858121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853716-9743-408b-8a6e-ada23c7b1cfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:02.859558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8853716-9743-408b-8a6e-ada23c7b1cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:02.861045 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8853716-9743-408b-8a6e-ada23c7b1cfb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:02.862680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:02.867614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f3672-d47b-42de-a989-0ec550c14f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:02.868355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8853716-9743-408b-8a6e-ada23c7b1cfb None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:02.869105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f3672-d47b-42de-a989-0ec550c14f47 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-a74f3672-d47b-42de-a989-0ec550c14f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:51:02.887651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:02.888466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:02.889482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:51:02.889482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:51:02.889482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:51:02.889482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:02.889482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:02.894426 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f3672-d47b-42de-a989-0ec550c14f47 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:02.936868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:02.956074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:02.967615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8853716-9743-408b-8a6e-ada23c7b1cfb None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:02.993018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f3672-d47b-42de-a989-0ec550c14f47 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:03.000002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868257e-400a-4fad-b42b-1dfcaada446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:03.000653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868257e-400a-4fad-b42b-1dfcaada446c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:03.000937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868257e-400a-4fad-b42b-1dfcaada446c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:03.001208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868257e-400a-4fad-b42b-1dfcaada446c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:03.002033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868257e-400a-4fad-b42b-1dfcaada446c None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.domain.id=default, user.id=7e9333f1aa1b4eae9a0f479d3c29fb15) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:03.002337 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868257e-400a-4fad-b42b-1dfcaada446c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:03.003818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868257e-400a-4fad-b42b-1dfcaada446c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:03.013382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1322 bytes} [Sun Jun 26 02:51:02 2022] GET /identity/v3/role_assignments?user.id=7e9333f1aa1b4eae9a0f479d3c29fb15&scope.domain.id=default&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:03.027136 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6cf67-d3df-464d-a914-132d8e1daf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:03.027865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6cf67-d3df-464d-a914-132d8e1daf3c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:03.028151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6cf67-d3df-464d-a914-132d8e1daf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:03.028434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6cf67-d3df-464d-a914-132d8e1daf3c None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:03.029194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6cf67-d3df-464d-a914-132d8e1daf3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:03.029514 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6cf67-d3df-464d-a914-132d8e1daf3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:03.030977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6cf67-d3df-464d-a914-132d8e1daf3c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:03.051301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:05.248637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b2fd-81c9-42f7-8a35-9f6ec3a592c8 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:05.249190 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b2fd-81c9-42f7-8a35-9f6ec3a592c8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:05.249471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94b2fd-81c9-42f7-8a35-9f6ec3a592c8 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:05.250866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:05.267883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381194-45c7-4376-9ac8-eafbb31a35ca None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:05.268833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381194-45c7-4376-9ac8-eafbb31a35ca None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:05.269322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381194-45c7-4376-9ac8-eafbb31a35ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:05.295990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-48381194-45c7-4376-9ac8-eafbb31a35ca None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:05.297562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-48381194-45c7-4376-9ac8-eafbb31a35ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:05.383360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:05.418336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94b2fd-81c9-42f7-8a35-9f6ec3a592c8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:05.484784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37028d5-0aed-4a94-bef4-5d3567025645 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:05.485115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37028d5-0aed-4a94-bef4-5d3567025645 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:05.485351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37028d5-0aed-4a94-bef4-5d3567025645 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:05.486728 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:05.492094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8789cc9-e9c3-427e-a426-1eac092786aa None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:05.492381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8789cc9-e9c3-427e-a426-1eac092786aa None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:05.492659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8789cc9-e9c3-427e-a426-1eac092786aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:05.516183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-a8789cc9-e9c3-427e-a426-1eac092786aa None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:05.517656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a8789cc9-e9c3-427e-a426-1eac092786aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:05.595370 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:05.628421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 14/25] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:05.630017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94b2fd-81c9-42f7-8a35-9f6ec3a592c8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:05.688717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8789cc9-e9c3-427e-a426-1eac092786aa None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:05.696370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87ddf3-8d9c-4294-98e4-fe1e7aad6c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:05.697199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87ddf3-8d9c-4294-98e4-fe1e7aad6c4e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:05.697480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87ddf3-8d9c-4294-98e4-fe1e7aad6c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:05.697755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87ddf3-8d9c-4294-98e4-fe1e7aad6c4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:05.714913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:05.726292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87ddf3-8d9c-4294-98e4-fe1e7aad6c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2a87ddf3-8d9c-4294-98e4-fe1e7aad6c4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:05.746710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:05.747687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:05.748434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 12/26] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:51:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:05.755941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87ddf3-8d9c-4294-98e4-fe1e7aad6c4e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:05.902093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8789cc9-e9c3-427e-a426-1eac092786aa None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:05.938461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87ddf3-8d9c-4294-98e4-fe1e7aad6c4e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:05.944090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8abe36-a70f-4ef8-afb6-29fd7abaff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:05.945012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8abe36-a70f-4ef8-afb6-29fd7abaff54 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:05.945394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8abe36-a70f-4ef8-afb6-29fd7abaff54 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:05.945767 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8abe36-a70f-4ef8-afb6-29fd7abaff54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:05.959057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8abe36-a70f-4ef8-afb6-29fd7abaff54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:05.961197 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8abe36-a70f-4ef8-afb6-29fd7abaff54 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:05.976772 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ac4d2-bb0b-45e1-a091-e2a52a1aace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:05.977713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ac4d2-bb0b-45e1-a091-e2a52a1aace8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:05.978147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ac4d2-bb0b-45e1-a091-e2a52a1aace8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:05.978556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ac4d2-bb0b-45e1-a091-e2a52a1aace8 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:05.979519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ac4d2-bb0b-45e1-a091-e2a52a1aace8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:05.979973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ac4d2-bb0b-45e1-a091-e2a52a1aace8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:05.981635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ac4d2-bb0b-45e1-a091-e2a52a1aace8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-6e8abe36-a70f-4ef8-afb6-29fd7abaff54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:51:05.982822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:05.983752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:05.984837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:51:05.984837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:51:05.984837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:51:05.984837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:05.984837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 15/27] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:51:05.986125 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061b0b6-922e-4a76-8af7-8b36e6c614a5 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:05.986483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061b0b6-922e-4a76-8af7-8b36e6c614a5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:05.986835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061b0b6-922e-4a76-8af7-8b36e6c614a5 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:05.988417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 16/28] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:05.989623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cbe29-9ca9-4aca-9196-8703f33c524f None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:05.990220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cbe29-9ca9-4aca-9196-8703f33c524f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:05.990850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cbe29-9ca9-4aca-9196-8703f33c524f None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:05.992426 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 17/29] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:05.993334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cbe29-9ca9-4aca-9196-8703f33c524f None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:06.007988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 13/30] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:06.009237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ece0f5-c328-41bc-b597-8a43533f4dbf None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:06.009527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ece0f5-c328-41bc-b597-8a43533f4dbf None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:06.009802 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ece0f5-c328-41bc-b597-8a43533f4dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:06.027979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c2ece0f5-c328-41bc-b597-8a43533f4dbf None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:06.029154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c2ece0f5-c328-41bc-b597-8a43533f4dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:06.042353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:06.101850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:06.113345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cbe29-9ca9-4aca-9196-8703f33c524f None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:06.123061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 14/31] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:06.124643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc0fd-c17a-454b-bc8f-e8af7db5afbb None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:06.125164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc0fd-c17a-454b-bc8f-e8af7db5afbb None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:06.125634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc0fd-c17a-454b-bc8f-e8af7db5afbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:06.161028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ece79-7dca-4f1b-8216-7bd5ff6468f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:06.162081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ece79-7dca-4f1b-8216-7bd5ff6468f6 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:06.162555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ece79-7dca-4f1b-8216-7bd5ff6468f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:06.162954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-294bc0fd-c17a-454b-bc8f-e8af7db5afbb None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:06.163102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ece79-7dca-4f1b-8216-7bd5ff6468f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:06.163803 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ece79-7dca-4f1b-8216-7bd5ff6468f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:06.164113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ece79-7dca-4f1b-8216-7bd5ff6468f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:06.164209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-294bc0fd-c17a-454b-bc8f-e8af7db5afbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:06.165512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ece79-7dca-4f1b-8216-7bd5ff6468f6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:06.178303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 18/32] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:06.183193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ece79-7dca-4f1b-8216-7bd5ff6468f6 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:06.240179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 15/33] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:06.241508 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bc0fd-c17a-454b-bc8f-e8af7db5afbb None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:06.277157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:06.283279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ece79-7dca-4f1b-8216-7bd5ff6468f6 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:06.318288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca64ad-2fba-4abb-9acf-8260e596d108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:06.319219 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca64ad-2fba-4abb-9acf-8260e596d108 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:06.319502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca64ad-2fba-4abb-9acf-8260e596d108 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:06.319776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca64ad-2fba-4abb-9acf-8260e596d108 None admin] PATH_INFO: `/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:06.320984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca64ad-2fba-4abb-9acf-8260e596d108 None admin] RBAC: Authorizing `identity:get_user(user_id=7e9333f1aa1b4eae9a0f479d3c29fb15)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:06.322446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca64ad-2fba-4abb-9acf-8260e596d108 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:06.324148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 19/34] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:06 2022] GET /identity/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:06.324911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca64ad-2fba-4abb-9acf-8260e596d108 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:06.355310 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bc0fd-c17a-454b-bc8f-e8af7db5afbb None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:06.376240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:06.395699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06460fa-bca2-4d94-9525-067fa4d22368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:06.396735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06460fa-bca2-4d94-9525-067fa4d22368 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:06.397248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06460fa-bca2-4d94-9525-067fa4d22368 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:06.397710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06460fa-bca2-4d94-9525-067fa4d22368 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:06.398668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06460fa-bca2-4d94-9525-067fa4d22368 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:06.400418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06460fa-bca2-4d94-9525-067fa4d22368 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:06.424536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca64ad-2fba-4abb-9acf-8260e596d108 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:06.458889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851afb0-3c79-47bc-9e56-4d3cfe967766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:06.459586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851afb0-3c79-47bc-9e56-4d3cfe967766 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:06.459868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851afb0-3c79-47bc-9e56-4d3cfe967766 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:06.460147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851afb0-3c79-47bc-9e56-4d3cfe967766 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:06.460868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851afb0-3c79-47bc-9e56-4d3cfe967766 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:06.462347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851afb0-3c79-47bc-9e56-4d3cfe967766 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:06.534814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 16/35] 10.222.0.36 () {60 vars in 1131 bytes} [Sun Jun 26 02:51:06 2022] POST /identity/v3/roles => generated 219 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:51:06.539986 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06460fa-bca2-4d94-9525-067fa4d22368 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:06.631172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 20/36] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:51:06 2022] POST /identity/v3/projects => generated 301 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:51:06.632726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851afb0-3c79-47bc-9e56-4d3cfe967766 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:06.671926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:06.688424 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06460fa-bca2-4d94-9525-067fa4d22368 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:06.728919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc34e89-fb5f-4363-81f5-0f8b3a78cc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:06.729639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc34e89-fb5f-4363-81f5-0f8b3a78cc3e None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:06.729924 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc34e89-fb5f-4363-81f5-0f8b3a78cc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:06.730204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc34e89-fb5f-4363-81f5-0f8b3a78cc3e None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:06.731349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc34e89-fb5f-4363-81f5-0f8b3a78cc3e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:06.733006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc34e89-fb5f-4363-81f5-0f8b3a78cc3e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:06.749709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 17/37] 10.222.0.36 () {60 vars in 1131 bytes} [Sun Jun 26 02:51:06 2022] POST /identity/v3/roles => generated 225 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:51:06.751376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57399b-c0b3-4d91-bb8b-55c84665892d None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:06.751796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57399b-c0b3-4d91-bb8b-55c84665892d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:06.752083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57399b-c0b3-4d91-bb8b-55c84665892d None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:06.753944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 18/38] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:06.760266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6bf17-83ab-4daa-8bb8-ad627ca5ea92 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:06.760604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6bf17-83ab-4daa-8bb8-ad627ca5ea92 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:06.760933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6bf17-83ab-4daa-8bb8-ad627ca5ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:06.780630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851afb0-3c79-47bc-9e56-4d3cfe967766 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:06.781485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f4a6bf17-83ab-4daa-8bb8-ad627ca5ea92 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:06.783363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f4a6bf17-83ab-4daa-8bb8-ad627ca5ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:06.822351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aad0a4-dc9f-473b-8fb0-faf3f8894e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:06.823001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:06.824573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aad0a4-dc9f-473b-8fb0-faf3f8894e59 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:06.825104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aad0a4-dc9f-473b-8fb0-faf3f8894e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:06.825536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aad0a4-dc9f-473b-8fb0-faf3f8894e59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:06.827729 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aad0a4-dc9f-473b-8fb0-faf3f8894e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:06.829626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aad0a4-dc9f-473b-8fb0-faf3f8894e59 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:06.831620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 21/39] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:06.841554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aad0a4-dc9f-473b-8fb0-faf3f8894e59 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:06.906188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 19/40] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:06.949461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6bf17-83ab-4daa-8bb8-ad627ca5ea92 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:07.094042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:07.111918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aad0a4-dc9f-473b-8fb0-faf3f8894e59 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:07.115667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6bf17-83ab-4daa-8bb8-ad627ca5ea92 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:07.147422 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4f3c1-2e50-4a2c-852e-0ef1697c1336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:07.148347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4f3c1-2e50-4a2c-852e-0ef1697c1336 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:07.148635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4f3c1-2e50-4a2c-852e-0ef1697c1336 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:07.148915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4f3c1-2e50-4a2c-852e-0ef1697c1336 None admin] PATH_INFO: `/v3/domains/default/users/7e9333f1aa1b4eae9a0f479d3c29fb15/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:07.150235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b960668-9ff8-4be0-950e-9a48ea5110ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:07.150979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b960668-9ff8-4be0-950e-9a48ea5110ab None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:07.151169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4f3c1-2e50-4a2c-852e-0ef1697c1336 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7e9333f1aa1b4eae9a0f479d3c29fb15, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:07.151335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b960668-9ff8-4be0-950e-9a48ea5110ab None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:07.151569 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b960668-9ff8-4be0-950e-9a48ea5110ab None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:07.152324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b960668-9ff8-4be0-950e-9a48ea5110ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:07.152731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4f3c1-2e50-4a2c-852e-0ef1697c1336 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:07.153780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b960668-9ff8-4be0-950e-9a48ea5110ab None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:07.168672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1131 bytes} [Sun Jun 26 02:51:06 2022] POST /identity/v3/roles => generated 223 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:51:07.169225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 22/42] 10.222.0.36 () {58 vars in 1361 bytes} [Sun Jun 26 02:51:06 2022] PUT /identity/v3/domains/default/users/7e9333f1aa1b4eae9a0f479d3c29fb15/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:07.244107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ccbf4-4ebc-419f-a6c2-93cd12837bca None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:07.244472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ccbf4-4ebc-419f-a6c2-93cd12837bca None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:07.244635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ccbf4-4ebc-419f-a6c2-93cd12837bca None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:07.246145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 21/43] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:07.252991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788c94-ab09-4731-879a-a8b2e7cd3873 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:07.253248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788c94-ab09-4731-879a-a8b2e7cd3873 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:07.253560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788c94-ab09-4731-879a-a8b2e7cd3873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:07.272835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-97788c94-ab09-4731-879a-a8b2e7cd3873 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:07.274448 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-97788c94-ab09-4731-879a-a8b2e7cd3873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:07.353790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 23/44] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:07.377284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ccbf4-4ebc-419f-a6c2-93cd12837bca None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:07.408569 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:07.485448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ccbf4-4ebc-419f-a6c2-93cd12837bca None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:07.525397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9139fda-8955-4813-94dc-98897a8d7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:07.526211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139fda-8955-4813-94dc-98897a8d7288 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:07.526497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139fda-8955-4813-94dc-98897a8d7288 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:07.526778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139fda-8955-4813-94dc-98897a8d7288 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:07.528069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9139fda-8955-4813-94dc-98897a8d7288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:07.529574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9139fda-8955-4813-94dc-98897a8d7288 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:07.531245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 22/45] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:07.536935 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97788c94-ab09-4731-879a-a8b2e7cd3873 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:07.615668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:07.642446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97788c94-ab09-4731-879a-a8b2e7cd3873 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:07.679878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3ff1b-c37b-48a0-aa31-2373311c62d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:07.680557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3ff1b-c37b-48a0-aa31-2373311c62d0 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:07.680844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3ff1b-c37b-48a0-aa31-2373311c62d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:07.681126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3ff1b-c37b-48a0-aa31-2373311c62d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:07.681863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3ff1b-c37b-48a0-aa31-2373311c62d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:07.683392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3ff1b-c37b-48a0-aa31-2373311c62d0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:07.710210 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:51:07 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:51:09.217015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415ced5-08c9-46a4-bc08-4062d2dcc4e8 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:09.217634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415ced5-08c9-46a4-bc08-4062d2dcc4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:09.217634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415ced5-08c9-46a4-bc08-4062d2dcc4e8 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:09.219077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 23/47] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:09.224437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfec73-3dc2-4500-bb45-e683873fcbf1 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:09.224868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfec73-3dc2-4500-bb45-e683873fcbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:09.224984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfec73-3dc2-4500-bb45-e683873fcbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:09.242198 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8edfec73-3dc2-4500-bb45-e683873fcbf1 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:09.243409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8edfec73-3dc2-4500-bb45-e683873fcbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:09.313260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 25/48] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:09.336739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415ced5-08c9-46a4-bc08-4062d2dcc4e8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:09.437115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:09.445421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415ced5-08c9-46a4-bc08-4062d2dcc4e8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:09.480674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4ff76-3ecd-407d-a740-56012b8b9818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:09.481395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4ff76-3ecd-407d-a740-56012b8b9818 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:09.481679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4ff76-3ecd-407d-a740-56012b8b9818 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:09.481960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4ff76-3ecd-407d-a740-56012b8b9818 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:09.493258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4ff76-3ecd-407d-a740-56012b8b9818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-afb4ff76-3ecd-407d-a740-56012b8b9818 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:09.500953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:09.501789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:09.502608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 24/49] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:09.508119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfec73-3dc2-4500-bb45-e683873fcbf1 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:09.563630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:09.609673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfec73-3dc2-4500-bb45-e683873fcbf1 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:09.644784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e4a15-c154-4084-9040-8ee099168e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:09.645456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e4a15-c154-4084-9040-8ee099168e3e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:09.645745 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e4a15-c154-4084-9040-8ee099168e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:09.646021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e4a15-c154-4084-9040-8ee099168e3e None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:09.646780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e4a15-c154-4084-9040-8ee099168e3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:09.647121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e4a15-c154-4084-9040-8ee099168e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:09.648545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e4a15-c154-4084-9040-8ee099168e3e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:09.656902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 26/50] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:09.662627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4ff76-3ecd-407d-a740-56012b8b9818 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:09.721693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c14ba6-dc27-4b4c-ada1-40e4a29939a2 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:09.721983 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c14ba6-dc27-4b4c-ada1-40e4a29939a2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:09.722272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c14ba6-dc27-4b4c-ada1-40e4a29939a2 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:09.723742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 27/51] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:09.728621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ffe7-f4e7-4fd0-a98c-d7ac7d5b0016 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:09.728914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ffe7-f4e7-4fd0-a98c-d7ac7d5b0016 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:09.729198 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ffe7-f4e7-4fd0-a98c-d7ac7d5b0016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:09.745609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d200ffe7-f4e7-4fd0-a98c-d7ac7d5b0016 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:09.746753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d200ffe7-f4e7-4fd0-a98c-d7ac7d5b0016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:09.767802 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4ff76-3ecd-407d-a740-56012b8b9818 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:09.801973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e86700-0a60-4648-8226-4f4ab633c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:09.802875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86700-0a60-4648-8226-4f4ab633c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:09.803202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86700-0a60-4648-8226-4f4ab633c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:09.803478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86700-0a60-4648-8226-4f4ab633c3b2 None admin] PATH_INFO: `/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:09.804927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e86700-0a60-4648-8226-4f4ab633c3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=7e9333f1aa1b4eae9a0f479d3c29fb15)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:09.806421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e86700-0a60-4648-8226-4f4ab633c3b2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:09.808089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 25/52] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:09 2022] GET /identity/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:09.813431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e86700-0a60-4648-8226-4f4ab633c3b2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:09.816315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 28/53] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:09.838428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:09.839429 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200ffe7-f4e7-4fd0-a98c-d7ac7d5b0016 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:09.887652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:09.913677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e86700-0a60-4648-8226-4f4ab633c3b2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:09.938553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200ffe7-f4e7-4fd0-a98c-d7ac7d5b0016 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:09.946377 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99cb4-8793-4df5-94cd-85dd9e4ec25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:09.947215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99cb4-8793-4df5-94cd-85dd9e4ec25b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:09.947504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99cb4-8793-4df5-94cd-85dd9e4ec25b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:09.947782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99cb4-8793-4df5-94cd-85dd9e4ec25b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:09.948957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb99cb4-8793-4df5-94cd-85dd9e4ec25b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:09.950558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb99cb4-8793-4df5-94cd-85dd9e4ec25b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:09.952222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 26/54] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:09.957975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99cb4-8793-4df5-94cd-85dd9e4ec25b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:09.971313 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f593d5e-cd88-4dc4-b276-b56c21294caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:09.972125 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f593d5e-cd88-4dc4-b276-b56c21294caf None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:09.972409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f593d5e-cd88-4dc4-b276-b56c21294caf None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:09.972682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f593d5e-cd88-4dc4-b276-b56c21294caf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:09.973849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f593d5e-cd88-4dc4-b276-b56c21294caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:09.975334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f593d5e-cd88-4dc4-b276-b56c21294caf None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:09.976966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 29/55] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:09.982495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f593d5e-cd88-4dc4-b276-b56c21294caf None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:10.049300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:10.059154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99cb4-8793-4df5-94cd-85dd9e4ec25b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:10.078132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f593d5e-cd88-4dc4-b276-b56c21294caf None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:10.093486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656c839-9ce0-4fe2-bf48-2bf1552d0255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:10.093911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:10.094148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656c839-9ce0-4fe2-bf48-2bf1552d0255 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:10.094439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656c839-9ce0-4fe2-bf48-2bf1552d0255 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:10.094711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656c839-9ce0-4fe2-bf48-2bf1552d0255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:10.095654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656c839-9ce0-4fe2-bf48-2bf1552d0255 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.domain.id=default, user.id=7e9333f1aa1b4eae9a0f479d3c29fb15) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:10.096007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656c839-9ce0-4fe2-bf48-2bf1552d0255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:10.097548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656c839-9ce0-4fe2-bf48-2bf1552d0255 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:10.103512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 27/56] 10.222.0.36 () {56 vars in 1322 bytes} [Sun Jun 26 02:51:09 2022] GET /identity/v3/role_assignments?user.id=7e9333f1aa1b4eae9a0f479d3c29fb15&scope.domain.id=default&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:10.111268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b27b3-703c-4134-a78c-17e7c847c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:10.111959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b27b3-703c-4134-a78c-17e7c847c43a None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:10.112244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b27b3-703c-4134-a78c-17e7c847c43a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:10.112525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b27b3-703c-4134-a78c-17e7c847c43a None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:10.113262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b27b3-703c-4134-a78c-17e7c847c43a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:10.114775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b27b3-703c-4134-a78c-17e7c847c43a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:10.144544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 30/57] 10.222.0.36 () {60 vars in 1140 bytes} [Sun Jun 26 02:51:09 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:51:12.176682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171278-7553-4df4-8bce-5e7f98a5a581 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:12.177227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171278-7553-4df4-8bce-5e7f98a5a581 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:12.177227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171278-7553-4df4-8bce-5e7f98a5a581 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:12.178651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 28/58] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:12.184764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f8413-d9aa-472c-8f03-efb9fc0ee280 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:12.185168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f8413-d9aa-472c-8f03-efb9fc0ee280 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:12.185334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f8413-d9aa-472c-8f03-efb9fc0ee280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:12.203208 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-450f8413-d9aa-472c-8f03-efb9fc0ee280 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:12.204416 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-450f8413-d9aa-472c-8f03-efb9fc0ee280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:12.281055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 31/59] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:12.305900 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a171278-7553-4df4-8bce-5e7f98a5a581 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:12.410486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a171278-7553-4df4-8bce-5e7f98a5a581 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:12.445663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5a9eb-c2fa-4eab-871a-e18df6790ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:12.446376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5a9eb-c2fa-4eab-871a-e18df6790ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:12.446661 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5a9eb-c2fa-4eab-871a-e18df6790ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:12.446947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5a9eb-c2fa-4eab-871a-e18df6790ee3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:12.448293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5a9eb-c2fa-4eab-871a-e18df6790ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:12.449812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5a9eb-c2fa-4eab-871a-e18df6790ee3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:12.451448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 29/60] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:12.457065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f8413-d9aa-472c-8f03-efb9fc0ee280 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:12.550874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:12.555072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f8413-d9aa-472c-8f03-efb9fc0ee280 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:12.593022 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865b27f-633e-4913-8aec-47a39a79c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:12.593686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b27f-633e-4913-8aec-47a39a79c538 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:12.593967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b27f-633e-4913-8aec-47a39a79c538 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:12.594240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b27f-633e-4913-8aec-47a39a79c538 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:12.594945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865b27f-633e-4913-8aec-47a39a79c538 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:12.596454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865b27f-633e-4913-8aec-47a39a79c538 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:12.627997 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 32/61] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:51:12 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:51:15.772585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a603a-99ac-44de-9483-6b1fd0d8c4a7 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:15.773102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a603a-99ac-44de-9483-6b1fd0d8c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:15.773176 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a603a-99ac-44de-9483-6b1fd0d8c4a7 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:15.774528 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 30/62] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:15.779991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844a8ab-4dc6-4c84-bc30-0415c8c7b4ea None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:15.780878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844a8ab-4dc6-4c84-bc30-0415c8c7b4ea None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:15.781375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844a8ab-4dc6-4c84-bc30-0415c8c7b4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:15.784353 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb3a1b-dce2-40c6-bb16-a098dbd6d079 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:15.784867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb3a1b-dce2-40c6-bb16-a098dbd6d079 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:15.785337 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb3a1b-dce2-40c6-bb16-a098dbd6d079 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:15.786887 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:15.792383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028a646-3e00-4ea5-8d8a-d515f7dadcc0 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:15.792902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028a646-3e00-4ea5-8d8a-d515f7dadcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:15.793371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028a646-3e00-4ea5-8d8a-d515f7dadcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:15.816470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-2844a8ab-4dc6-4c84-bc30-0415c8c7b4ea None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:15.818147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2844a8ab-4dc6-4c84-bc30-0415c8c7b4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:15.823964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c028a646-3e00-4ea5-8d8a-d515f7dadcc0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:15.825583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c028a646-3e00-4ea5-8d8a-d515f7dadcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:15.863387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:15.942956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 33/64] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:15.960818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 32/65] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:15.992490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844a8ab-4dc6-4c84-bc30-0415c8c7b4ea None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:16.002089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028a646-3e00-4ea5-8d8a-d515f7dadcc0 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:16.133365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:16.155539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844a8ab-4dc6-4c84-bc30-0415c8c7b4ea None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:16.194342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf6861-f1d3-43b5-acd4-472c23d720a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:16.195467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6861-f1d3-43b5-acd4-472c23d720a2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.195932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6861-f1d3-43b5-acd4-472c23d720a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.196358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf6861-f1d3-43b5-acd4-472c23d720a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.207439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf6861-f1d3-43b5-acd4-472c23d720a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-a3bf6861-f1d3-43b5-acd4-472c23d720a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:16.215443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:16.216482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:16.217320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:16.217969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 34/66] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:16.219191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aad1e9-f0ca-4ffd-bd0c-6c68bfed572d None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.219486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aad1e9-f0ca-4ffd-bd0c-6c68bfed572d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.219876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aad1e9-f0ca-4ffd-bd0c-6c68bfed572d None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.225025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 35/67] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:16.225025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba735dc6-3eb4-4784-b6d7-ae3d0534fcad None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.225025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba735dc6-3eb4-4784-b6d7-ae3d0534fcad None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.225025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba735dc6-3eb4-4784-b6d7-ae3d0534fcad None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.225025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 36/68] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:16.225025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba735dc6-3eb4-4784-b6d7-ae3d0534fcad None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:16.262922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028a646-3e00-4ea5-8d8a-d515f7dadcc0 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:16.302852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a061-b3af-41e6-8a3b-d687f2a17014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:16.303684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a061-b3af-41e6-8a3b-d687f2a17014 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.303973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a061-b3af-41e6-8a3b-d687f2a17014 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.304249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a061-b3af-41e6-8a3b-d687f2a17014 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.314427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94a061-b3af-41e6-8a3b-d687f2a17014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9d94a061-b3af-41e6-8a3b-d687f2a17014 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:16.322073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:16.323754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 33/69] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:51:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:16.324514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b794b-cbf4-4d87-b487-fff296116a29 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.325181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b794b-cbf4-4d87-b487-fff296116a29 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.325181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b794b-cbf4-4d87-b487-fff296116a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.340388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba735dc6-3eb4-4784-b6d7-ae3d0534fcad None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:16.343467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e49b794b-cbf4-4d87-b487-fff296116a29 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:16.344701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e49b794b-cbf4-4d87-b487-fff296116a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:16.354267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:16.375892 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be820f8c-9cb3-4a7c-bd27-4b2ecedfbdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:16.376575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be820f8c-9cb3-4a7c-bd27-4b2ecedfbdfb None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.376861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be820f8c-9cb3-4a7c-bd27-4b2ecedfbdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.377140 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be820f8c-9cb3-4a7c-bd27-4b2ecedfbdfb None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.377893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be820f8c-9cb3-4a7c-bd27-4b2ecedfbdfb None admin] RBAC: Adding query filter params (name=member) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:16.378207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be820f8c-9cb3-4a7c-bd27-4b2ecedfbdfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:16.379645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be820f8c-9cb3-4a7c-bd27-4b2ecedfbdfb None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:16.392858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 37/70] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:16.392858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfbae5-761f-448f-a923-1a4d54707963 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.392858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfbae5-761f-448f-a923-1a4d54707963 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.392858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfbae5-761f-448f-a923-1a4d54707963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.402033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:16.408477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-1abfbae5-761f-448f-a923-1a4d54707963 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:16.409667 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1abfbae5-761f-448f-a923-1a4d54707963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:16.421958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 34/71] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:16.422813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b794b-cbf4-4d87-b487-fff296116a29 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:16.475135 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 38/72] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:16.475985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfbae5-761f-448f-a923-1a4d54707963 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:16.523296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b794b-cbf4-4d87-b487-fff296116a29 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:16.556221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec9c32-7bc1-41f8-9347-29e8f3dbf99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:16.556896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec9c32-7bc1-41f8-9347-29e8f3dbf99a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.557179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec9c32-7bc1-41f8-9347-29e8f3dbf99a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.557457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec9c32-7bc1-41f8-9347-29e8f3dbf99a None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.558221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec9c32-7bc1-41f8-9347-29e8f3dbf99a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:16.558529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec9c32-7bc1-41f8-9347-29e8f3dbf99a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:16.559968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec9c32-7bc1-41f8-9347-29e8f3dbf99a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:16.568681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 35/73] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:16.569897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34287-b02c-4ac8-aaf7-76b2f3f31c22 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.570186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34287-b02c-4ac8-aaf7-76b2f3f31c22 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.570462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34287-b02c-4ac8-aaf7-76b2f3f31c22 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.571739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 36/74] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:16.575815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c34287-b02c-4ac8-aaf7-76b2f3f31c22 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:16.580567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfbae5-761f-448f-a923-1a4d54707963 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:16.586023 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:16.621405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd77663-6c73-4477-92da-21bdebfc7a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:16.622310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd77663-6c73-4477-92da-21bdebfc7a20 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.622599 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd77663-6c73-4477-92da-21bdebfc7a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.622867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd77663-6c73-4477-92da-21bdebfc7a20 None admin] PATH_INFO: `/v3/users/f058e8cc10ad4965a0a08401171a50a3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.625700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:16.637166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd77663-6c73-4477-92da-21bdebfc7a20 None admin] RBAC: Authorizing `identity:get_user(user_id=f058e8cc10ad4965a0a08401171a50a3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:16.638673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd77663-6c73-4477-92da-21bdebfc7a20 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:16.640569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 39/75] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:16 2022] GET /identity/v3/users/f058e8cc10ad4965a0a08401171a50a3 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:16.641208 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd77663-6c73-4477-92da-21bdebfc7a20 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:16.682395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c34287-b02c-4ac8-aaf7-76b2f3f31c22 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:16.714815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdde7f-816f-424d-90fd-fc84a31c811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:16.715663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdde7f-816f-424d-90fd-fc84a31c811d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.715950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdde7f-816f-424d-90fd-fc84a31c811d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.716232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdde7f-816f-424d-90fd-fc84a31c811d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.727024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdde7f-816f-424d-90fd-fc84a31c811d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-06cdde7f-816f-424d-90fd-fc84a31c811d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:16.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:16.736060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:16.736800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:16.737380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd77663-6c73-4477-92da-21bdebfc7a20 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:16.737447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 37/76] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:51:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:16.738122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdde7f-816f-424d-90fd-fc84a31c811d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:16.770264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85ef38-1053-4980-aa10-6cba950f9d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:16.771133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ef38-1053-4980-aa10-6cba950f9d7a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.771430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ef38-1053-4980-aa10-6cba950f9d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.771714 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ef38-1053-4980-aa10-6cba950f9d7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.781658 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85ef38-1053-4980-aa10-6cba950f9d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-3f85ef38-1053-4980-aa10-6cba950f9d7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:16.789260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:16.790119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:16.790859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 40/77] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:16.792413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698266-79e4-4254-9a9a-66688d3423cc None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.792413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698266-79e4-4254-9a9a-66688d3423cc None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.792555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698266-79e4-4254-9a9a-66688d3423cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.802660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:16.809578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-c5698266-79e4-4254-9a9a-66688d3423cc None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:16.810765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c5698266-79e4-4254-9a9a-66688d3423cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:16.838205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdde7f-816f-424d-90fd-fc84a31c811d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:16.858219 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:16.871862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af0e8d-a70d-45fa-b000-70064492ab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:16.872748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af0e8d-a70d-45fa-b000-70064492ab9f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:16.873029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af0e8d-a70d-45fa-b000-70064492ab9f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:16.873303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af0e8d-a70d-45fa-b000-70064492ab9f None admin] PATH_INFO: `/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:16.874590 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af0e8d-a70d-45fa-b000-70064492ab9f None admin] RBAC: Authorizing `identity:get_user(user_id=7e9333f1aa1b4eae9a0f479d3c29fb15)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:16.876000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 41/78] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:16.876811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698266-79e4-4254-9a9a-66688d3423cc None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:16.879074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af0e8d-a70d-45fa-b000-70064492ab9f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:16.886163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 38/79] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:16 2022] GET /identity/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:16.886163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af0e8d-a70d-45fa-b000-70064492ab9f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:16.976338 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698266-79e4-4254-9a9a-66688d3423cc None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:16.990545 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af0e8d-a70d-45fa-b000-70064492ab9f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:17.010230 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107e56-db0f-4693-b561-f585dd43431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:17.010889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107e56-db0f-4693-b561-f585dd43431a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:17.011201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107e56-db0f-4693-b561-f585dd43431a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:17.011481 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107e56-db0f-4693-b561-f585dd43431a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:17.023664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf25af6-b388-45b1-941c-571eb0c8cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:17.024341 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf25af6-b388-45b1-941c-571eb0c8cd5e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:17.024623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf25af6-b388-45b1-941c-571eb0c8cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:17.024901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf25af6-b388-45b1-941c-571eb0c8cd5e None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:17.025661 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf25af6-b388-45b1-941c-571eb0c8cd5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:17.026255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf25af6-b388-45b1-941c-571eb0c8cd5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:17.028313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf25af6-b388-45b1-941c-571eb0c8cd5e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:17.029726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:17.038045 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 39/80] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:51:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:17.039298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf25af6-b388-45b1-941c-571eb0c8cd5e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:17.076462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:17.092210 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef107e56-db0f-4693-b561-f585dd43431a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:17.093750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef107e56-db0f-4693-b561-f585dd43431a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:17.141297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf25af6-b388-45b1-941c-571eb0c8cd5e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:17.174888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eace8-6fec-4545-a8e9-9e612d89a97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:17.175585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eace8-6fec-4545-a8e9-9e612d89a97d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:17.175873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eace8-6fec-4545-a8e9-9e612d89a97d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:17.176150 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eace8-6fec-4545-a8e9-9e612d89a97d None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:17.176884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eace8-6fec-4545-a8e9-9e612d89a97d None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:17.177188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eace8-6fec-4545-a8e9-9e612d89a97d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:17.178566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eace8-6fec-4545-a8e9-9e612d89a97d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:17.186540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 40/81] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:17.188631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eace8-6fec-4545-a8e9-9e612d89a97d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:17.202530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 42/82] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:17.202530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107e56-db0f-4693-b561-f585dd43431a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:17.246424 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:17.282555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:17.288610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eace8-6fec-4545-a8e9-9e612d89a97d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:17.298614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107e56-db0f-4693-b561-f585dd43431a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:17.320966 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d4393-9d3e-4073-ae1f-2f18b0a13672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:17.321622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d4393-9d3e-4073-ae1f-2f18b0a13672 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:17.321909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d4393-9d3e-4073-ae1f-2f18b0a13672 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:17.322187 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d4393-9d3e-4073-ae1f-2f18b0a13672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:17.332007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d4f5c-a384-4c40-b7ff-00a0d6c14098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:17.332811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d4f5c-a384-4c40-b7ff-00a0d6c14098 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:17.333097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d4f5c-a384-4c40-b7ff-00a0d6c14098 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:17.333378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d4f5c-a384-4c40-b7ff-00a0d6c14098 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:17.334585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d4f5c-a384-4c40-b7ff-00a0d6c14098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:17.336113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d4f5c-a384-4c40-b7ff-00a0d6c14098 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:17.342196 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 43/83] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:17.342196 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d4f5c-a384-4c40-b7ff-00a0d6c14098 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:17.392941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d4393-9d3e-4073-ae1f-2f18b0a13672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:17.394399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d4393-9d3e-4073-ae1f-2f18b0a13672 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:17.440010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d4f5c-a384-4c40-b7ff-00a0d6c14098 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:17.449578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:17.473536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b17dc-21c1-48ed-b0f8-5868b03724c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:17.474452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b17dc-21c1-48ed-b0f8-5868b03724c9 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:17.474713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b17dc-21c1-48ed-b0f8-5868b03724c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:17.475009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b17dc-21c1-48ed-b0f8-5868b03724c9 None admin] PATH_INFO: `/v3/users/f058e8cc10ad4965a0a08401171a50a3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:17.476222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b17dc-21c1-48ed-b0f8-5868b03724c9 None admin] RBAC: Authorizing `identity:get_user(user_id=f058e8cc10ad4965a0a08401171a50a3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:17.477744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b17dc-21c1-48ed-b0f8-5868b03724c9 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:17.483848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 44/84] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:17 2022] GET /identity/v3/users/f058e8cc10ad4965a0a08401171a50a3 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:17.483848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b17dc-21c1-48ed-b0f8-5868b03724c9 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:17.493466 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 41/85] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:17.498978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d4393-9d3e-4073-ae1f-2f18b0a13672 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:17.503225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:17.581418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b17dc-21c1-48ed-b0f8-5868b03724c9 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:17.596501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d4393-9d3e-4073-ae1f-2f18b0a13672 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:17.616600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043b65a-6140-4192-a8d5-33b5ae76272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:17.617492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043b65a-6140-4192-a8d5-33b5ae76272c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:17.617777 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043b65a-6140-4192-a8d5-33b5ae76272c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:17.618057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043b65a-6140-4192-a8d5-33b5ae76272c None admin] PATH_INFO: `/v3/users/f058e8cc10ad4965a0a08401171a50a3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:17.619303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043b65a-6140-4192-a8d5-33b5ae76272c None admin] RBAC: Authorizing `identity:get_user(user_id=f058e8cc10ad4965a0a08401171a50a3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:17.620800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043b65a-6140-4192-a8d5-33b5ae76272c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:17.622452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 45/86] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:17 2022] GET /identity/v3/users/f058e8cc10ad4965a0a08401171a50a3 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:17.623212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043b65a-6140-4192-a8d5-33b5ae76272c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:17.631904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf9b1-c1c9-42be-8eeb-111998f97e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:17.632791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf9b1-c1c9-42be-8eeb-111998f97e76 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:17.633077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf9b1-c1c9-42be-8eeb-111998f97e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:17.633363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf9b1-c1c9-42be-8eeb-111998f97e76 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:17.634559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bf9b1-c1c9-42be-8eeb-111998f97e76 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:17.636078 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bf9b1-c1c9-42be-8eeb-111998f97e76 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:17.637775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 42/87] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:17 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:17.638537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf9b1-c1c9-42be-8eeb-111998f97e76 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:17.665783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:17.707034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:17.719698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043b65a-6140-4192-a8d5-33b5ae76272c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:17.740867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf9b1-c1c9-42be-8eeb-111998f97e76 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:17.756358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5841f-0fa8-4107-8711-67a2d2fbb6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:17.756959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5841f-0fa8-4107-8711-67a2d2fbb6e3 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:17.757266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5841f-0fa8-4107-8711-67a2d2fbb6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:17.757531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5841f-0fa8-4107-8711-67a2d2fbb6e3 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:17.758258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5841f-0fa8-4107-8711-67a2d2fbb6e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:17.759778 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5841f-0fa8-4107-8711-67a2d2fbb6e3 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:17.776194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743851c-7011-4bd7-b72a-e6cc74e572c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:17.776883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743851c-7011-4bd7-b72a-e6cc74e572c1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:17.777173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743851c-7011-4bd7-b72a-e6cc74e572c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:17.777449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743851c-7011-4bd7-b72a-e6cc74e572c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:17.780435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 46/88] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:51:17 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:51:17.781110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5841f-0fa8-4107-8711-67a2d2fbb6e3 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:17.856196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743851c-7011-4bd7-b72a-e6cc74e572c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:17.857816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743851c-7011-4bd7-b72a-e6cc74e572c1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:17.888150 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:17.912749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5841f-0fa8-4107-8711-67a2d2fbb6e3 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:17.957436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8a9e2-f5e3-4ab7-a5b7-7547a486ffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:17.958575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8a9e2-f5e3-4ab7-a5b7-7547a486ffe9 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:17.958873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8a9e2-f5e3-4ab7-a5b7-7547a486ffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:17.959162 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8a9e2-f5e3-4ab7-a5b7-7547a486ffe9 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:17.960390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8a9e2-f5e3-4ab7-a5b7-7547a486ffe9 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:17.961860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8a9e2-f5e3-4ab7-a5b7-7547a486ffe9 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:17.963834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 47/89] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:17 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:17.964513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8a9e2-f5e3-4ab7-a5b7-7547a486ffe9 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:17.980970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:17.981968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 43/90] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:17.986968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743851c-7011-4bd7-b72a-e6cc74e572c1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:18.090479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8a9e2-f5e3-4ab7-a5b7-7547a486ffe9 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:18.117936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743851c-7011-4bd7-b72a-e6cc74e572c1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:18.128213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64b582-0b02-40d4-8424-9335e54b7945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:18.129116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64b582-0b02-40d4-8424-9335e54b7945 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:18.129530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64b582-0b02-40d4-8424-9335e54b7945 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:18.130043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64b582-0b02-40d4-8424-9335e54b7945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:18.148067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:18.161018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f8b3c-e2cd-4f44-b07b-43fc1e1ed4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:18.161917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f8b3c-e2cd-4f44-b07b-43fc1e1ed4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:18.162200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f8b3c-e2cd-4f44-b07b-43fc1e1ed4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:18.162478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f8b3c-e2cd-4f44-b07b-43fc1e1ed4c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:18.163359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f8b3c-e2cd-4f44-b07b-43fc1e1ed4c1 None admin] RBAC: Adding query filter params (role.id=729faf69df60450caeada9c53520224f, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58, user.id=f058e8cc10ad4965a0a08401171a50a3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:18.163673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f8b3c-e2cd-4f44-b07b-43fc1e1ed4c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:18.165130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f8b3c-e2cd-4f44-b07b-43fc1e1ed4c1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:18.171405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 44/91] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:17 2022] GET /identity/v3/role_assignments?user.id=f058e8cc10ad4965a0a08401171a50a3&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=729faf69df60450caeada9c53520224f => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:18.172220 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f8b3c-e2cd-4f44-b07b-43fc1e1ed4c1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:18.210028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64b582-0b02-40d4-8424-9335e54b7945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:18.211993 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64b582-0b02-40d4-8424-9335e54b7945 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:18.229036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:18.327009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 48/92] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:18.328404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64b582-0b02-40d4-8424-9335e54b7945 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:18.359702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f8b3c-e2cd-4f44-b07b-43fc1e1ed4c1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:18.437833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64b582-0b02-40d4-8424-9335e54b7945 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:18.441521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3633e-f110-4125-bd21-2049b3dfa969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:18.442180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3633e-f110-4125-bd21-2049b3dfa969 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:18.442469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3633e-f110-4125-bd21-2049b3dfa969 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:18.442749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3633e-f110-4125-bd21-2049b3dfa969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:18.443629 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3633e-f110-4125-bd21-2049b3dfa969 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58, user.id=7e9333f1aa1b4eae9a0f479d3c29fb15) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:18.443948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3633e-f110-4125-bd21-2049b3dfa969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:18.445480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3633e-f110-4125-bd21-2049b3dfa969 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:18.454109 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:18.461021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 45/93] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:18 2022] GET /identity/v3/role_assignments?user.id=7e9333f1aa1b4eae9a0f479d3c29fb15&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:18.461899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3633e-f110-4125-bd21-2049b3dfa969 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:18.478546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587fa8e-a5a2-42f9-b98c-73b76f222b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:18.479813 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587fa8e-a5a2-42f9-b98c-73b76f222b19 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:18.480307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587fa8e-a5a2-42f9-b98c-73b76f222b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:18.480822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587fa8e-a5a2-42f9-b98c-73b76f222b19 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:18.482378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587fa8e-a5a2-42f9-b98c-73b76f222b19 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:18.484346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587fa8e-a5a2-42f9-b98c-73b76f222b19 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:18.486461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 49/94] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:18 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:18.493090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587fa8e-a5a2-42f9-b98c-73b76f222b19 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:18.610170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587fa8e-a5a2-42f9-b98c-73b76f222b19 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:18.665452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:18.676321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884efa25-a1b1-46a8-b8e0-9ec29ffafc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:18.677918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884efa25-a1b1-46a8-b8e0-9ec29ffafc4b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:18.678396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884efa25-a1b1-46a8-b8e0-9ec29ffafc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:18.678864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884efa25-a1b1-46a8-b8e0-9ec29ffafc4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:18.680131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884efa25-a1b1-46a8-b8e0-9ec29ffafc4b None admin] RBAC: Adding query filter params (role.id=c81f6283cf3a418bad94b56a1e9ea2b3, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58, user.id=f058e8cc10ad4965a0a08401171a50a3) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:18.680916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884efa25-a1b1-46a8-b8e0-9ec29ffafc4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:18.682580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884efa25-a1b1-46a8-b8e0-9ec29ffafc4b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:18.691301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 50/95] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:18 2022] GET /identity/v3/role_assignments?user.id=f058e8cc10ad4965a0a08401171a50a3&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=c81f6283cf3a418bad94b56a1e9ea2b3 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:18.783646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3633e-f110-4125-bd21-2049b3dfa969 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:18.863869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5d395-b086-4be8-b758-e1b3a71a7561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:18.864697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5d395-b086-4be8-b758-e1b3a71a7561 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:18.864984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5d395-b086-4be8-b758-e1b3a71a7561 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:18.865263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5d395-b086-4be8-b758-e1b3a71a7561 None admin] PATH_INFO: `/v3/projects/d05fa48c30fc45e9b6fa48c7e283cd93` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:18.866592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5d395-b086-4be8-b758-e1b3a71a7561 None admin] RBAC: Authorizing `identity:get_project(project_id=d05fa48c30fc45e9b6fa48c7e283cd93)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:18.868131 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5d395-b086-4be8-b758-e1b3a71a7561 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:18.869914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 46/96] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:18 2022] GET /identity/v3/projects/d05fa48c30fc45e9b6fa48c7e283cd93 => generated 312 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:18.880241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884efa25-a1b1-46a8-b8e0-9ec29ffafc4b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:18.949381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:19.014768 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884efa25-a1b1-46a8-b8e0-9ec29ffafc4b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:19.066172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059f0de-efa4-4fbc-bbba-6c52b66bdb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:19.066851 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059f0de-efa4-4fbc-bbba-6c52b66bdb20 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:19.067160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059f0de-efa4-4fbc-bbba-6c52b66bdb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:19.067440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059f0de-efa4-4fbc-bbba-6c52b66bdb20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:19.068292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059f0de-efa4-4fbc-bbba-6c52b66bdb20 None admin] RBAC: Adding query filter params (role.id=729faf69df60450caeada9c53520224f, scope.project.id=d05fa48c30fc45e9b6fa48c7e283cd93, user.id=f058e8cc10ad4965a0a08401171a50a3) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:19.068611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059f0de-efa4-4fbc-bbba-6c52b66bdb20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:19.070136 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059f0de-efa4-4fbc-bbba-6c52b66bdb20 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:19.079328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 51/97] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:18 2022] GET /identity/v3/role_assignments?user.id=f058e8cc10ad4965a0a08401171a50a3&scope.project.id=d05fa48c30fc45e9b6fa48c7e283cd93&role.id=729faf69df60450caeada9c53520224f => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:20.447794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26125bc1-81a1-40b7-bc37-1782ab2706cd None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:20.448352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26125bc1-81a1-40b7-bc37-1782ab2706cd None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:20.448352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26125bc1-81a1-40b7-bc37-1782ab2706cd None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:20.449862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 47/98] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:20.455320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5a874-fdef-4e47-a170-5699262668b4 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:20.455722 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5a874-fdef-4e47-a170-5699262668b4 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:20.455879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5a874-fdef-4e47-a170-5699262668b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:20.473197 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-1eb5a874-fdef-4e47-a170-5699262668b4 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:20.474398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1eb5a874-fdef-4e47-a170-5699262668b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:20.561043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 52/99] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:20.596728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26125bc1-81a1-40b7-bc37-1782ab2706cd None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:20.642137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf075f-1e76-4c52-8f78-abb3d016f0cf None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:20.642440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf075f-1e76-4c52-8f78-abb3d016f0cf None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:20.642684 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf075f-1e76-4c52-8f78-abb3d016f0cf None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:20.644349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 53/100] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:20.651888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a363c-5eed-4fb2-a799-1bc3aa8ff18a None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:20.652174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a363c-5eed-4fb2-a799-1bc3aa8ff18a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:20.652455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a363c-5eed-4fb2-a799-1bc3aa8ff18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:20.672836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-db2a363c-5eed-4fb2-a799-1bc3aa8ff18a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:20.674008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-db2a363c-5eed-4fb2-a799-1bc3aa8ff18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:20.729530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:20.737741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26125bc1-81a1-40b7-bc37-1782ab2706cd None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:20.766227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:20.780614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c3b86-320d-4eb1-93fa-cf2b607c9018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:20.782157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3b86-320d-4eb1-93fa-cf2b607c9018 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:20.783171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3b86-320d-4eb1-93fa-cf2b607c9018 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:20.783459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3b86-320d-4eb1-93fa-cf2b607c9018 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:20.796255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c3b86-320d-4eb1-93fa-cf2b607c9018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-1e2c3b86-320d-4eb1-93fa-cf2b607c9018 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:20.804665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:20.805513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:20.806259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 48/101] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:20.809688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 54/102] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:20.813274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c3b86-320d-4eb1-93fa-cf2b607c9018 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:20.844586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a363c-5eed-4fb2-a799-1bc3aa8ff18a None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:20.978039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c3b86-320d-4eb1-93fa-cf2b607c9018 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:21.023372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7daac-b5e8-4205-a5ae-46066fc79172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:21.024385 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7daac-b5e8-4205-a5ae-46066fc79172 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.024865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7daac-b5e8-4205-a5ae-46066fc79172 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.025340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7daac-b5e8-4205-a5ae-46066fc79172 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.026309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7daac-b5e8-4205-a5ae-46066fc79172 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:21.026830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7daac-b5e8-4205-a5ae-46066fc79172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:21.028449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7daac-b5e8-4205-a5ae-46066fc79172 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:21.037034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 49/103] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:21.043016 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f87f60-5712-4b0d-a193-ac599f05563a None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.043639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f87f60-5712-4b0d-a193-ac599f05563a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.044161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f87f60-5712-4b0d-a193-ac599f05563a None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.046081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 50/104] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:21.050620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f87f60-5712-4b0d-a193-ac599f05563a None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:21.069119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a363c-5eed-4fb2-a799-1bc3aa8ff18a None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:21.103388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:21.160862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f87f60-5712-4b0d-a193-ac599f05563a None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:21.198130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0537a-c180-411a-87ec-dc69a2e88f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:21.199916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0537a-c180-411a-87ec-dc69a2e88f42 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.200736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f7831-1116-4c58-ac6e-0ef98ce35b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:21.202028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0537a-c180-411a-87ec-dc69a2e88f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.202615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0537a-c180-411a-87ec-dc69a2e88f42 None admin] PATH_INFO: `/v3/users/6c25391d5508473a90bd897fc5d05c56` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.203014 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f7831-1116-4c58-ac6e-0ef98ce35b98 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.204138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f7831-1116-4c58-ac6e-0ef98ce35b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.204627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f7831-1116-4c58-ac6e-0ef98ce35b98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.207566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f7831-1116-4c58-ac6e-0ef98ce35b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:21.210957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f7831-1116-4c58-ac6e-0ef98ce35b98 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:21.218268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 55/105] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:21.219968 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91f437-41fa-420a-92e0-080778968523 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.220506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91f437-41fa-420a-92e0-080778968523 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.221037 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91f437-41fa-420a-92e0-080778968523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.236302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0537a-c180-411a-87ec-dc69a2e88f42 None admin] RBAC: Authorizing `identity:get_user(user_id=6c25391d5508473a90bd897fc5d05c56)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:21.238135 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0537a-c180-411a-87ec-dc69a2e88f42 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:21.244546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 51/106] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:21 2022] GET /identity/v3/users/6c25391d5508473a90bd897fc5d05c56 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:21.247243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0537a-c180-411a-87ec-dc69a2e88f42 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:21.256050 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-2b91f437-41fa-420a-92e0-080778968523 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:21.263090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2b91f437-41fa-420a-92e0-080778968523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:21.329517 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:21.352667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0537a-c180-411a-87ec-dc69a2e88f42 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:21.355852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:21.387798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9ebfe-80c3-41c8-960a-e7e56afef719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:21.388834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9ebfe-80c3-41c8-960a-e7e56afef719 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.389359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9ebfe-80c3-41c8-960a-e7e56afef719 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.389867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9ebfe-80c3-41c8-960a-e7e56afef719 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.390946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9ebfe-80c3-41c8-960a-e7e56afef719 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:21.392652 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9ebfe-80c3-41c8-960a-e7e56afef719 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:21.437329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 52/107] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:51:21 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:51:21.439781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9ebfe-80c3-41c8-960a-e7e56afef719 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:21.443796 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 56/108] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:21.486498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91f437-41fa-420a-92e0-080778968523 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:21.564833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9ebfe-80c3-41c8-960a-e7e56afef719 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:21.603219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5997a-e078-4a9f-8798-4253f434438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:21.604357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5997a-e078-4a9f-8798-4253f434438b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.604845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5997a-e078-4a9f-8798-4253f434438b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.605336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5997a-e078-4a9f-8798-4253f434438b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.633375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:21.664597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91f437-41fa-420a-92e0-080778968523 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:21.688342 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5997a-e078-4a9f-8798-4253f434438b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:21.690241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5997a-e078-4a9f-8798-4253f434438b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:21.702937 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf054b2-700e-48a8-97ab-82bfb739e558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:21.703784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf054b2-700e-48a8-97ab-82bfb739e558 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.704070 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf054b2-700e-48a8-97ab-82bfb739e558 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.704349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf054b2-700e-48a8-97ab-82bfb739e558 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.715579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf054b2-700e-48a8-97ab-82bfb739e558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-adf054b2-700e-48a8-97ab-82bfb739e558 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:21.724027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:21.724880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:21.725645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 57/109] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:51:21.726731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b93f5-a587-4ad1-ae2a-0b2209db85cd None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.726731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b93f5-a587-4ad1-ae2a-0b2209db85cd None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.731017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b93f5-a587-4ad1-ae2a-0b2209db85cd None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.731017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 58/110] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:21.733856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36302b-f938-4f26-9641-70b177f614a3 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.734146 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36302b-f938-4f26-9641-70b177f614a3 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.734425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36302b-f938-4f26-9641-70b177f614a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.751810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-3b36302b-f938-4f26-9641-70b177f614a3 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:21.753081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3b36302b-f938-4f26-9641-70b177f614a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:21.776408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:21.808743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 53/111] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:21.810026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5997a-e078-4a9f-8798-4253f434438b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:21.830331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 59/112] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:21.835220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36302b-f938-4f26-9641-70b177f614a3 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:21.868566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:21.923870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5997a-e078-4a9f-8798-4253f434438b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:21.950357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36302b-f938-4f26-9641-70b177f614a3 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:21.972452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fb660-6631-4853-920f-407a6f8843fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:21.973144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb660-6631-4853-920f-407a6f8843fb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.973693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb660-6631-4853-920f-407a6f8843fb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.973977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fb660-6631-4853-920f-407a6f8843fb None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.975002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fb660-6631-4853-920f-407a6f8843fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:21.975731 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fb660-6631-4853-920f-407a6f8843fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:21.977388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fb660-6631-4853-920f-407a6f8843fb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:21.986001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cb7af-09db-41f8-a446-e74887bcba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:21.987006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cb7af-09db-41f8-a446-e74887bcba68 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.987338 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cb7af-09db-41f8-a446-e74887bcba68 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.987621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cb7af-09db-41f8-a446-e74887bcba68 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.988227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 54/113] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:21.988857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cb7af-09db-41f8-a446-e74887bcba68 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:21.989664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de1ca-788e-4bab-b562-f2e7cf9414b3 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:21.989960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de1ca-788e-4bab-b562-f2e7cf9414b3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:21.990240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de1ca-788e-4bab-b562-f2e7cf9414b3 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:21.990451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cb7af-09db-41f8-a446-e74887bcba68 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:21.991638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 55/114] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:21.992360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 60/115] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:21 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:21.995459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cb7af-09db-41f8-a446-e74887bcba68 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:21.997749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0de1ca-788e-4bab-b562-f2e7cf9414b3 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:22.024709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:22.121274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cb7af-09db-41f8-a446-e74887bcba68 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:22.137557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0de1ca-788e-4bab-b562-f2e7cf9414b3 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:22.155119 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:22.171417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207e52d-27eb-4095-9801-54370439c5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:22.172571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e52d-27eb-4095-9801-54370439c5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:22.172858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e52d-27eb-4095-9801-54370439c5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:22.173144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e52d-27eb-4095-9801-54370439c5e8 None admin] PATH_INFO: `/v3/users/f058e8cc10ad4965a0a08401171a50a3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:22.174391 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207e52d-27eb-4095-9801-54370439c5e8 None admin] RBAC: Authorizing `identity:get_user(user_id=f058e8cc10ad4965a0a08401171a50a3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:22.175763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61944c5a-37c5-4375-a159-546cef7f373c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:22.175959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207e52d-27eb-4095-9801-54370439c5e8 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:22.176609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944c5a-37c5-4375-a159-546cef7f373c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:22.176894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944c5a-37c5-4375-a159-546cef7f373c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:22.177222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944c5a-37c5-4375-a159-546cef7f373c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:22.177662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 61/116] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:21 2022] GET /identity/v3/users/f058e8cc10ad4965a0a08401171a50a3 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:22.178970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b897b28-dc8d-47d9-bc5c-dd20830e22e5 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:22.179281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b897b28-dc8d-47d9-bc5c-dd20830e22e5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:22.179856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b897b28-dc8d-47d9-bc5c-dd20830e22e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:22.189467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61944c5a-37c5-4375-a159-546cef7f373c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-61944c5a-37c5-4375-a159-546cef7f373c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:22.197263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:22.199024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 56/117] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:51:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:22.199869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61944c5a-37c5-4375-a159-546cef7f373c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:22.203558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8b897b28-dc8d-47d9-bc5c-dd20830e22e5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:22.206055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8b897b28-dc8d-47d9-bc5c-dd20830e22e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:22.282415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 62/118] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:22.283393 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b897b28-dc8d-47d9-bc5c-dd20830e22e5 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:22.307861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:22.324599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61944c5a-37c5-4375-a159-546cef7f373c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:22.360262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fde14b-986a-47fc-8bbf-56839f08299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:22.360993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fde14b-986a-47fc-8bbf-56839f08299d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:22.361279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fde14b-986a-47fc-8bbf-56839f08299d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:22.361556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fde14b-986a-47fc-8bbf-56839f08299d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:22.362492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fde14b-986a-47fc-8bbf-56839f08299d None admin] RBAC: Adding query filter params (role.id=6e4d951189724f6d8905ef4c7b8c0015, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58, user.id=6c25391d5508473a90bd897fc5d05c56) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:22.362811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fde14b-986a-47fc-8bbf-56839f08299d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:22.364700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fde14b-986a-47fc-8bbf-56839f08299d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:22.370720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 57/119] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:22 2022] GET /identity/v3/role_assignments?user.id=6c25391d5508473a90bd897fc5d05c56&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=6e4d951189724f6d8905ef4c7b8c0015 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:22.371553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fde14b-986a-47fc-8bbf-56839f08299d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:22.386103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b897b28-dc8d-47d9-bc5c-dd20830e22e5 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:22.436478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d6d5d-cfc9-4c69-8447-c546b2b9cee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:22.438257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:22.439144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6d5d-cfc9-4c69-8447-c546b2b9cee1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:22.439630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6d5d-cfc9-4c69-8447-c546b2b9cee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:22.440457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6d5d-cfc9-4c69-8447-c546b2b9cee1 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:22.442492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d6d5d-cfc9-4c69-8447-c546b2b9cee1 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:22.445757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d6d5d-cfc9-4c69-8447-c546b2b9cee1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:22.449228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 63/120] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:22 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:22.450911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312dafa-4326-4c37-b737-bef0448815fb None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:22.451429 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312dafa-4326-4c37-b737-bef0448815fb None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:22.452668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312dafa-4326-4c37-b737-bef0448815fb None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:22.455053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 64/121] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:22.456187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312dafa-4326-4c37-b737-bef0448815fb None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:22.529821 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fde14b-986a-47fc-8bbf-56839f08299d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:22.565913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0f50d-67c8-4366-a236-4e12b8cc5c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:22.567419 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0f50d-67c8-4366-a236-4e12b8cc5c70 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:22.567679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:22.568371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0f50d-67c8-4366-a236-4e12b8cc5c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:22.568847 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0f50d-67c8-4366-a236-4e12b8cc5c70 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:22.569799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0f50d-67c8-4366-a236-4e12b8cc5c70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:22.570298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0f50d-67c8-4366-a236-4e12b8cc5c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:22.571956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0f50d-67c8-4366-a236-4e12b8cc5c70 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:22.579964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312dafa-4326-4c37-b737-bef0448815fb None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:22.581817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 58/122] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:22.587374 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0f50d-67c8-4366-a236-4e12b8cc5c70 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:22.616292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e94fd-d3fc-4fde-92da-d850d6db1563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:22.617238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e94fd-d3fc-4fde-92da-d850d6db1563 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:22.617578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e94fd-d3fc-4fde-92da-d850d6db1563 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:22.618032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e94fd-d3fc-4fde-92da-d850d6db1563 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:22.630713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e94fd-d3fc-4fde-92da-d850d6db1563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-8c7e94fd-d3fc-4fde-92da-d850d6db1563 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:22.639542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:22.640627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:22.641554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:22.643608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 65/123] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:51:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:22.645086 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0e266-bc86-4006-a4e4-8a3fae72b65b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:22.645504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0e266-bc86-4006-a4e4-8a3fae72b65b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:22.645904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0e266-bc86-4006-a4e4-8a3fae72b65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:22.663530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-91d0e266-bc86-4006-a4e4-8a3fae72b65b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:22.664889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-91d0e266-bc86-4006-a4e4-8a3fae72b65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:22.700105 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0f50d-67c8-4366-a236-4e12b8cc5c70 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:22.701865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:22.737128 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 66/124] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:22.741931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cb2be-ef32-4c50-af0f-cc4ebb86fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:22.741931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cb2be-ef32-4c50-af0f-cc4ebb86fd7b None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:22.741931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cb2be-ef32-4c50-af0f-cc4ebb86fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:22.741931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cb2be-ef32-4c50-af0f-cc4ebb86fd7b None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/users/f058e8cc10ad4965a0a08401171a50a3/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:22.742225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cb2be-ef32-4c50-af0f-cc4ebb86fd7b None admin] RBAC: Authorizing `identity:create_grant(project_id=cefdac4b6cbd48da9ac73336c23c3d58, user_id=f058e8cc10ad4965a0a08401171a50a3, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:22.743109 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cb2be-ef32-4c50-af0f-cc4ebb86fd7b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:22.743469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0e266-bc86-4006-a4e4-8a3fae72b65b None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:22.772509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 59/125] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:51:22 2022] PUT /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/users/f058e8cc10ad4965a0a08401171a50a3/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:22.775599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cb2be-ef32-4c50-af0f-cc4ebb86fd7b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:22.834583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:22.859080 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0e266-bc86-4006-a4e4-8a3fae72b65b None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:22.901530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea61da-d267-4e68-9f42-291eae2b157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:22.902794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea61da-d267-4e68-9f42-291eae2b157f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:22.903322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea61da-d267-4e68-9f42-291eae2b157f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:22.903788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea61da-d267-4e68-9f42-291eae2b157f None admin] PATH_INFO: `/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:22.905470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea61da-d267-4e68-9f42-291eae2b157f None admin] RBAC: Authorizing `identity:get_user(user_id=7e9333f1aa1b4eae9a0f479d3c29fb15)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:22.908204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea61da-d267-4e68-9f42-291eae2b157f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:22.910390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 67/126] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:22 2022] GET /identity/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:22.911561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea61da-d267-4e68-9f42-291eae2b157f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:22.944208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cb2be-ef32-4c50-af0f-cc4ebb86fd7b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:23.019712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3afd29-9c66-4ce5-bbce-b1be658ebb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:23.020410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3afd29-9c66-4ce5-bbce-b1be658ebb81 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:23.020699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3afd29-9c66-4ce5-bbce-b1be658ebb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:23.021007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3afd29-9c66-4ce5-bbce-b1be658ebb81 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:23.021782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3afd29-9c66-4ce5-bbce-b1be658ebb81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:23.022098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3afd29-9c66-4ce5-bbce-b1be658ebb81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:23.024535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3afd29-9c66-4ce5-bbce-b1be658ebb81 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:23.033586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 60/127] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:51:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:23.039073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3afd29-9c66-4ce5-bbce-b1be658ebb81 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:23.065230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:23.076624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea61da-d267-4e68-9f42-291eae2b157f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:23.112675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d179c-85f9-4d79-b449-8056485cf481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:23.113855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d179c-85f9-4d79-b449-8056485cf481 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:23.114325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d179c-85f9-4d79-b449-8056485cf481 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:23.114804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d179c-85f9-4d79-b449-8056485cf481 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:23.126485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d179c-85f9-4d79-b449-8056485cf481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-372d179c-85f9-4d79-b449-8056485cf481 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:23.134539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:23.135442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:23.136193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:23.138595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 68/128] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:23.139591 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d179c-85f9-4d79-b449-8056485cf481 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:23.150373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3afd29-9c66-4ce5-bbce-b1be658ebb81 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:23.151845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:23.221402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd284983-504d-4556-ba7e-07cfa1add369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:23.222309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd284983-504d-4556-ba7e-07cfa1add369 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:23.222586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd284983-504d-4556-ba7e-07cfa1add369 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:23.222853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd284983-504d-4556-ba7e-07cfa1add369 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:23.227735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd284983-504d-4556-ba7e-07cfa1add369 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:23.229228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd284983-504d-4556-ba7e-07cfa1add369 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:23.231276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 61/129] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:23 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:23.232063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd284983-504d-4556-ba7e-07cfa1add369 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:23.245916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d179c-85f9-4d79-b449-8056485cf481 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:23.280133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8353a5-7d51-497c-bb05-b899bdb505dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:23.281424 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8353a5-7d51-497c-bb05-b899bdb505dd None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:23.281967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8353a5-7d51-497c-bb05-b899bdb505dd None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:23.282431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8353a5-7d51-497c-bb05-b899bdb505dd None admin] PATH_INFO: `/v3/users/f058e8cc10ad4965a0a08401171a50a3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:23.284067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8353a5-7d51-497c-bb05-b899bdb505dd None admin] RBAC: Authorizing `identity:get_user(user_id=f058e8cc10ad4965a0a08401171a50a3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:23.285889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8353a5-7d51-497c-bb05-b899bdb505dd None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:23.288179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 69/130] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:23 2022] GET /identity/v3/users/f058e8cc10ad4965a0a08401171a50a3 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:23.289130 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8353a5-7d51-497c-bb05-b899bdb505dd None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:23.369731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:23.394186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8353a5-7d51-497c-bb05-b899bdb505dd None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:23.457055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9d28-754b-4a02-9537-b86746536829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:23.457887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9d28-754b-4a02-9537-b86746536829 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:23.458170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9d28-754b-4a02-9537-b86746536829 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:23.458447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9d28-754b-4a02-9537-b86746536829 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/users/7e9333f1aa1b4eae9a0f479d3c29fb15/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:23.461790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec9d28-754b-4a02-9537-b86746536829 None admin] RBAC: Authorizing `identity:create_grant(project_id=cefdac4b6cbd48da9ac73336c23c3d58, user_id=7e9333f1aa1b4eae9a0f479d3c29fb15, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:23.463304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec9d28-754b-4a02-9537-b86746536829 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:23.475766 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:23.492329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 70/131] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:51:23 2022] PUT /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/users/7e9333f1aa1b4eae9a0f479d3c29fb15/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:23.492947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9d28-754b-4a02-9537-b86746536829 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:23.496379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd284983-504d-4556-ba7e-07cfa1add369 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:23.561167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11013fd1-8521-492c-9d0b-1ba7b2dbd1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:23.562177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11013fd1-8521-492c-9d0b-1ba7b2dbd1fd None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:23.562463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11013fd1-8521-492c-9d0b-1ba7b2dbd1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:23.562744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11013fd1-8521-492c-9d0b-1ba7b2dbd1fd None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:23.563551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11013fd1-8521-492c-9d0b-1ba7b2dbd1fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:23.563857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11013fd1-8521-492c-9d0b-1ba7b2dbd1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:23.567881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11013fd1-8521-492c-9d0b-1ba7b2dbd1fd None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:23.590587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 62/132] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:23.596255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11013fd1-8521-492c-9d0b-1ba7b2dbd1fd None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:23.689958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9d28-754b-4a02-9537-b86746536829 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:23.741975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33ae1c-647c-4f39-be3f-cefe33e37c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:23.742787 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33ae1c-647c-4f39-be3f-cefe33e37c37 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:23.743099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33ae1c-647c-4f39-be3f-cefe33e37c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:23.743264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11013fd1-8521-492c-9d0b-1ba7b2dbd1fd None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:23.743416 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33ae1c-647c-4f39-be3f-cefe33e37c37 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:23.744607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33ae1c-647c-4f39-be3f-cefe33e37c37 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:23.746396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33ae1c-647c-4f39-be3f-cefe33e37c37 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:23.748249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 71/133] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:23 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:23.762107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33ae1c-647c-4f39-be3f-cefe33e37c37 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:23.770182 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:23.796457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24448e29-3e45-4249-9d73-6403949f2d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:23.797555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24448e29-3e45-4249-9d73-6403949f2d6f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:23.797839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24448e29-3e45-4249-9d73-6403949f2d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:23.799051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24448e29-3e45-4249-9d73-6403949f2d6f None admin] PATH_INFO: `/v3/users/f058e8cc10ad4965a0a08401171a50a3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:23.801048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24448e29-3e45-4249-9d73-6403949f2d6f None admin] RBAC: Authorizing `identity:get_user(user_id=f058e8cc10ad4965a0a08401171a50a3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:23.802533 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24448e29-3e45-4249-9d73-6403949f2d6f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:23.804789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 63/134] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:23 2022] GET /identity/v3/users/f058e8cc10ad4965a0a08401171a50a3 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:23.809922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24448e29-3e45-4249-9d73-6403949f2d6f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:23.847712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:23.938708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24448e29-3e45-4249-9d73-6403949f2d6f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:23.959324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33ae1c-647c-4f39-be3f-cefe33e37c37 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:23.979977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4572a-b4b3-4b2a-9b6a-a9bb374ea832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:23.981239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4572a-b4b3-4b2a-9b6a-a9bb374ea832 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:23.981715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4572a-b4b3-4b2a-9b6a-a9bb374ea832 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:23.982208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4572a-b4b3-4b2a-9b6a-a9bb374ea832 None admin] PATH_INFO: `/v3/projects/d05fa48c30fc45e9b6fa48c7e283cd93` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:23.984434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4572a-b4b3-4b2a-9b6a-a9bb374ea832 None admin] RBAC: Authorizing `identity:get_project(project_id=d05fa48c30fc45e9b6fa48c7e283cd93)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:23.986127 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4572a-b4b3-4b2a-9b6a-a9bb374ea832 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:23.988284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 64/135] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:23 2022] GET /identity/v3/projects/d05fa48c30fc45e9b6fa48c7e283cd93 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:23.994795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4572a-b4b3-4b2a-9b6a-a9bb374ea832 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:24.033801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5b1d2-22bc-4b73-a66d-b4ae31a64863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:24.035099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b1d2-22bc-4b73-a66d-b4ae31a64863 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:24.035578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b1d2-22bc-4b73-a66d-b4ae31a64863 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:24.036092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b1d2-22bc-4b73-a66d-b4ae31a64863 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/users/f058e8cc10ad4965a0a08401171a50a3/roles/c81f6283cf3a418bad94b56a1e9ea2b3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:24.043252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5b1d2-22bc-4b73-a66d-b4ae31a64863 None admin] RBAC: Authorizing `identity:create_grant(project_id=cefdac4b6cbd48da9ac73336c23c3d58, user_id=f058e8cc10ad4965a0a08401171a50a3, role_id=c81f6283cf3a418bad94b56a1e9ea2b3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:24.044947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5b1d2-22bc-4b73-a66d-b4ae31a64863 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:24.074225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 72/136] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:51:23 2022] PUT /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/users/f058e8cc10ad4965a0a08401171a50a3/roles/c81f6283cf3a418bad94b56a1e9ea2b3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:24.182454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:24.193399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4572a-b4b3-4b2a-9b6a-a9bb374ea832 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:24.231351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4928829-18b1-4249-b3a8-f0cedccfd75d None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:24.231673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4928829-18b1-4249-b3a8-f0cedccfd75d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:24.231952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4928829-18b1-4249-b3a8-f0cedccfd75d None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:24.235477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 73/137] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:24.246738 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270593a-acb8-444a-af2c-aeadf4e5db73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:24.247266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84b6f-55d1-49f6-8e7f-37ca439a6ac1 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:24.247699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84b6f-55d1-49f6-8e7f-37ca439a6ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:24.247986 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84b6f-55d1-49f6-8e7f-37ca439a6ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:24.248544 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270593a-acb8-444a-af2c-aeadf4e5db73 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:24.249087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270593a-acb8-444a-af2c-aeadf4e5db73 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:24.249651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270593a-acb8-444a-af2c-aeadf4e5db73 None admin] PATH_INFO: `/v3/projects/d05fa48c30fc45e9b6fa48c7e283cd93/users/f058e8cc10ad4965a0a08401171a50a3/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:24.252004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270593a-acb8-444a-af2c-aeadf4e5db73 None admin] RBAC: Authorizing `identity:create_grant(project_id=d05fa48c30fc45e9b6fa48c7e283cd93, user_id=f058e8cc10ad4965a0a08401171a50a3, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:24.253714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270593a-acb8-444a-af2c-aeadf4e5db73 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:24.276750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 65/138] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:51:23 2022] PUT /identity/v3/projects/d05fa48c30fc45e9b6fa48c7e283cd93/users/f058e8cc10ad4965a0a08401171a50a3/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:24.282614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8aa84b6f-55d1-49f6-8e7f-37ca439a6ac1 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:24.283853 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8aa84b6f-55d1-49f6-8e7f-37ca439a6ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:24.379810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:24.392719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 74/139] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:24.431368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270593a-acb8-444a-af2c-aeadf4e5db73 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:24.545761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270593a-acb8-444a-af2c-aeadf4e5db73 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:24.581308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56aecb-cf3f-4510-8461-b545d3506b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:24.582124 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56aecb-cf3f-4510-8461-b545d3506b0a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:24.582407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56aecb-cf3f-4510-8461-b545d3506b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:24.582684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56aecb-cf3f-4510-8461-b545d3506b0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:24.583890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56aecb-cf3f-4510-8461-b545d3506b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:24.585416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56aecb-cf3f-4510-8461-b545d3506b0a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:24.587079 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 66/140] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:24.592616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa84b6f-55d1-49f6-8e7f-37ca439a6ac1 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:24.714704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa84b6f-55d1-49f6-8e7f-37ca439a6ac1 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:24.759787 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b806bb-a34e-4d0e-9601-87c48f90eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:24.760388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b806bb-a34e-4d0e-9601-87c48f90eaaf None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:24.760667 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b806bb-a34e-4d0e-9601-87c48f90eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:24.760941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b806bb-a34e-4d0e-9601-87c48f90eaaf None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:24.761665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b806bb-a34e-4d0e-9601-87c48f90eaaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:24.763161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b806bb-a34e-4d0e-9601-87c48f90eaaf None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:24.799567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 75/141] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:51:24 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:51:24.941593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c43df-f57f-4448-ac94-a96346600ebf None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:24.941921 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c43df-f57f-4448-ac94-a96346600ebf None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:24.942149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c43df-f57f-4448-ac94-a96346600ebf None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:24.943566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 67/142] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:24.949211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d970989-57e2-42aa-9169-bfb50395448f None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:24.949494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d970989-57e2-42aa-9169-bfb50395448f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:24.949770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d970989-57e2-42aa-9169-bfb50395448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:24.976049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-9d970989-57e2-42aa-9169-bfb50395448f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:24.977242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9d970989-57e2-42aa-9169-bfb50395448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:25.035789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:25.064770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 76/143] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:25.098134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c43df-f57f-4448-ac94-a96346600ebf None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:25.118941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:25.223306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c43df-f57f-4448-ac94-a96346600ebf None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:25.279692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c75d4-d336-4527-b5aa-cbadb74ec439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:25.280913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c75d4-d336-4527-b5aa-cbadb74ec439 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:25.281386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c75d4-d336-4527-b5aa-cbadb74ec439 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:25.281848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c75d4-d336-4527-b5aa-cbadb74ec439 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:25.293898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c75d4-d336-4527-b5aa-cbadb74ec439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-fe2c75d4-d336-4527-b5aa-cbadb74ec439 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:25.301945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:25.302784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:25.303572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:25.305909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 68/144] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:51:25.312034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d970989-57e2-42aa-9169-bfb50395448f None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:25.430415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d970989-57e2-42aa-9169-bfb50395448f None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:25.470525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0317c-7e1e-4741-9aae-650c849c7c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:25.471577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0317c-7e1e-4741-9aae-650c849c7c78 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:25.472050 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0317c-7e1e-4741-9aae-650c849c7c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:25.472512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0317c-7e1e-4741-9aae-650c849c7c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:25.473557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0317c-7e1e-4741-9aae-650c849c7c78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:25.474046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0317c-7e1e-4741-9aae-650c849c7c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:25.475659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0317c-7e1e-4741-9aae-650c849c7c78 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:25.505978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 77/145] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:25.511701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c75d4-d336-4527-b5aa-cbadb74ec439 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:25.613973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:25.639464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c75d4-d336-4527-b5aa-cbadb74ec439 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:25.674254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b153f01-3906-429e-be9c-0c718d7f74ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:25.675176 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153f01-3906-429e-be9c-0c718d7f74ef None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:25.675458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153f01-3906-429e-be9c-0c718d7f74ef None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:25.675730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153f01-3906-429e-be9c-0c718d7f74ef None admin] PATH_INFO: `/v3/users/6c25391d5508473a90bd897fc5d05c56` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:25.676930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b153f01-3906-429e-be9c-0c718d7f74ef None admin] RBAC: Authorizing `identity:get_user(user_id=6c25391d5508473a90bd897fc5d05c56)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:25.678495 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b153f01-3906-429e-be9c-0c718d7f74ef None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:25.680329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 69/146] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:25 2022] GET /identity/v3/users/6c25391d5508473a90bd897fc5d05c56 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:25.685669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0317c-7e1e-4741-9aae-650c849c7c78 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:25.722465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946d2c3-6405-45c9-b3e6-bd151c72639d None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:25.723133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946d2c3-6405-45c9-b3e6-bd151c72639d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:25.723595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946d2c3-6405-45c9-b3e6-bd151c72639d None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:25.725143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 70/147] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:51:25.730311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503626-f0c8-4736-add5-1fe0d3cbecf7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:25.730683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503626-f0c8-4736-add5-1fe0d3cbecf7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:25.730972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503626-f0c8-4736-add5-1fe0d3cbecf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:25.758067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-34503626-f0c8-4736-add5-1fe0d3cbecf7 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:25.759290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-34503626-f0c8-4736-add5-1fe0d3cbecf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:25.762958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:25.862806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0317c-7e1e-4741-9aae-650c849c7c78 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:25.872982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 71/148] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:25.917035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b07895-4d66-4767-874b-411a9a1b60b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:25.917915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b07895-4d66-4767-874b-411a9a1b60b3 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:25.918190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b07895-4d66-4767-874b-411a9a1b60b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:25.918464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b07895-4d66-4767-874b-411a9a1b60b3 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:25.919707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b07895-4d66-4767-874b-411a9a1b60b3 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:25.921299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b07895-4d66-4767-874b-411a9a1b60b3 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:25.923450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 78/149] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:25 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:25.928897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503626-f0c8-4736-add5-1fe0d3cbecf7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:25.929386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b07895-4d66-4767-874b-411a9a1b60b3 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:26.039809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:26.084380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503626-f0c8-4736-add5-1fe0d3cbecf7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:26.099067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b07895-4d66-4767-874b-411a9a1b60b3 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:26.108558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:26.147333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0951a34-09e1-476c-83bb-ecde88e83e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:26.148187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951a34-09e1-476c-83bb-ecde88e83e5e None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:26.148465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951a34-09e1-476c-83bb-ecde88e83e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:26.148737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951a34-09e1-476c-83bb-ecde88e83e5e None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/users/6c25391d5508473a90bd897fc5d05c56/roles/6e4d951189724f6d8905ef4c7b8c0015` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:26.150283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589bfa3-8b2f-4ce5-a36d-75a9d9441bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:26.151132 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589bfa3-8b2f-4ce5-a36d-75a9d9441bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:26.151412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589bfa3-8b2f-4ce5-a36d-75a9d9441bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:26.151702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589bfa3-8b2f-4ce5-a36d-75a9d9441bd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:26.153644 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0951a34-09e1-476c-83bb-ecde88e83e5e None admin] RBAC: Authorizing `identity:create_grant(project_id=cefdac4b6cbd48da9ac73336c23c3d58, user_id=6c25391d5508473a90bd897fc5d05c56, role_id=6e4d951189724f6d8905ef4c7b8c0015)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:26.155219 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0951a34-09e1-476c-83bb-ecde88e83e5e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:26.170412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589bfa3-8b2f-4ce5-a36d-75a9d9441bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:26.184321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 79/150] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:51:25 2022] PUT /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/users/6c25391d5508473a90bd897fc5d05c56/roles/6e4d951189724f6d8905ef4c7b8c0015 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-c589bfa3-8b2f-4ce5-a36d-75a9d9441bd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:26.185536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:26.186512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:26.187352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 72/151] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:26.192737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0951a34-09e1-476c-83bb-ecde88e83e5e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:26.315349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0951a34-09e1-476c-83bb-ecde88e83e5e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:26.357587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a51005-7f01-4bb1-95df-d5c40f2470cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:26.358275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51005-7f01-4bb1-95df-d5c40f2470cd None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:26.358692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51005-7f01-4bb1-95df-d5c40f2470cd None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:26.358969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51005-7f01-4bb1-95df-d5c40f2470cd None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:26.359750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a51005-7f01-4bb1-95df-d5c40f2470cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:26.360056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a51005-7f01-4bb1-95df-d5c40f2470cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:26.361464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a51005-7f01-4bb1-95df-d5c40f2470cd None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:26.374192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 80/152] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:26.379439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589bfa3-8b2f-4ce5-a36d-75a9d9441bd1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:26.512387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589bfa3-8b2f-4ce5-a36d-75a9d9441bd1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:26.548789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d8923-c703-4572-93ad-8f0f29eb15ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:26.549688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d8923-c703-4572-93ad-8f0f29eb15ee None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:26.549969 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d8923-c703-4572-93ad-8f0f29eb15ee None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:26.550241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d8923-c703-4572-93ad-8f0f29eb15ee None admin] PATH_INFO: `/v3/users/f058e8cc10ad4965a0a08401171a50a3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:26.551531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d8923-c703-4572-93ad-8f0f29eb15ee None admin] RBAC: Authorizing `identity:get_user(user_id=f058e8cc10ad4965a0a08401171a50a3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:26.553009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d8923-c703-4572-93ad-8f0f29eb15ee None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:26.555081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 73/153] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:26 2022] GET /identity/v3/users/f058e8cc10ad4965a0a08401171a50a3 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:26.561951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a51005-7f01-4bb1-95df-d5c40f2470cd None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:26.594364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:26.669511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a51005-7f01-4bb1-95df-d5c40f2470cd None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:26.704116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf4109-2b5e-4030-8ebf-0b0d3aee4202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:26.704770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf4109-2b5e-4030-8ebf-0b0d3aee4202 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:26.705096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf4109-2b5e-4030-8ebf-0b0d3aee4202 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:26.705375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf4109-2b5e-4030-8ebf-0b0d3aee4202 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:26.779095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf4109-2b5e-4030-8ebf-0b0d3aee4202 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:26.780631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf4109-2b5e-4030-8ebf-0b0d3aee4202 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:26.817857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:26.900170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 81/154] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:26.905475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d8923-c703-4572-93ad-8f0f29eb15ee None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:26.909434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:26.964046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fba038-85e5-4e77-826b-8df180e2f6e3 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:26.964397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fba038-85e5-4e77-826b-8df180e2f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:26.964595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fba038-85e5-4e77-826b-8df180e2f6e3 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:26.967018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 82/155] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:26.971315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04a6ea-7af6-4404-85a1-b21b397db2ec None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:26.971699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04a6ea-7af6-4404-85a1-b21b397db2ec None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:26.971979 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04a6ea-7af6-4404-85a1-b21b397db2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:27.008063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-fb04a6ea-7af6-4404-85a1-b21b397db2ec None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:27.009283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-fb04a6ea-7af6-4404-85a1-b21b397db2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:27.055279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d8923-c703-4572-93ad-8f0f29eb15ee None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:27.094440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6eb0-8bc3-4ac8-87ac-d4e689d38e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:27.095356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6eb0-8bc3-4ac8-87ac-d4e689d38e0c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:27.095672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6eb0-8bc3-4ac8-87ac-d4e689d38e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:27.095946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6eb0-8bc3-4ac8-87ac-d4e689d38e0c None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:27.097141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b6eb0-8bc3-4ac8-87ac-d4e689d38e0c None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:27.098619 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b6eb0-8bc3-4ac8-87ac-d4e689d38e0c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:27.100774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 74/156] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:26 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:27.106293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6eb0-8bc3-4ac8-87ac-d4e689d38e0c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:27.164786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 83/157] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:27.182877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:27.216057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6eb0-8bc3-4ac8-87ac-d4e689d38e0c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:27.236492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04a6ea-7af6-4404-85a1-b21b397db2ec None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:27.253807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43899730-61d3-4ddd-9c7c-b151289e664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:27.254739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43899730-61d3-4ddd-9c7c-b151289e664f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:27.255363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43899730-61d3-4ddd-9c7c-b151289e664f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:27.255842 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43899730-61d3-4ddd-9c7c-b151289e664f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:27.256824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43899730-61d3-4ddd-9c7c-b151289e664f None admin] RBAC: Adding query filter params (role.id=729faf69df60450caeada9c53520224f, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58, user.id=f058e8cc10ad4965a0a08401171a50a3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:27.257707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43899730-61d3-4ddd-9c7c-b151289e664f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:27.259325 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43899730-61d3-4ddd-9c7c-b151289e664f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:27.266665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 75/158] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:27 2022] GET /identity/v3/role_assignments?user.id=f058e8cc10ad4965a0a08401171a50a3&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=729faf69df60450caeada9c53520224f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:27.319517 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:27.358843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04a6ea-7af6-4404-85a1-b21b397db2ec None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:27.394191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10406e2e-4517-4721-84cc-69f2024b578a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:27.395382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10406e2e-4517-4721-84cc-69f2024b578a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:27.395796 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10406e2e-4517-4721-84cc-69f2024b578a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:27.396217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10406e2e-4517-4721-84cc-69f2024b578a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:27.407990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10406e2e-4517-4721-84cc-69f2024b578a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-10406e2e-4517-4721-84cc-69f2024b578a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:27.416378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:27.417876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:27.418817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:27.421116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 84/159] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:51:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:27.427825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43899730-61d3-4ddd-9c7c-b151289e664f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:27.590879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43899730-61d3-4ddd-9c7c-b151289e664f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:27.635727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44088ddc-24fe-4aa8-ba79-9048de5db985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:27.636476 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44088ddc-24fe-4aa8-ba79-9048de5db985 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:27.636760 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44088ddc-24fe-4aa8-ba79-9048de5db985 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:27.637034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44088ddc-24fe-4aa8-ba79-9048de5db985 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:27.637800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44088ddc-24fe-4aa8-ba79-9048de5db985 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:27.638108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44088ddc-24fe-4aa8-ba79-9048de5db985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:27.639539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44088ddc-24fe-4aa8-ba79-9048de5db985 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:27.642087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:27.650200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 76/160] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:27.655603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10406e2e-4517-4721-84cc-69f2024b578a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:27.798823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10406e2e-4517-4721-84cc-69f2024b578a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:27.821679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:27.833937 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9373219-2d8a-4f4b-9b23-41e57c8152c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:27.835087 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9373219-2d8a-4f4b-9b23-41e57c8152c3 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:27.835367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9373219-2d8a-4f4b-9b23-41e57c8152c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:27.835638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9373219-2d8a-4f4b-9b23-41e57c8152c3 None admin] PATH_INFO: `/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:27.836874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9373219-2d8a-4f4b-9b23-41e57c8152c3 None admin] RBAC: Authorizing `identity:get_user(user_id=7e9333f1aa1b4eae9a0f479d3c29fb15)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:27.838340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9373219-2d8a-4f4b-9b23-41e57c8152c3 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:27.840194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 85/161] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:27 2022] GET /identity/v3/users/7e9333f1aa1b4eae9a0f479d3c29fb15 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:27.845776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44088ddc-24fe-4aa8-ba79-9048de5db985 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:27.922824 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8ff1a-573d-43ef-9440-38f5e572a6aa None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:27.923198 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8ff1a-573d-43ef-9440-38f5e572a6aa None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:27.923412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8ff1a-573d-43ef-9440-38f5e572a6aa None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:27.925136 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 86/162] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:27.944857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6b02-bfa6-45f1-aeea-8b058b2b5f06 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:27.945180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6b02-bfa6-45f1-aeea-8b058b2b5f06 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:27.945412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6b02-bfa6-45f1-aeea-8b058b2b5f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:27.979449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44088ddc-24fe-4aa8-ba79-9048de5db985 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:28.011003 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-600e6b02-bfa6-45f1-aeea-8b058b2b5f06 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:28.012190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-600e6b02-bfa6-45f1-aeea-8b058b2b5f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:28.019766 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be23f2-ad67-4a4a-9e1a-04b5fe5226b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:28.021767 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be23f2-ad67-4a4a-9e1a-04b5fe5226b0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:28.022574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be23f2-ad67-4a4a-9e1a-04b5fe5226b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:28.023076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be23f2-ad67-4a4a-9e1a-04b5fe5226b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:28.096181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:28.101207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be23f2-ad67-4a4a-9e1a-04b5fe5226b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:28.104427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be23f2-ad67-4a4a-9e1a-04b5fe5226b0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:28.133685 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 87/163] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:28.139006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81459-578b-4376-b716-f8d4c937a3ef None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:28.139006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81459-578b-4376-b716-f8d4c937a3ef None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:28.139006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81459-578b-4376-b716-f8d4c937a3ef None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:28.139006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 88/164] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:28.144647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6bbab-df3e-4a1d-bcad-3ee2f3de7375 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:28.144911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6bbab-df3e-4a1d-bcad-3ee2f3de7375 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:28.145145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6bbab-df3e-4a1d-bcad-3ee2f3de7375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:28.175206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d2e6bbab-df3e-4a1d-bcad-3ee2f3de7375 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:28.176679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d2e6bbab-df3e-4a1d-bcad-3ee2f3de7375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:28.246672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 89/165] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:28.248071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6bbab-df3e-4a1d-bcad-3ee2f3de7375 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:28.285429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 77/166] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:28.291008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be23f2-ad67-4a4a-9e1a-04b5fe5226b0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:28.299375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:28.350677 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6bbab-df3e-4a1d-bcad-3ee2f3de7375 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:28.385717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec35ab-68a5-4857-8d6d-f39cdfe00b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:28.387093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec35ab-68a5-4857-8d6d-f39cdfe00b80 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:28.387682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec35ab-68a5-4857-8d6d-f39cdfe00b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:28.388150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec35ab-68a5-4857-8d6d-f39cdfe00b80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:28.398765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec35ab-68a5-4857-8d6d-f39cdfe00b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-29ec35ab-68a5-4857-8d6d-f39cdfe00b80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:28.409040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:28.409917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:28.410921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:28.413696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 90/167] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:51:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:28.414764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec35ab-68a5-4857-8d6d-f39cdfe00b80 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:28.448991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:28.458637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be23f2-ad67-4a4a-9e1a-04b5fe5226b0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:28.526613 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58b92e-45df-4bdd-abda-6c2e17b31643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:28.527531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b92e-45df-4bdd-abda-6c2e17b31643 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:28.527816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b92e-45df-4bdd-abda-6c2e17b31643 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:28.528096 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b92e-45df-4bdd-abda-6c2e17b31643 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:28.529372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58b92e-45df-4bdd-abda-6c2e17b31643 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:28.531270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58b92e-45df-4bdd-abda-6c2e17b31643 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:28.532824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 78/168] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:28 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:28.533693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58b92e-45df-4bdd-abda-6c2e17b31643 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:28.540911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec35ab-68a5-4857-8d6d-f39cdfe00b80 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:28.553505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:28.580036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cb847-a600-41b3-b907-66444b463a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:28.581258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cb847-a600-41b3-b907-66444b463a7c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:28.581795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cb847-a600-41b3-b907-66444b463a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:28.582269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cb847-a600-41b3-b907-66444b463a7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:28.594342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cb847-a600-41b3-b907-66444b463a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-f87cb847-a600-41b3-b907-66444b463a7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:28.602980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:28.603950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:28.604715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:28.607682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 91/169] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:28.609015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cb847-a600-41b3-b907-66444b463a7c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:28.713184 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cb847-a600-41b3-b907-66444b463a7c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:28.739705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58b92e-45df-4bdd-abda-6c2e17b31643 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:28.749427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a14776-f4ea-442d-846b-4ea21a8017ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:28.750398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a14776-f4ea-442d-846b-4ea21a8017ee None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:28.750972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a14776-f4ea-442d-846b-4ea21a8017ee None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:28.751470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a14776-f4ea-442d-846b-4ea21a8017ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:28.752509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a14776-f4ea-442d-846b-4ea21a8017ee None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58, user.id=7e9333f1aa1b4eae9a0f479d3c29fb15) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:28.753027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a14776-f4ea-442d-846b-4ea21a8017ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:28.754730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a14776-f4ea-442d-846b-4ea21a8017ee None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:28.761405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 92/170] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:28 2022] GET /identity/v3/role_assignments?user.id=7e9333f1aa1b4eae9a0f479d3c29fb15&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:28.762583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a14776-f4ea-442d-846b-4ea21a8017ee None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:28.800478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:28.816210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e426b-531d-46b2-9d31-75390def410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:28.817254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e426b-531d-46b2-9d31-75390def410f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:28.817721 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e426b-531d-46b2-9d31-75390def410f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:28.818223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e426b-531d-46b2-9d31-75390def410f None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:28.819194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e426b-531d-46b2-9d31-75390def410f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:28.821468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e426b-531d-46b2-9d31-75390def410f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:28.823193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e426b-531d-46b2-9d31-75390def410f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:28.848451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 79/171] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:51:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:28.864637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e426b-531d-46b2-9d31-75390def410f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:28.922193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:28.926850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a14776-f4ea-442d-846b-4ea21a8017ee None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:28.972795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f80ad-b9ae-4ac8-b6eb-31771aff5681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:28.974806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f80ad-b9ae-4ac8-b6eb-31771aff5681 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:28.976069 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f80ad-b9ae-4ac8-b6eb-31771aff5681 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:28.976691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f80ad-b9ae-4ac8-b6eb-31771aff5681 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:28.978736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f80ad-b9ae-4ac8-b6eb-31771aff5681 None admin] RBAC: Adding query filter params (name=member) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:28.979343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f80ad-b9ae-4ac8-b6eb-31771aff5681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:28.981124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f80ad-b9ae-4ac8-b6eb-31771aff5681 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:28.996183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 93/172] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:29.002156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f80ad-b9ae-4ac8-b6eb-31771aff5681 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:29.141274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e426b-531d-46b2-9d31-75390def410f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:29.146557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:29.157699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f80ad-b9ae-4ac8-b6eb-31771aff5681 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:29.207078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c572a5-0f0d-4d27-8cd2-3f4b07264f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:29.208310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c572a5-0f0d-4d27-8cd2-3f4b07264f5a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:29.208594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c572a5-0f0d-4d27-8cd2-3f4b07264f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:29.208868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c572a5-0f0d-4d27-8cd2-3f4b07264f5a None admin] PATH_INFO: `/v3/users/f058e8cc10ad4965a0a08401171a50a3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:29.210097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c572a5-0f0d-4d27-8cd2-3f4b07264f5a None admin] RBAC: Authorizing `identity:get_user(user_id=f058e8cc10ad4965a0a08401171a50a3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:29.211695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c572a5-0f0d-4d27-8cd2-3f4b07264f5a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:29.213640 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 94/173] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:29 2022] GET /identity/v3/users/f058e8cc10ad4965a0a08401171a50a3 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:29.219902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c572a5-0f0d-4d27-8cd2-3f4b07264f5a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:29.307721 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039e163-a091-4908-8f18-9bfe2ca1f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:29.308642 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e163-a091-4908-8f18-9bfe2ca1f520 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:29.308924 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e163-a091-4908-8f18-9bfe2ca1f520 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:29.309202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e163-a091-4908-8f18-9bfe2ca1f520 None admin] PATH_INFO: `/v3/users/f058e8cc10ad4965a0a08401171a50a3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:29.311312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039e163-a091-4908-8f18-9bfe2ca1f520 None admin] RBAC: Authorizing `identity:get_user(user_id=f058e8cc10ad4965a0a08401171a50a3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:29.312827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039e163-a091-4908-8f18-9bfe2ca1f520 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:29.314832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 80/174] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:28 2022] GET /identity/v3/users/f058e8cc10ad4965a0a08401171a50a3 => generated 275 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:29.321041 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039e163-a091-4908-8f18-9bfe2ca1f520 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:29.413307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c572a5-0f0d-4d27-8cd2-3f4b07264f5a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:29.451884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:29.461438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039e163-a091-4908-8f18-9bfe2ca1f520 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:29.484422 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860a981-ac1f-4166-af76-0d756051da8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:29.485525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a981-ac1f-4166-af76-0d756051da8b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:29.485525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a981-ac1f-4166-af76-0d756051da8b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:29.485705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a981-ac1f-4166-af76-0d756051da8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:29.517585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd77a45-7a97-4219-b1d1-9de035ee41b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:29.518620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd77a45-7a97-4219-b1d1-9de035ee41b1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:29.519131 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd77a45-7a97-4219-b1d1-9de035ee41b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:29.519659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd77a45-7a97-4219-b1d1-9de035ee41b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:29.568339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:29.641622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860a981-ac1f-4166-af76-0d756051da8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:29.641877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd77a45-7a97-4219-b1d1-9de035ee41b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:29.643147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860a981-ac1f-4166-af76-0d756051da8b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:29.643947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd77a45-7a97-4219-b1d1-9de035ee41b1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:29.803744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 95/175] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:29.805869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8838c-8c76-4e6e-ac49-39ca37b68a82 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:29.806381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8838c-8c76-4e6e-ac49-39ca37b68a82 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:29.806854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8838c-8c76-4e6e-ac49-39ca37b68a82 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:29.808586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 96/176] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:29.820487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76a1b5-b744-4c1d-b4fc-789ef2ad97a6 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:29.821042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76a1b5-b744-4c1d-b4fc-789ef2ad97a6 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:29.821537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76a1b5-b744-4c1d-b4fc-789ef2ad97a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:29.828853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 81/177] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:29.829404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:29.830933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd77a45-7a97-4219-b1d1-9de035ee41b1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:29.856968 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4c76a1b5-b744-4c1d-b4fc-789ef2ad97a6 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:29.858194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4c76a1b5-b744-4c1d-b4fc-789ef2ad97a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:29.939317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd77a45-7a97-4219-b1d1-9de035ee41b1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:29.958934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:29.975015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 97/178] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:29.975015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76a1b5-b744-4c1d-b4fc-789ef2ad97a6 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:29.983036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab69a95-3c16-4804-afc1-b241c9de2989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:29.984125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab69a95-3c16-4804-afc1-b241c9de2989 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:29.984470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab69a95-3c16-4804-afc1-b241c9de2989 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:29.984834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab69a95-3c16-4804-afc1-b241c9de2989 None admin] PATH_INFO: `/v3/projects/d05fa48c30fc45e9b6fa48c7e283cd93` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:29.986099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab69a95-3c16-4804-afc1-b241c9de2989 None admin] RBAC: Authorizing `identity:get_project(project_id=d05fa48c30fc45e9b6fa48c7e283cd93)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:29.987696 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab69a95-3c16-4804-afc1-b241c9de2989 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:29.989478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 82/179] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:29 2022] GET /identity/v3/projects/d05fa48c30fc45e9b6fa48c7e283cd93 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:29.990770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8b02a-77d6-4153-9136-524ab4bc6ae8 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:29.991098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8b02a-77d6-4153-9136-524ab4bc6ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:29.991435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8b02a-77d6-4153-9136-524ab4bc6ae8 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:29.996609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 83/180] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:29.996609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64990376-6e8e-49b1-ba76-4ec214576a74 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:29.996609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64990376-6e8e-49b1-ba76-4ec214576a74 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:29.996609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64990376-6e8e-49b1-ba76-4ec214576a74 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:29.999659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 84/181] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:30.000527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64990376-6e8e-49b1-ba76-4ec214576a74 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:30.064730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:30.084217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76a1b5-b744-4c1d-b4fc-789ef2ad97a6 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:30.105957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64990376-6e8e-49b1-ba76-4ec214576a74 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:30.119545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cac16-05d2-4670-bc7e-7bbd3b1b3930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:30.120616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cac16-05d2-4670-bc7e-7bbd3b1b3930 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.120889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cac16-05d2-4670-bc7e-7bbd3b1b3930 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.121168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cac16-05d2-4670-bc7e-7bbd3b1b3930 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.122337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cac16-05d2-4670-bc7e-7bbd3b1b3930 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:30.123834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cac16-05d2-4670-bc7e-7bbd3b1b3930 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:30.125798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 98/182] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:29 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:30.126767 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc56d0-066b-45b2-9004-8817a1b3b9d3 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.127089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc56d0-066b-45b2-9004-8817a1b3b9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.127365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc56d0-066b-45b2-9004-8817a1b3b9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.141933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2ddfd-5776-4fa4-a650-4c3354fdc191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:30.142595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ddfd-5776-4fa4-a650-4c3354fdc191 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.142875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ddfd-5776-4fa4-a650-4c3354fdc191 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.143181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ddfd-5776-4fa4-a650-4c3354fdc191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.143453 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-34dc56d0-066b-45b2-9004-8817a1b3b9d3 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:30.144015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2ddfd-5776-4fa4-a650-4c3354fdc191 None admin] RBAC: Adding query filter params (role.id=729faf69df60450caeada9c53520224f, scope.project.id=d05fa48c30fc45e9b6fa48c7e283cd93, user.id=f058e8cc10ad4965a0a08401171a50a3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:30.144324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2ddfd-5776-4fa4-a650-4c3354fdc191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:30.144647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-34dc56d0-066b-45b2-9004-8817a1b3b9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:30.145762 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2ddfd-5776-4fa4-a650-4c3354fdc191 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:30.151576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 85/183] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:29 2022] GET /identity/v3/role_assignments?user.id=f058e8cc10ad4965a0a08401171a50a3&scope.project.id=d05fa48c30fc45e9b6fa48c7e283cd93&role.id=729faf69df60450caeada9c53520224f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:30.152730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fccf1-4a64-44f1-8cb6-835629b1c0a5 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.153014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fccf1-4a64-44f1-8cb6-835629b1c0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.153287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fccf1-4a64-44f1-8cb6-835629b1c0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.173100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9f7fccf1-4a64-44f1-8cb6-835629b1c0a5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:30.174609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9f7fccf1-4a64-44f1-8cb6-835629b1c0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:30.209824 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:30.225121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 99/184] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:30.232663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc56d0-066b-45b2-9004-8817a1b3b9d3 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:30.267029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 86/185] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:30.267029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761dc13-fa02-49a4-bce4-700d55fe031d None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.267029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761dc13-fa02-49a4-bce4-700d55fe031d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.267029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761dc13-fa02-49a4-bce4-700d55fe031d None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.267029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 87/186] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:30.267029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761dc13-fa02-49a4-bce4-700d55fe031d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:30.333957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:30.355764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc56d0-066b-45b2-9004-8817a1b3b9d3 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:30.383657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761dc13-fa02-49a4-bce4-700d55fe031d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:30.392391 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ed057-bc55-4819-899b-ff44702ea701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:30.393218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ed057-bc55-4819-899b-ff44702ea701 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.393503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ed057-bc55-4819-899b-ff44702ea701 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.393777 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ed057-bc55-4819-899b-ff44702ea701 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.404260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ed057-bc55-4819-899b-ff44702ea701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-591ed057-bc55-4819-899b-ff44702ea701 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:30.412052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:30.412913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 100/187] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:51:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:30.418873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ed057-bc55-4819-899b-ff44702ea701 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:30.419618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a0471-3cfe-4cd5-96b4-03d79f86d5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:30.420037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a0471-3cfe-4cd5-96b4-03d79f86d5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.420310 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a0471-3cfe-4cd5-96b4-03d79f86d5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.420583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a0471-3cfe-4cd5-96b4-03d79f86d5c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.421501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a0471-3cfe-4cd5-96b4-03d79f86d5c0 None admin] RBAC: Adding query filter params (role.id=c81f6283cf3a418bad94b56a1e9ea2b3, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58, user.id=f058e8cc10ad4965a0a08401171a50a3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:30.421808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a0471-3cfe-4cd5-96b4-03d79f86d5c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:30.423276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a0471-3cfe-4cd5-96b4-03d79f86d5c0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:30.429190 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 88/188] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:30 2022] GET /identity/v3/role_assignments?user.id=f058e8cc10ad4965a0a08401171a50a3&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=c81f6283cf3a418bad94b56a1e9ea2b3 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:30.430333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d8fd9-a07f-4156-8177-8b5fd01ee497 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.430616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d8fd9-a07f-4156-8177-8b5fd01ee497 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.430889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d8fd9-a07f-4156-8177-8b5fd01ee497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.447796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f38d8fd9-a07f-4156-8177-8b5fd01ee497 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:30.449308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f38d8fd9-a07f-4156-8177-8b5fd01ee497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:30.471524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:30.539015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 89/189] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:30.539015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d8fd9-a07f-4156-8177-8b5fd01ee497 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:30.545074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ed057-bc55-4819-899b-ff44702ea701 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:30.585825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efdce1-b434-4621-8c2b-5f1601546002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:30.586574 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efdce1-b434-4621-8c2b-5f1601546002 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.586860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efdce1-b434-4621-8c2b-5f1601546002 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.587171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efdce1-b434-4621-8c2b-5f1601546002 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.593074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:30.599653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efdce1-b434-4621-8c2b-5f1601546002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-a0efdce1-b434-4621-8c2b-5f1601546002 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:30.607847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:30.608782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 101/190] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:51:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:30.614601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efdce1-b434-4621-8c2b-5f1601546002 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:30.648188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d8fd9-a07f-4156-8177-8b5fd01ee497 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:30.684878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7531671-d5c4-4287-923e-49d4723cf6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:30.685675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531671-d5c4-4287-923e-49d4723cf6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.685956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531671-d5c4-4287-923e-49d4723cf6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.686225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531671-d5c4-4287-923e-49d4723cf6d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.687439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7531671-d5c4-4287-923e-49d4723cf6d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:30.688898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7531671-d5c4-4287-923e-49d4723cf6d7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:30.690521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 90/191] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:30.691293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7531671-d5c4-4287-923e-49d4723cf6d7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:30.721224 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efdce1-b434-4621-8c2b-5f1601546002 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:30.734191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:30.755954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcb609-edee-4cf8-b004-ecd355f23f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:30.756621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcb609-edee-4cf8-b004-ecd355f23f23 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.756907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcb609-edee-4cf8-b004-ecd355f23f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.757183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcb609-edee-4cf8-b004-ecd355f23f23 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.757938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcb609-edee-4cf8-b004-ecd355f23f23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:30.758245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcb609-edee-4cf8-b004-ecd355f23f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:30.759679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcb609-edee-4cf8-b004-ecd355f23f23 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:30.767706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 102/192] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:30.772408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcb609-edee-4cf8-b004-ecd355f23f23 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:30.788786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7531671-d5c4-4287-923e-49d4723cf6d7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:30.809830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:30.825593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30198a1-4392-4cf4-b334-b4d347ec463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:30.826392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30198a1-4392-4cf4-b334-b4d347ec463d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.826677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30198a1-4392-4cf4-b334-b4d347ec463d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.826948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30198a1-4392-4cf4-b334-b4d347ec463d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.837062 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30198a1-4392-4cf4-b334-b4d347ec463d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-c30198a1-4392-4cf4-b334-b4d347ec463d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:30.844991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:30.845877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:30.846660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 91/193] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:30.847669 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30198a1-4392-4cf4-b334-b4d347ec463d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:30.869019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcb609-edee-4cf8-b004-ecd355f23f23 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:30.901046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2f073-51f0-4caa-a6bc-cbef5c26935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:30.901712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2f073-51f0-4caa-a6bc-cbef5c26935f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.901992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2f073-51f0-4caa-a6bc-cbef5c26935f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.902266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2f073-51f0-4caa-a6bc-cbef5c26935f None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.903048 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2f073-51f0-4caa-a6bc-cbef5c26935f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:30.903363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2f073-51f0-4caa-a6bc-cbef5c26935f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:30.904766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2f073-51f0-4caa-a6bc-cbef5c26935f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:30.912564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 103/194] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:51:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:30.913331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2f073-51f0-4caa-a6bc-cbef5c26935f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:30.946893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:30.948405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30198a1-4392-4cf4-b334-b4d347ec463d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:30.982246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aca4a0-8278-4960-b43f-73cc5f9f2a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:30.982910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aca4a0-8278-4960-b43f-73cc5f9f2a43 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:30.983224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aca4a0-8278-4960-b43f-73cc5f9f2a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:30.983499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aca4a0-8278-4960-b43f-73cc5f9f2a43 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:30.984193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aca4a0-8278-4960-b43f-73cc5f9f2a43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:30.985661 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aca4a0-8278-4960-b43f-73cc5f9f2a43 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:31.008885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2f073-51f0-4caa-a6bc-cbef5c26935f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:31.013272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 92/195] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:51:30 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:51:31.014014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aca4a0-8278-4960-b43f-73cc5f9f2a43 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:31.043662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4f0d1-50af-4ba2-ba40-7d7b62e93abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:31.044571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4f0d1-50af-4ba2-ba40-7d7b62e93abb None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:31.044875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4f0d1-50af-4ba2-ba40-7d7b62e93abb None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:31.045180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4f0d1-50af-4ba2-ba40-7d7b62e93abb None admin] PATH_INFO: `/v3/users/8c87be7bdb4242fb8d468f26d9ee473a` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:31.060795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4f0d1-50af-4ba2-ba40-7d7b62e93abb None admin] RBAC: Authorizing `identity:get_user(user_id=8c87be7bdb4242fb8d468f26d9ee473a)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:31.062578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4f0d1-50af-4ba2-ba40-7d7b62e93abb None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:31.069284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 104/196] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:30 2022] GET /identity/v3/users/8c87be7bdb4242fb8d468f26d9ee473a => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:31.069284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4f0d1-50af-4ba2-ba40-7d7b62e93abb None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:31.074101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:31.147560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aca4a0-8278-4960-b43f-73cc5f9f2a43 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:31.180653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:31.187767 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b1a42-7692-44fe-9bd2-78e9cfa83d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:31.188451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1a42-7692-44fe-9bd2-78e9cfa83d39 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:31.188731 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1a42-7692-44fe-9bd2-78e9cfa83d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:31.189004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1a42-7692-44fe-9bd2-78e9cfa83d39 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:31.189757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b1a42-7692-44fe-9bd2-78e9cfa83d39 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:31.190056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b1a42-7692-44fe-9bd2-78e9cfa83d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:31.191507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b1a42-7692-44fe-9bd2-78e9cfa83d39 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:31.193429 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4f0d1-50af-4ba2-ba40-7d7b62e93abb None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:31.200618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 93/197] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:31.201261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b1a42-7692-44fe-9bd2-78e9cfa83d39 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:31.232970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292852f-7e2b-492d-820f-473677e4c07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:31.233973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292852f-7e2b-492d-820f-473677e4c07e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:31.234256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292852f-7e2b-492d-820f-473677e4c07e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:31.234527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292852f-7e2b-492d-820f-473677e4c07e None admin] PATH_INFO: `/v3/users/8c87be7bdb4242fb8d468f26d9ee473a` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:31.246679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292852f-7e2b-492d-820f-473677e4c07e None admin] RBAC: Authorizing `identity:get_user(user_id=8c87be7bdb4242fb8d468f26d9ee473a)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:31.246679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292852f-7e2b-492d-820f-473677e4c07e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:31.246679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 105/198] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:31 2022] GET /identity/v3/users/8c87be7bdb4242fb8d468f26d9ee473a => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:31.246679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292852f-7e2b-492d-820f-473677e4c07e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:31.322729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:31.326719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b1a42-7692-44fe-9bd2-78e9cfa83d39 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:31.368798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189726d-497d-4676-97e8-036588aed7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:31.369008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292852f-7e2b-492d-820f-473677e4c07e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:31.369097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189726d-497d-4676-97e8-036588aed7ec None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:31.369097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189726d-497d-4676-97e8-036588aed7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:31.369097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189726d-497d-4676-97e8-036588aed7ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:31.419114 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388207ae-6c6d-4509-a5bd-ffb6cb63cab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:31.420236 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388207ae-6c6d-4509-a5bd-ffb6cb63cab4 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:31.422271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388207ae-6c6d-4509-a5bd-ffb6cb63cab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:31.422688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388207ae-6c6d-4509-a5bd-ffb6cb63cab4 None admin] PATH_INFO: `/v3/users/6c25391d5508473a90bd897fc5d05c56` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:31.424315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388207ae-6c6d-4509-a5bd-ffb6cb63cab4 None admin] RBAC: Authorizing `identity:get_user(user_id=6c25391d5508473a90bd897fc5d05c56)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:31.426764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388207ae-6c6d-4509-a5bd-ffb6cb63cab4 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:31.433445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 106/199] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:31 2022] GET /identity/v3/users/6c25391d5508473a90bd897fc5d05c56 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:31.433445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388207ae-6c6d-4509-a5bd-ffb6cb63cab4 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:31.454093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189726d-497d-4676-97e8-036588aed7ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:31.455921 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189726d-497d-4676-97e8-036588aed7ec None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:31.473222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:31.558559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:31.567723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 94/200] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:31.568862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189726d-497d-4676-97e8-036588aed7ec None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:31.580288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388207ae-6c6d-4509-a5bd-ffb6cb63cab4 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:31.621462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5031d-8a60-4330-96dc-570e20d665ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:31.621462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5031d-8a60-4330-96dc-570e20d665ab None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:31.621462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5031d-8a60-4330-96dc-570e20d665ab None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:31.621462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5031d-8a60-4330-96dc-570e20d665ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:31.698542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5031d-8a60-4330-96dc-570e20d665ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:31.700169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5031d-8a60-4330-96dc-570e20d665ab None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:31.709406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189726d-497d-4676-97e8-036588aed7ec None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:31.731913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:31.759517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6dcd5-606b-47c2-9be3-b10a8ffc329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:31.760181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6dcd5-606b-47c2-9be3-b10a8ffc329f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:31.760457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6dcd5-606b-47c2-9be3-b10a8ffc329f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:31.760729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6dcd5-606b-47c2-9be3-b10a8ffc329f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:31.806124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 107/201] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:31.810901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5031d-8a60-4330-96dc-570e20d665ab None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:31.861081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:31.865700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6dcd5-606b-47c2-9be3-b10a8ffc329f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:31.868564 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6dcd5-606b-47c2-9be3-b10a8ffc329f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:31.917758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5031d-8a60-4330-96dc-570e20d665ab None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:31.947422 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:31.955262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41240f2b-334f-4fe1-a37b-e2561dc70e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:31.956052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41240f2b-334f-4fe1-a37b-e2561dc70e43 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:31.956332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41240f2b-334f-4fe1-a37b-e2561dc70e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:31.956606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41240f2b-334f-4fe1-a37b-e2561dc70e43 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:31.957811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41240f2b-334f-4fe1-a37b-e2561dc70e43 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:31.959380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41240f2b-334f-4fe1-a37b-e2561dc70e43 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:31.961161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 108/202] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:31 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:31.966633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41240f2b-334f-4fe1-a37b-e2561dc70e43 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:32.003288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 95/203] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:32.008318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6dcd5-606b-47c2-9be3-b10a8ffc329f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:32.069043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41240f2b-334f-4fe1-a37b-e2561dc70e43 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:32.103506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a5beb-0b21-4462-910c-8f923ab51085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:32.104383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a5beb-0b21-4462-910c-8f923ab51085 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:32.104671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a5beb-0b21-4462-910c-8f923ab51085 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:32.104941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a5beb-0b21-4462-910c-8f923ab51085 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:32.106122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a5beb-0b21-4462-910c-8f923ab51085 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:32.107625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a5beb-0b21-4462-910c-8f923ab51085 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:32.113985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 109/204] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:31 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:32.113985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a5beb-0b21-4462-910c-8f923ab51085 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:32.114786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:32.119320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6dcd5-606b-47c2-9be3-b10a8ffc329f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:32.154769 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de903229-6204-471a-89ce-08cf3a9f6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:32.156310 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903229-6204-471a-89ce-08cf3a9f6076 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:32.156791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903229-6204-471a-89ce-08cf3a9f6076 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:32.157266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903229-6204-471a-89ce-08cf3a9f6076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:32.158290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de903229-6204-471a-89ce-08cf3a9f6076 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16, user.id=8c87be7bdb4242fb8d468f26d9ee473a) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:32.158798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de903229-6204-471a-89ce-08cf3a9f6076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:32.160488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de903229-6204-471a-89ce-08cf3a9f6076 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:32.166890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 96/205] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:32 2022] GET /identity/v3/role_assignments?user.id=8c87be7bdb4242fb8d468f26d9ee473a&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:32.168121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de903229-6204-471a-89ce-08cf3a9f6076 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:32.201470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:32.295038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a5beb-0b21-4462-910c-8f923ab51085 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:32.297826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de903229-6204-471a-89ce-08cf3a9f6076 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:32.351597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc0ed3-b767-47f1-bc3a-bcaa3b842a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:32.353786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0ed3-b767-47f1-bc3a-bcaa3b842a79 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:32.355333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0ed3-b767-47f1-bc3a-bcaa3b842a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:32.356965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0ed3-b767-47f1-bc3a-bcaa3b842a79 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:32.358922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc0ed3-b767-47f1-bc3a-bcaa3b842a79 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:32.361588 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc0ed3-b767-47f1-bc3a-bcaa3b842a79 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:32.364377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 110/206] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:32 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:32.372857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a20b-d799-4b08-a43f-b8afac2560fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:32.373283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc0ed3-b767-47f1-bc3a-bcaa3b842a79 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:32.373550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a20b-d799-4b08-a43f-b8afac2560fc None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:32.373830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a20b-d799-4b08-a43f-b8afac2560fc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:32.374195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a20b-d799-4b08-a43f-b8afac2560fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:32.375089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89a20b-d799-4b08-a43f-b8afac2560fc None admin] RBAC: Adding query filter params (role.id=c81f6283cf3a418bad94b56a1e9ea2b3, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16, user.id=8c87be7bdb4242fb8d468f26d9ee473a) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:32.375416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89a20b-d799-4b08-a43f-b8afac2560fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:32.376909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89a20b-d799-4b08-a43f-b8afac2560fc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:32.387196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 97/207] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:32 2022] GET /identity/v3/role_assignments?user.id=8c87be7bdb4242fb8d468f26d9ee473a&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=c81f6283cf3a418bad94b56a1e9ea2b3 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:32.523385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc0ed3-b767-47f1-bc3a-bcaa3b842a79 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:32.573488 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66780205-be88-4df3-b148-c71e21053672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:32.574077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780205-be88-4df3-b148-c71e21053672 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:32.574355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780205-be88-4df3-b148-c71e21053672 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:32.574632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780205-be88-4df3-b148-c71e21053672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:32.575501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66780205-be88-4df3-b148-c71e21053672 None admin] RBAC: Adding query filter params (role.id=6e4d951189724f6d8905ef4c7b8c0015, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58, user.id=6c25391d5508473a90bd897fc5d05c56) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:32.575813 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66780205-be88-4df3-b148-c71e21053672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:32.577320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66780205-be88-4df3-b148-c71e21053672 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:32.579178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:32.584657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 111/208] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:32 2022] GET /identity/v3/role_assignments?user.id=6c25391d5508473a90bd897fc5d05c56&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=6e4d951189724f6d8905ef4c7b8c0015 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:33.185760 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9e96c-feff-40e7-8b55-2f45d857da93 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:33.186277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9e96c-feff-40e7-8b55-2f45d857da93 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:33.186445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9e96c-feff-40e7-8b55-2f45d857da93 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:33.187944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 98/209] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:33.193346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe88d6-2121-46f8-886e-99a246c40d03 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:33.194150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe88d6-2121-46f8-886e-99a246c40d03 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:33.194612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe88d6-2121-46f8-886e-99a246c40d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:33.216328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-3ebe88d6-2121-46f8-886e-99a246c40d03 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:33.217917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3ebe88d6-2121-46f8-886e-99a246c40d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:33.307171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 112/210] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:33.329894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9e96c-feff-40e7-8b55-2f45d857da93 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:33.358475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:33.398078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10e43c-66f2-4300-8695-4d4182cd0459 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:33.398428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10e43c-66f2-4300-8695-4d4182cd0459 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:33.398659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10e43c-66f2-4300-8695-4d4182cd0459 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:33.400317 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 113/211] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:33.405366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3acd1e-d6ac-415e-91df-23ef172269f5 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:33.405650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3acd1e-d6ac-415e-91df-23ef172269f5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:33.405927 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3acd1e-d6ac-415e-91df-23ef172269f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:33.423364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ec3acd1e-d6ac-415e-91df-23ef172269f5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:33.424524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ec3acd1e-d6ac-415e-91df-23ef172269f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:33.438203 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9e96c-feff-40e7-8b55-2f45d857da93 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:33.474773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fadd7a-eaad-4051-a50b-97f3fe8a4730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:33.476141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fadd7a-eaad-4051-a50b-97f3fe8a4730 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:33.476881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fadd7a-eaad-4051-a50b-97f3fe8a4730 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:33.477555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fadd7a-eaad-4051-a50b-97f3fe8a4730 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:33.488948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fadd7a-eaad-4051-a50b-97f3fe8a4730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:33.492865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 114/212] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-16fadd7a-eaad-4051-a50b-97f3fe8a4730 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:33.497763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:33.498704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:33.499622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:33.502514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 99/213] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:33.509133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3acd1e-d6ac-415e-91df-23ef172269f5 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:33.521050 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fadd7a-eaad-4051-a50b-97f3fe8a4730 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:33.571586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:33.613648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3acd1e-d6ac-415e-91df-23ef172269f5 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:33.622805 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:33.638475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fadd7a-eaad-4051-a50b-97f3fe8a4730 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:33.654018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695cd2d-d9ad-4b28-b3d0-ef3c191968a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:33.655149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695cd2d-d9ad-4b28-b3d0-ef3c191968a0 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:33.655503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695cd2d-d9ad-4b28-b3d0-ef3c191968a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:33.655836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695cd2d-d9ad-4b28-b3d0-ef3c191968a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:33.656873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695cd2d-d9ad-4b28-b3d0-ef3c191968a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:33.657698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695cd2d-d9ad-4b28-b3d0-ef3c191968a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:33.659550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695cd2d-d9ad-4b28-b3d0-ef3c191968a0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:33.671775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 115/214] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:33.677105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695cd2d-d9ad-4b28-b3d0-ef3c191968a0 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:33.685897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c313bf-9822-4885-8dc3-1db37921d2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:33.686915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c313bf-9822-4885-8dc3-1db37921d2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:33.687227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c313bf-9822-4885-8dc3-1db37921d2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:33.687592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c313bf-9822-4885-8dc3-1db37921d2f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:33.688853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c313bf-9822-4885-8dc3-1db37921d2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:33.690269 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c313bf-9822-4885-8dc3-1db37921d2f4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:33.691942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 100/215] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:33.697246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c313bf-9822-4885-8dc3-1db37921d2f4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:33.799117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c313bf-9822-4885-8dc3-1db37921d2f4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:33.806399 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695cd2d-d9ad-4b28-b3d0-ef3c191968a0 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:33.835425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:33.844884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34719da-f1c0-44bc-acd2-c2cac9d0f60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:33.846092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34719da-f1c0-44bc-acd2-c2cac9d0f60d None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:33.846920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34719da-f1c0-44bc-acd2-c2cac9d0f60d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:33.847661 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34719da-f1c0-44bc-acd2-c2cac9d0f60d None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:33.848766 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34719da-f1c0-44bc-acd2-c2cac9d0f60d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:33.850644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34719da-f1c0-44bc-acd2-c2cac9d0f60d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:33.851104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeed3f7-27c2-46be-8703-b9da33796b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:33.851994 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeed3f7-27c2-46be-8703-b9da33796b55 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:33.852268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeed3f7-27c2-46be-8703-b9da33796b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:33.852539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeed3f7-27c2-46be-8703-b9da33796b55 None admin] PATH_INFO: `/v3/users/14199454c5874ee78e12168bf251ad20` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:33.869173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeed3f7-27c2-46be-8703-b9da33796b55 None admin] RBAC: Authorizing `identity:get_user(user_id=14199454c5874ee78e12168bf251ad20)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:33.870840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeed3f7-27c2-46be-8703-b9da33796b55 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:33.877562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 116/216] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:33 2022] GET /identity/v3/users/14199454c5874ee78e12168bf251ad20 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:33.879206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeed3f7-27c2-46be-8703-b9da33796b55 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:33.886738 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 101/217] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:51:33 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:51:33.992539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeed3f7-27c2-46be-8703-b9da33796b55 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:34.031919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87a3a5-0e2b-4f54-9064-4906bee64549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:34.032965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87a3a5-0e2b-4f54-9064-4906bee64549 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:34.033436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87a3a5-0e2b-4f54-9064-4906bee64549 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:34.033902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87a3a5-0e2b-4f54-9064-4906bee64549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:34.084085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:34.110353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87a3a5-0e2b-4f54-9064-4906bee64549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:34.111855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87a3a5-0e2b-4f54-9064-4906bee64549 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:34.217350 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 117/218] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:34.224139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34719da-f1c0-44bc-acd2-c2cac9d0f60d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:34.237676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:34.332882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34719da-f1c0-44bc-acd2-c2cac9d0f60d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:34.367089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0699c-2aca-4936-ac5a-7ec641d1e703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:34.367998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0699c-2aca-4936-ac5a-7ec641d1e703 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:34.368279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0699c-2aca-4936-ac5a-7ec641d1e703 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:34.368552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0699c-2aca-4936-ac5a-7ec641d1e703 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:34.369743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0699c-2aca-4936-ac5a-7ec641d1e703 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:34.371233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0699c-2aca-4936-ac5a-7ec641d1e703 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:34.373359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 102/219] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:34 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:34.379203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87a3a5-0e2b-4f54-9064-4906bee64549 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:34.449881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8285-ecd7-478d-8187-853eb1bb732c None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:34.450208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8285-ecd7-478d-8187-853eb1bb732c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:34.450465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a8285-ecd7-478d-8187-853eb1bb732c None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:34.452222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 103/220] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:34.468031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9e07a-ac0e-476c-a457-26502a812da9 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:34.468318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9e07a-ac0e-476c-a457-26502a812da9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:34.468602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9e07a-ac0e-476c-a457-26502a812da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:34.471927 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:34.498170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9ad9e07a-ac0e-476c-a457-26502a812da9 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:34.499473 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9ad9e07a-ac0e-476c-a457-26502a812da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:34.533202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87a3a5-0e2b-4f54-9064-4906bee64549 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:34.595042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 104/221] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:34.596345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3997c8b-5b8c-44ab-95ae-dcc6e51dc09d None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:34.596635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3997c8b-5b8c-44ab-95ae-dcc6e51dc09d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:34.596914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3997c8b-5b8c-44ab-95ae-dcc6e51dc09d None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:34.598338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 105/222] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:34.605334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351edb-1551-4b89-8019-cfb29f367f77 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:34.605619 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351edb-1551-4b89-8019-cfb29f367f77 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:34.605898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351edb-1551-4b89-8019-cfb29f367f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:34.615365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03359d78-9bf0-4201-8d84-caa420e21326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:34.616034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359d78-9bf0-4201-8d84-caa420e21326 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:34.616316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359d78-9bf0-4201-8d84-caa420e21326 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:34.616593 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359d78-9bf0-4201-8d84-caa420e21326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:34.617437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03359d78-9bf0-4201-8d84-caa420e21326 None admin] RBAC: Adding query filter params (role.id=729faf69df60450caeada9c53520224f, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16, user.id=14199454c5874ee78e12168bf251ad20) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:34.617748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03359d78-9bf0-4201-8d84-caa420e21326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:34.619247 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03359d78-9bf0-4201-8d84-caa420e21326 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:34.628080 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 118/223] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:34 2022] GET /identity/v3/role_assignments?user.id=14199454c5874ee78e12168bf251ad20&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=729faf69df60450caeada9c53520224f => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:34.628728 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03359d78-9bf0-4201-8d84-caa420e21326 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:34.639632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e3351edb-1551-4b89-8019-cfb29f367f77 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:34.641288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e3351edb-1551-4b89-8019-cfb29f367f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:34.644016 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:34.760946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03359d78-9bf0-4201-8d84-caa420e21326 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:34.807933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 106/224] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:34.818174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f29b08-fbb3-4920-9c83-313679e5ce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:34.819129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f29b08-fbb3-4920-9c83-313679e5ce3b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:34.819476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f29b08-fbb3-4920-9c83-313679e5ce3b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:34.819808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f29b08-fbb3-4920-9c83-313679e5ce3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:34.844644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3351edb-1551-4b89-8019-cfb29f367f77 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:34.847635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f29b08-fbb3-4920-9c83-313679e5ce3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-06f29b08-fbb3-4920-9c83-313679e5ce3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:34.855507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:34.856406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:34.857181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 119/225] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:51:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:34.865665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f29b08-fbb3-4920-9c83-313679e5ce3b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:34.871294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:34.945777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3351edb-1551-4b89-8019-cfb29f367f77 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:34.982750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023638-f714-4a73-ae9c-d78234edb910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:34.982750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023638-f714-4a73-ae9c-d78234edb910 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:34.982750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023638-f714-4a73-ae9c-d78234edb910 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:34.982750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023638-f714-4a73-ae9c-d78234edb910 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:34.988483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:34.992239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40023638-f714-4a73-ae9c-d78234edb910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-40023638-f714-4a73-ae9c-d78234edb910 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:35.002833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:35.003834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:35.004624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 107/226] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:51:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:51:35.015999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023638-f714-4a73-ae9c-d78234edb910 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:35.025056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f29b08-fbb3-4920-9c83-313679e5ce3b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:35.082428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a7a22-91ee-460a-97a2-6edbae06640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:35.083154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7a22-91ee-460a-97a2-6edbae06640d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:35.083444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7a22-91ee-460a-97a2-6edbae06640d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:35.083726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a7a22-91ee-460a-97a2-6edbae06640d None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:35.084494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a7a22-91ee-460a-97a2-6edbae06640d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:35.084803 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a7a22-91ee-460a-97a2-6edbae06640d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:35.086215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a7a22-91ee-460a-97a2-6edbae06640d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:35.095423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 120/227] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:35.101042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a7a22-91ee-460a-97a2-6edbae06640d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:35.139159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023638-f714-4a73-ae9c-d78234edb910 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:35.205443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1c295-6de1-4501-a644-a0f7f29cbcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:35.206126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1c295-6de1-4501-a644-a0f7f29cbcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:35.206407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1c295-6de1-4501-a644-a0f7f29cbcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:35.206687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1c295-6de1-4501-a644-a0f7f29cbcd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:35.207482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1c295-6de1-4501-a644-a0f7f29cbcd9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:35.207793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1c295-6de1-4501-a644-a0f7f29cbcd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:35.209196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1c295-6de1-4501-a644-a0f7f29cbcd9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:35.219814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:35.222794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 108/228] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:51:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:35.235311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1c295-6de1-4501-a644-a0f7f29cbcd9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:35.254960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a7a22-91ee-460a-97a2-6edbae06640d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:35.296390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72c9d2-75d7-45b6-b6cc-67b070768d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:35.297288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72c9d2-75d7-45b6-b6cc-67b070768d0c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:35.297574 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72c9d2-75d7-45b6-b6cc-67b070768d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:35.297952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72c9d2-75d7-45b6-b6cc-67b070768d0c None admin] PATH_INFO: `/v3/users/8c87be7bdb4242fb8d468f26d9ee473a` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:35.299305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72c9d2-75d7-45b6-b6cc-67b070768d0c None admin] RBAC: Authorizing `identity:get_user(user_id=8c87be7bdb4242fb8d468f26d9ee473a)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:35.300774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72c9d2-75d7-45b6-b6cc-67b070768d0c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:35.303899 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 121/229] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:35 2022] GET /identity/v3/users/8c87be7bdb4242fb8d468f26d9ee473a => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:35.309495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72c9d2-75d7-45b6-b6cc-67b070768d0c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:35.323305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:35.357886 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1c295-6de1-4501-a644-a0f7f29cbcd9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:35.390935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe67dc-f4be-43cc-acb5-15e55e7ef6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:35.391974 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe67dc-f4be-43cc-acb5-15e55e7ef6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:35.392260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe67dc-f4be-43cc-acb5-15e55e7ef6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:35.392536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe67dc-f4be-43cc-acb5-15e55e7ef6e6 None admin] PATH_INFO: `/v3/users/8c87be7bdb4242fb8d468f26d9ee473a` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:35.393736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe67dc-f4be-43cc-acb5-15e55e7ef6e6 None admin] RBAC: Authorizing `identity:get_user(user_id=8c87be7bdb4242fb8d468f26d9ee473a)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:35.395236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe67dc-f4be-43cc-acb5-15e55e7ef6e6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:35.397179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 109/230] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:35 2022] GET /identity/v3/users/8c87be7bdb4242fb8d468f26d9ee473a => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:35.402921 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe67dc-f4be-43cc-acb5-15e55e7ef6e6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:35.470020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72c9d2-75d7-45b6-b6cc-67b070768d0c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:35.506285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:35.507581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9aa0f-78e4-42e0-a635-b06ff9fa1d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:35.508477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9aa0f-78e4-42e0-a635-b06ff9fa1d36 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:35.508758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9aa0f-78e4-42e0-a635-b06ff9fa1d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:35.509192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9aa0f-78e4-42e0-a635-b06ff9fa1d36 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:35.510634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9aa0f-78e4-42e0-a635-b06ff9fa1d36 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:35.512282 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9aa0f-78e4-42e0-a635-b06ff9fa1d36 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:35.514147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 122/231] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:35 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:35.524226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9aa0f-78e4-42e0-a635-b06ff9fa1d36 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:35.596628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe67dc-f4be-43cc-acb5-15e55e7ef6e6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:35.645056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:35.661041 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1597e4-5c31-4c61-85a1-4d5ab84c911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:35.662183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1597e4-5c31-4c61-85a1-4d5ab84c911c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:35.662681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1597e4-5c31-4c61-85a1-4d5ab84c911c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:35.663133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1597e4-5c31-4c61-85a1-4d5ab84c911c None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:35.665320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1597e4-5c31-4c61-85a1-4d5ab84c911c None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:35.668822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1597e4-5c31-4c61-85a1-4d5ab84c911c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:35.673424 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 110/232] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:35 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:35.678504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1597e4-5c31-4c61-85a1-4d5ab84c911c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:35.728085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9aa0f-78e4-42e0-a635-b06ff9fa1d36 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:35.787785 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6f566-b59f-4c42-acf3-7434fd12d4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:35.789483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6f566-b59f-4c42-acf3-7434fd12d4d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:35.789934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6f566-b59f-4c42-acf3-7434fd12d4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:35.790351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6f566-b59f-4c42-acf3-7434fd12d4d4 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/users/8c87be7bdb4242fb8d468f26d9ee473a/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:35.792912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6f566-b59f-4c42-acf3-7434fd12d4d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb27a40f6d7647a9b0c4abb9026dde16, user_id=8c87be7bdb4242fb8d468f26d9ee473a, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:35.794526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6f566-b59f-4c42-acf3-7434fd12d4d4 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:35.818447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 123/233] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:51:35 2022] PUT /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/users/8c87be7bdb4242fb8d468f26d9ee473a/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:35.836343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1597e4-5c31-4c61-85a1-4d5ab84c911c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:35.883891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b4022-eb97-460d-a2ff-ae90449a0e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:35.884985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b4022-eb97-460d-a2ff-ae90449a0e20 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:35.885361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b4022-eb97-460d-a2ff-ae90449a0e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:35.885730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b4022-eb97-460d-a2ff-ae90449a0e20 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/users/8c87be7bdb4242fb8d468f26d9ee473a/roles/c81f6283cf3a418bad94b56a1e9ea2b3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:35.888345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b4022-eb97-460d-a2ff-ae90449a0e20 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb27a40f6d7647a9b0c4abb9026dde16, user_id=8c87be7bdb4242fb8d468f26d9ee473a, role_id=c81f6283cf3a418bad94b56a1e9ea2b3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:35.890029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b4022-eb97-460d-a2ff-ae90449a0e20 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:35.922170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 111/234] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:51:35 2022] PUT /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/users/8c87be7bdb4242fb8d468f26d9ee473a/roles/c81f6283cf3a418bad94b56a1e9ea2b3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:36.507940 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8acc3b-b792-48c3-846e-0a46cc1aae43 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:36.508868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8acc3b-b792-48c3-846e-0a46cc1aae43 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:36.509437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8acc3b-b792-48c3-846e-0a46cc1aae43 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:36.511329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 124/235] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:36.516381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c300-ff8d-4dcf-97ce-36bfa089ae89 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:36.516804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c300-ff8d-4dcf-97ce-36bfa089ae89 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:36.516988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9c300-ff8d-4dcf-97ce-36bfa089ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:36.538728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-24c9c300-ff8d-4dcf-97ce-36bfa089ae89 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:36.548125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-24c9c300-ff8d-4dcf-97ce-36bfa089ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:36.614053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:36.635582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 112/236] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:36.639071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320970b6-dea8-4a90-a88f-ea3ed97723ef None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:36.639368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320970b6-dea8-4a90-a88f-ea3ed97723ef None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:36.639782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320970b6-dea8-4a90-a88f-ea3ed97723ef None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:36.641412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 125/237] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:36.646500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d52e51-8df2-4775-be81-738fd1f97d6d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:36.646791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d52e51-8df2-4775-be81-738fd1f97d6d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:36.647103 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d52e51-8df2-4775-be81-738fd1f97d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:36.663848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-54d52e51-8df2-4775-be81-738fd1f97d6d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:36.665039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-54d52e51-8df2-4775-be81-738fd1f97d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:36.677486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320970b6-dea8-4a90-a88f-ea3ed97723ef None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:36.756425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 113/238] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:36.786104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:36.844719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320970b6-dea8-4a90-a88f-ea3ed97723ef None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:36.850705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d52e51-8df2-4775-be81-738fd1f97d6d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:36.898597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00da64d-4292-4a76-8a15-c1f218821c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:36.899452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da64d-4292-4a76-8a15-c1f218821c63 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:36.899732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da64d-4292-4a76-8a15-c1f218821c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:36.900009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da64d-4292-4a76-8a15-c1f218821c63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:36.912956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00da64d-4292-4a76-8a15-c1f218821c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-a00da64d-4292-4a76-8a15-c1f218821c63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:36.921731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:36.922626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:36.923451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 126/239] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:36.928650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00da64d-4292-4a76-8a15-c1f218821c63 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:37.043012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00da64d-4292-4a76-8a15-c1f218821c63 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:37.067367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:37.094179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d52e51-8df2-4775-be81-738fd1f97d6d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:37.103689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa1c72-2ce4-448c-a12b-12e2c2f0f287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:37.104384 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1c72-2ce4-448c-a12b-12e2c2f0f287 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:37.104664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1c72-2ce4-448c-a12b-12e2c2f0f287 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:37.104947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1c72-2ce4-448c-a12b-12e2c2f0f287 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:37.105704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa1c72-2ce4-448c-a12b-12e2c2f0f287 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:37.106007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa1c72-2ce4-448c-a12b-12e2c2f0f287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:37.115149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa1c72-2ce4-448c-a12b-12e2c2f0f287 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:37.124202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 127/240] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:37.127588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:37.131965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa1c72-2ce4-448c-a12b-12e2c2f0f287 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:37.165225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53f221-7fe2-4427-afd9-b976c47ce194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:37.166040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53f221-7fe2-4427-afd9-b976c47ce194 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:37.166316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53f221-7fe2-4427-afd9-b976c47ce194 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:37.166941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53f221-7fe2-4427-afd9-b976c47ce194 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:37.168917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53f221-7fe2-4427-afd9-b976c47ce194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:37.170386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53f221-7fe2-4427-afd9-b976c47ce194 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:37.175178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 114/241] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:37.183914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53f221-7fe2-4427-afd9-b976c47ce194 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:37.286717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa1c72-2ce4-448c-a12b-12e2c2f0f287 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:37.317586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53f221-7fe2-4427-afd9-b976c47ce194 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:37.325582 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8159ecb-db98-4725-b00e-fe6132dacaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:37.326818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159ecb-db98-4725-b00e-fe6132dacaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:37.327020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159ecb-db98-4725-b00e-fe6132dacaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:37.327446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159ecb-db98-4725-b00e-fe6132dacaf5 None admin] PATH_INFO: `/v3/users/ffdcecaa0de5459ea36d0afcbd7f155d` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:37.342205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8159ecb-db98-4725-b00e-fe6132dacaf5 None admin] RBAC: Authorizing `identity:get_user(user_id=ffdcecaa0de5459ea36d0afcbd7f155d)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:37.344035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8159ecb-db98-4725-b00e-fe6132dacaf5 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:37.350559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 128/242] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:37 2022] GET /identity/v3/users/ffdcecaa0de5459ea36d0afcbd7f155d => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:37.350559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f93d8a-0cef-427f-90a2-5190a8e43702 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:37.350559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f93d8a-0cef-427f-90a2-5190a8e43702 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:37.350559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f93d8a-0cef-427f-90a2-5190a8e43702 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:37.350559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 129/243] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:37.355759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f93d8a-0cef-427f-90a2-5190a8e43702 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:37.359642 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6a15a-6df3-4adc-bafe-30e01dee20da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:37.360491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6a15a-6df3-4adc-bafe-30e01dee20da None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:37.360988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6a15a-6df3-4adc-bafe-30e01dee20da None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:37.361462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6a15a-6df3-4adc-bafe-30e01dee20da None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:37.362383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6a15a-6df3-4adc-bafe-30e01dee20da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:37.364081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6a15a-6df3-4adc-bafe-30e01dee20da None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:37.386917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 115/244] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:51:37 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:51:37.389225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea98eb-55eb-4f0c-8a8b-d1537d3ce454 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:37.389850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea98eb-55eb-4f0c-8a8b-d1537d3ce454 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:37.390447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea98eb-55eb-4f0c-8a8b-d1537d3ce454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:37.402564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:37.410196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9eea98eb-55eb-4f0c-8a8b-d1537d3ce454 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:37.411741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9eea98eb-55eb-4f0c-8a8b-d1537d3ce454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:37.450945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:37.471564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f93d8a-0cef-427f-90a2-5190a8e43702 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:37.492259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 116/245] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:37.523173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea98eb-55eb-4f0c-8a8b-d1537d3ce454 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:37.544799 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09e562-6a4e-4b83-8dfe-c735c9523a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:37.545492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09e562-6a4e-4b83-8dfe-c735c9523a8d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:37.545918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09e562-6a4e-4b83-8dfe-c735c9523a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:37.546478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09e562-6a4e-4b83-8dfe-c735c9523a8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:37.640012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea98eb-55eb-4f0c-8a8b-d1537d3ce454 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:37.671952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09e562-6a4e-4b83-8dfe-c735c9523a8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:37.674785 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09e562-6a4e-4b83-8dfe-c735c9523a8d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:37.682143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25414f0-e4af-4b65-aeef-33dfc890a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:37.683122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25414f0-e4af-4b65-aeef-33dfc890a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:37.683474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25414f0-e4af-4b65-aeef-33dfc890a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:37.683826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25414f0-e4af-4b65-aeef-33dfc890a6c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:37.699441 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25414f0-e4af-4b65-aeef-33dfc890a6c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-d25414f0-e4af-4b65-aeef-33dfc890a6c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:37.709575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:37.710494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:37.711552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 117/246] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:51:37.717725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25414f0-e4af-4b65-aeef-33dfc890a6c4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:37.762911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:37.764878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:37.849357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25414f0-e4af-4b65-aeef-33dfc890a6c4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:37.858954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 130/247] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:37.872278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09e562-6a4e-4b83-8dfe-c735c9523a8d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:37.901365 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da475f-e830-4e21-a04b-f1f6e3037355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:37.903079 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da475f-e830-4e21-a04b-f1f6e3037355 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:37.903079 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da475f-e830-4e21-a04b-f1f6e3037355 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:37.903079 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da475f-e830-4e21-a04b-f1f6e3037355 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:37.903930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da475f-e830-4e21-a04b-f1f6e3037355 None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:37.904305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da475f-e830-4e21-a04b-f1f6e3037355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:37.906219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da475f-e830-4e21-a04b-f1f6e3037355 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:37.919216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 118/248] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:37.928986 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da475f-e830-4e21-a04b-f1f6e3037355 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:37.994695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09e562-6a4e-4b83-8dfe-c735c9523a8d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:38.028360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:38.038479 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da475f-e830-4e21-a04b-f1f6e3037355 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:38.038964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469c758-b90f-4648-9ac9-be17d812c1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:38.039869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469c758-b90f-4648-9ac9-be17d812c1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:38.040151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469c758-b90f-4648-9ac9-be17d812c1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:38.040423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469c758-b90f-4648-9ac9-be17d812c1d2 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:38.042043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469c758-b90f-4648-9ac9-be17d812c1d2 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:38.043677 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469c758-b90f-4648-9ac9-be17d812c1d2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:38.045683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 131/249] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:37 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:38.051677 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469c758-b90f-4648-9ac9-be17d812c1d2 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:38.063202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:38.077934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a042e0-b592-411d-b372-d8b5a97c9c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:38.079245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a042e0-b592-411d-b372-d8b5a97c9c66 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:38.079736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a042e0-b592-411d-b372-d8b5a97c9c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:38.080188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a042e0-b592-411d-b372-d8b5a97c9c66 None admin] PATH_INFO: `/v3/users/14199454c5874ee78e12168bf251ad20` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:38.082149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a042e0-b592-411d-b372-d8b5a97c9c66 None admin] RBAC: Authorizing `identity:get_user(user_id=14199454c5874ee78e12168bf251ad20)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:38.083935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a042e0-b592-411d-b372-d8b5a97c9c66 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:38.085968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 119/250] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:37 2022] GET /identity/v3/users/14199454c5874ee78e12168bf251ad20 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:38.096375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a042e0-b592-411d-b372-d8b5a97c9c66 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:38.225518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469c758-b90f-4648-9ac9-be17d812c1d2 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:38.282064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a042e0-b592-411d-b372-d8b5a97c9c66 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:38.294202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5416d-f144-4aa4-974e-4125388215bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:38.294868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5416d-f144-4aa4-974e-4125388215bd None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:38.295171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5416d-f144-4aa4-974e-4125388215bd None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:38.295441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5416d-f144-4aa4-974e-4125388215bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:38.296432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5416d-f144-4aa4-974e-4125388215bd None admin] RBAC: Adding query filter params (role.id=6e4d951189724f6d8905ef4c7b8c0015, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16, user.id=ffdcecaa0de5459ea36d0afcbd7f155d) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:38.296738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5416d-f144-4aa4-974e-4125388215bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:38.298197 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5416d-f144-4aa4-974e-4125388215bd None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:38.310645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 132/251] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:38 2022] GET /identity/v3/role_assignments?user.id=ffdcecaa0de5459ea36d0afcbd7f155d&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=6e4d951189724f6d8905ef4c7b8c0015 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:38.340384 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8c2da-8b07-4dac-9f18-139aac7f0bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:38.341272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8c2da-8b07-4dac-9f18-139aac7f0bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:38.341546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8c2da-8b07-4dac-9f18-139aac7f0bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:38.341821 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8c2da-8b07-4dac-9f18-139aac7f0bd3 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:38.348032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8c2da-8b07-4dac-9f18-139aac7f0bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:38.349602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8c2da-8b07-4dac-9f18-139aac7f0bd3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:38.351774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 120/252] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:38 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:38.357461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5416d-f144-4aa4-974e-4125388215bd None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:38.446522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:38.478583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5416d-f144-4aa4-974e-4125388215bd None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:38.492219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396b1ad-aebe-4ec8-94ac-0b7a721ef6e8 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:38.492553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396b1ad-aebe-4ec8-94ac-0b7a721ef6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:38.492773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396b1ad-aebe-4ec8-94ac-0b7a721ef6e8 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:38.494445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 121/253] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:38.501511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847b573-7c35-4fa3-9df5-f717dc69b363 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:38.501511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847b573-7c35-4fa3-9df5-f717dc69b363 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:38.501653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847b573-7c35-4fa3-9df5-f717dc69b363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:38.534086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7847b573-7c35-4fa3-9df5-f717dc69b363 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:38.535330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7847b573-7c35-4fa3-9df5-f717dc69b363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:38.571459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665ca9a-cd1a-4987-b1f1-8418df17f382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:38.572383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665ca9a-cd1a-4987-b1f1-8418df17f382 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:38.572659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665ca9a-cd1a-4987-b1f1-8418df17f382 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:38.572930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665ca9a-cd1a-4987-b1f1-8418df17f382 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/users/14199454c5874ee78e12168bf251ad20/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:38.576770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665ca9a-cd1a-4987-b1f1-8418df17f382 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb27a40f6d7647a9b0c4abb9026dde16, user_id=14199454c5874ee78e12168bf251ad20, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:38.578321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665ca9a-cd1a-4987-b1f1-8418df17f382 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:38.591664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:38.603839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 133/254] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:51:38 2022] PUT /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/users/14199454c5874ee78e12168bf251ad20/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:38.604895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc247f-1e64-4d6a-8902-be35fb22e52c None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:38.605204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc247f-1e64-4d6a-8902-be35fb22e52c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:38.605484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc247f-1e64-4d6a-8902-be35fb22e52c None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:38.612349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 134/255] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:38.613719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29d2d-f7bd-44d3-b75c-77b08893b717 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:38.614007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29d2d-f7bd-44d3-b75c-77b08893b717 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:38.614351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29d2d-f7bd-44d3-b75c-77b08893b717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:38.634751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5fe29d2d-f7bd-44d3-b75c-77b08893b717 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:38.636341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5fe29d2d-f7bd-44d3-b75c-77b08893b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:38.737738 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 122/256] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:38.761643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 135/257] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:38.778605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847b573-7c35-4fa3-9df5-f717dc69b363 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:38.797074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe29d2d-f7bd-44d3-b75c-77b08893b717 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:38.902122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:38.973646 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe29d2d-f7bd-44d3-b75c-77b08893b717 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:38.990747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847b573-7c35-4fa3-9df5-f717dc69b363 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:39.038160 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeb7e4-f790-450e-8f74-a811f534a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:39.039388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeb7e4-f790-450e-8f74-a811f534a272 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:39.039675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeb7e4-f790-450e-8f74-a811f534a272 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:39.039953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeb7e4-f790-450e-8f74-a811f534a272 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:39.052286 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeb7e4-f790-450e-8f74-a811f534a272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-60eeb7e4-f790-450e-8f74-a811f534a272 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:39.060110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:39.061006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:39.062001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 123/258] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:51:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:39.062684 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552695-cae5-424f-86a0-ceb925ba128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:39.063725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552695-cae5-424f-86a0-ceb925ba128a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:39.064161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552695-cae5-424f-86a0-ceb925ba128a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:39.064456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552695-cae5-424f-86a0-ceb925ba128a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:39.072603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeb7e4-f790-450e-8f74-a811f534a272 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:39.092698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552695-cae5-424f-86a0-ceb925ba128a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:39.100001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-fa552695-cae5-424f-86a0-ceb925ba128a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:39.108659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:39.109719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:39.110630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:39.115129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 136/259] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:51:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:39.126405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552695-cae5-424f-86a0-ceb925ba128a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:39.202980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeb7e4-f790-450e-8f74-a811f534a272 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:39.234718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552695-cae5-424f-86a0-ceb925ba128a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:39.238475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0926c-ec49-4710-a9ce-84ee97e7e929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:39.238789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0926c-ec49-4710-a9ce-84ee97e7e929 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:39.239198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0926c-ec49-4710-a9ce-84ee97e7e929 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:39.239573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0926c-ec49-4710-a9ce-84ee97e7e929 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:39.240430 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0926c-ec49-4710-a9ce-84ee97e7e929 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:39.240921 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0926c-ec49-4710-a9ce-84ee97e7e929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:39.242340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0926c-ec49-4710-a9ce-84ee97e7e929 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:39.251886 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 124/260] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:39.259994 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0926c-ec49-4710-a9ce-84ee97e7e929 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:39.262031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:39.275817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8765e6-fd4c-464e-a2bf-a8726bd81bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:39.276747 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8765e6-fd4c-464e-a2bf-a8726bd81bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:39.277175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8765e6-fd4c-464e-a2bf-a8726bd81bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:39.277590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8765e6-fd4c-464e-a2bf-a8726bd81bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:39.278545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8765e6-fd4c-464e-a2bf-a8726bd81bb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:39.279011 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8765e6-fd4c-464e-a2bf-a8726bd81bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:39.280713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8765e6-fd4c-464e-a2bf-a8726bd81bb9 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:39.290222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 137/261] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:51:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:39.297084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8765e6-fd4c-464e-a2bf-a8726bd81bb9 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:39.396592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:39.403468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8765e6-fd4c-464e-a2bf-a8726bd81bb9 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:39.431017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0926c-ec49-4710-a9ce-84ee97e7e929 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:39.439617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb55dd-9bab-4380-992a-fe4c702b3819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:39.440657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb55dd-9bab-4380-992a-fe4c702b3819 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:39.441053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb55dd-9bab-4380-992a-fe4c702b3819 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:39.441686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb55dd-9bab-4380-992a-fe4c702b3819 None admin] PATH_INFO: `/v3/users/8c87be7bdb4242fb8d468f26d9ee473a` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:39.442723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb55dd-9bab-4380-992a-fe4c702b3819 None admin] RBAC: Authorizing `identity:get_user(user_id=8c87be7bdb4242fb8d468f26d9ee473a)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:39.446600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb55dd-9bab-4380-992a-fe4c702b3819 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:39.446600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 138/262] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:39 2022] GET /identity/v3/users/8c87be7bdb4242fb8d468f26d9ee473a => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:39.451897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb55dd-9bab-4380-992a-fe4c702b3819 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:39.486092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14021127-9b05-4759-b561-8fbf82594d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:39.487396 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021127-9b05-4759-b561-8fbf82594d18 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:39.487821 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021127-9b05-4759-b561-8fbf82594d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:39.488236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021127-9b05-4759-b561-8fbf82594d18 None admin] PATH_INFO: `/v3/users/8c87be7bdb4242fb8d468f26d9ee473a` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:39.495779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14021127-9b05-4759-b561-8fbf82594d18 None admin] RBAC: Authorizing `identity:get_user(user_id=8c87be7bdb4242fb8d468f26d9ee473a)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:39.497417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14021127-9b05-4759-b561-8fbf82594d18 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:39.499543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 125/263] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:39 2022] GET /identity/v3/users/8c87be7bdb4242fb8d468f26d9ee473a => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:39.504847 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14021127-9b05-4759-b561-8fbf82594d18 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:39.519279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:39.571389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb55dd-9bab-4380-992a-fe4c702b3819 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:39.612462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4b4f-090e-48fb-ad8b-d93d30dafc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:39.613972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4b4f-090e-48fb-ad8b-d93d30dafc6e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:39.614455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4b4f-090e-48fb-ad8b-d93d30dafc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:39.614926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4b4f-090e-48fb-ad8b-d93d30dafc6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:39.651523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14021127-9b05-4759-b561-8fbf82594d18 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:39.689152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be8d84-f2ea-49ce-83f3-0538bf95b0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:39.690202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be8d84-f2ea-49ce-83f3-0538bf95b0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:39.690732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be8d84-f2ea-49ce-83f3-0538bf95b0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:39.691345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be8d84-f2ea-49ce-83f3-0538bf95b0c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:39.702442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c4b4f-090e-48fb-ad8b-d93d30dafc6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:39.704439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c4b4f-090e-48fb-ad8b-d93d30dafc6e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:39.712287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:39.768790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be8d84-f2ea-49ce-83f3-0538bf95b0c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:39.769483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:39.773647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be8d84-f2ea-49ce-83f3-0538bf95b0c9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:39.834886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 139/264] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 26 02:51:39.836307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4b4f-090e-48fb-ad8b-d93d30dafc6e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:39.987831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 126/265] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:39.993256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be8d84-f2ea-49ce-83f3-0538bf95b0c9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:40.032740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4b4f-090e-48fb-ad8b-d93d30dafc6e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:40.088611 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:40.105693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e27b8-60ce-4200-b9c2-6cf70b7057b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:40.107528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e27b8-60ce-4200-b9c2-6cf70b7057b5 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:40.108191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e27b8-60ce-4200-b9c2-6cf70b7057b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:40.109746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e27b8-60ce-4200-b9c2-6cf70b7057b5 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:40.111910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e27b8-60ce-4200-b9c2-6cf70b7057b5 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:40.114195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e27b8-60ce-4200-b9c2-6cf70b7057b5 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:40.116320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 140/266] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:39 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:40.129278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e27b8-60ce-4200-b9c2-6cf70b7057b5 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:40.160392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:40.186115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be8d84-f2ea-49ce-83f3-0538bf95b0c9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:40.241540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467891d4-e146-4948-a57b-5c6d09070116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:40.242358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467891d4-e146-4948-a57b-5c6d09070116 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:40.242644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467891d4-e146-4948-a57b-5c6d09070116 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:40.242925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467891d4-e146-4948-a57b-5c6d09070116 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:40.247527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e27b8-60ce-4200-b9c2-6cf70b7057b5 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:40.247718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467891d4-e146-4948-a57b-5c6d09070116 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:40.249235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467891d4-e146-4948-a57b-5c6d09070116 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:40.251587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 127/267] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:39 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:40.256995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467891d4-e146-4948-a57b-5c6d09070116 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:40.288196 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1902f-fc0d-4450-b8d0-f77db9c5cc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:40.289388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1902f-fc0d-4450-b8d0-f77db9c5cc9f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:40.290654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1902f-fc0d-4450-b8d0-f77db9c5cc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:40.291309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1902f-fc0d-4450-b8d0-f77db9c5cc9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:40.292801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1902f-fc0d-4450-b8d0-f77db9c5cc9f None admin] RBAC: Adding query filter params (role.id=c81f6283cf3a418bad94b56a1e9ea2b3, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16, user.id=8c87be7bdb4242fb8d468f26d9ee473a) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:40.294391 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1902f-fc0d-4450-b8d0-f77db9c5cc9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:40.297256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1902f-fc0d-4450-b8d0-f77db9c5cc9f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:40.311546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 141/268] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:40 2022] GET /identity/v3/role_assignments?user.id=8c87be7bdb4242fb8d468f26d9ee473a&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=c81f6283cf3a418bad94b56a1e9ea2b3 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:40.436475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467891d4-e146-4948-a57b-5c6d09070116 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:40.457859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:40.487829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6da90-d8e6-4c67-8954-4c4ef848c5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:40.488851 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6da90-d8e6-4c67-8954-4c4ef848c5fe None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:40.489358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6da90-d8e6-4c67-8954-4c4ef848c5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:40.489839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6da90-d8e6-4c67-8954-4c4ef848c5fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:40.490878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6da90-d8e6-4c67-8954-4c4ef848c5fe None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16, user.id=8c87be7bdb4242fb8d468f26d9ee473a) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:40.491436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6da90-d8e6-4c67-8954-4c4ef848c5fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:40.493080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6da90-d8e6-4c67-8954-4c4ef848c5fe None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:40.512276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 128/269] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:40 2022] GET /identity/v3/role_assignments?user.id=8c87be7bdb4242fb8d468f26d9ee473a&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:40.946190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f11c2-f92c-49aa-a76c-b4fa7b18c223 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:40.946712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f11c2-f92c-49aa-a76c-b4fa7b18c223 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:40.946712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f11c2-f92c-49aa-a76c-b4fa7b18c223 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:40.948142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 142/270] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:40.953493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005037-1f10-4367-8182-a837c1a57464 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:40.953915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005037-1f10-4367-8182-a837c1a57464 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:40.954109 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005037-1f10-4367-8182-a837c1a57464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:40.971819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-67005037-1f10-4367-8182-a837c1a57464 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:40.972989 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-67005037-1f10-4367-8182-a837c1a57464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:41.052200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 129/271] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:41.076241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f11c2-f92c-49aa-a76c-b4fa7b18c223 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:41.148211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc7509-099b-474f-ba98-720982f84eff None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.148532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc7509-099b-474f-ba98-720982f84eff None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.148782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc7509-099b-474f-ba98-720982f84eff None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.151532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 130/272] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:41.156032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c9006-4a78-4ee3-bf1a-211c369c05c1 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.156170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c9006-4a78-4ee3-bf1a-211c369c05c1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.156439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c9006-4a78-4ee3-bf1a-211c369c05c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.174602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-787c9006-4a78-4ee3-bf1a-211c369c05c1 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:41.175549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-787c9006-4a78-4ee3-bf1a-211c369c05c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:41.193827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:41.212543 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f11c2-f92c-49aa-a76c-b4fa7b18c223 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:41.247463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 131/273] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:41.249260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707575-df7a-47fc-b0d2-4eafa027e18e None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.249549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707575-df7a-47fc-b0d2-4eafa027e18e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.249827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707575-df7a-47fc-b0d2-4eafa027e18e None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.255042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 132/274] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:41.255584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fce871-0094-48cc-806d-8b5e33fe33c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:41.256425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fce871-0094-48cc-806d-8b5e33fe33c8 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.256700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fce871-0094-48cc-806d-8b5e33fe33c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.256976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fce871-0094-48cc-806d-8b5e33fe33c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.258578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20495-2de5-47f8-adff-d20b4ac9457a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.258859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20495-2de5-47f8-adff-d20b4ac9457a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.259161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20495-2de5-47f8-adff-d20b4ac9457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.274440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fce871-0094-48cc-806d-8b5e33fe33c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:41.279780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3eb20495-2de5-47f8-adff-d20b4ac9457a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:41.281081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3eb20495-2de5-47f8-adff-d20b4ac9457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-33fce871-0094-48cc-806d-8b5e33fe33c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:41.282570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:41.283471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:41.284266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:41.285571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 143/275] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:41.286629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fce871-0094-48cc-806d-8b5e33fe33c8 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:41.320423 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:41.355368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 133/276] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:41.363186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb20495-2de5-47f8-adff-d20b4ac9457a None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:41.402397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fce871-0094-48cc-806d-8b5e33fe33c8 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:41.435686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5870a-7c63-48e6-9585-40bb3f8bc928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:41.436612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5870a-7c63-48e6-9585-40bb3f8bc928 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.436895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5870a-7c63-48e6-9585-40bb3f8bc928 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.437173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5870a-7c63-48e6-9585-40bb3f8bc928 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.448249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5870a-7c63-48e6-9585-40bb3f8bc928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-fea5870a-7c63-48e6-9585-40bb3f8bc928 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:41.456055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:41.456920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:41.457757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:41.462383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 144/277] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:41.463603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5870a-7c63-48e6-9585-40bb3f8bc928 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:41.468719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:41.471204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb20495-2de5-47f8-adff-d20b4ac9457a None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:41.506179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd7c4d-9f0f-438a-9710-a0401e4a1bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:41.506854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7c4d-9f0f-438a-9710-a0401e4a1bcb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.507156 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7c4d-9f0f-438a-9710-a0401e4a1bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.507429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7c4d-9f0f-438a-9710-a0401e4a1bcb None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.508179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd7c4d-9f0f-438a-9710-a0401e4a1bcb None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:41.508479 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd7c4d-9f0f-438a-9710-a0401e4a1bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:41.509866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd7c4d-9f0f-438a-9710-a0401e4a1bcb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:41.520554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 134/278] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:41.522357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd7c4d-9f0f-438a-9710-a0401e4a1bcb None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:41.553240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:41.568231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5870a-7c63-48e6-9585-40bb3f8bc928 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:41.600811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616af6b-c21c-4275-a80f-573ca2caa5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:41.601617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616af6b-c21c-4275-a80f-573ca2caa5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.601905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616af6b-c21c-4275-a80f-573ca2caa5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.602186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616af6b-c21c-4275-a80f-573ca2caa5e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.603374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616af6b-c21c-4275-a80f-573ca2caa5e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:41.604868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616af6b-c21c-4275-a80f-573ca2caa5e0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:41.606806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 145/279] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:41.608094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0765f0-5e01-4f6b-acaf-4c682bccb525 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.608385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0765f0-5e01-4f6b-acaf-4c682bccb525 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.608658 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0765f0-5e01-4f6b-acaf-4c682bccb525 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.610032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 146/280] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:41.610577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0765f0-5e01-4f6b-acaf-4c682bccb525 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:41.624996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd7c4d-9f0f-438a-9710-a0401e4a1bcb None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:41.658107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7942f2-6620-4af9-b2c7-31106375d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:41.658781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7942f2-6620-4af9-b2c7-31106375d432 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.659098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7942f2-6620-4af9-b2c7-31106375d432 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.659379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7942f2-6620-4af9-b2c7-31106375d432 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.660134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7942f2-6620-4af9-b2c7-31106375d432 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:41.660465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7942f2-6620-4af9-b2c7-31106375d432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:41.661854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7942f2-6620-4af9-b2c7-31106375d432 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:41.670133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 135/281] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:41.671347 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837b6c8-13bc-4c35-b558-2de8ceb6a346 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.671629 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837b6c8-13bc-4c35-b558-2de8ceb6a346 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.671910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837b6c8-13bc-4c35-b558-2de8ceb6a346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.682003 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:41.689627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3837b6c8-13bc-4c35-b558-2de8ceb6a346 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:41.690879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3837b6c8-13bc-4c35-b558-2de8ceb6a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:41.714166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0765f0-5e01-4f6b-acaf-4c682bccb525 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:41.747289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175407af-4bb8-4260-b69b-2885e9307f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:41.748155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175407af-4bb8-4260-b69b-2885e9307f3a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.748440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175407af-4bb8-4260-b69b-2885e9307f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.748694 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175407af-4bb8-4260-b69b-2885e9307f3a None admin] PATH_INFO: `/v3/users/957c889e030746778fb50d1221cee726` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.761141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 136/282] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:41.761820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175407af-4bb8-4260-b69b-2885e9307f3a None admin] RBAC: Authorizing `identity:get_user(user_id=957c889e030746778fb50d1221cee726)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:41.762121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837b6c8-13bc-4c35-b558-2de8ceb6a346 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:41.763360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175407af-4bb8-4260-b69b-2885e9307f3a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:41.765139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 147/283] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:41 2022] GET /identity/v3/users/957c889e030746778fb50d1221cee726 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:41.766165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175407af-4bb8-4260-b69b-2885e9307f3a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:41.796327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:41.863105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175407af-4bb8-4260-b69b-2885e9307f3a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:41.868995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837b6c8-13bc-4c35-b558-2de8ceb6a346 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:41.891925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:41.898093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429b65f-f48f-4736-99c4-047ef62b81a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:41.898973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429b65f-f48f-4736-99c4-047ef62b81a0 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.899276 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429b65f-f48f-4736-99c4-047ef62b81a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.899552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429b65f-f48f-4736-99c4-047ef62b81a0 None admin] PATH_INFO: `/v3/users/ffdcecaa0de5459ea36d0afcbd7f155d` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.900729 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429b65f-f48f-4736-99c4-047ef62b81a0 None admin] RBAC: Authorizing `identity:get_user(user_id=ffdcecaa0de5459ea36d0afcbd7f155d)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:41.902209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429b65f-f48f-4736-99c4-047ef62b81a0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:41.902457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec3f50-786f-4ec6-8c0e-22d5bc971e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:41.903151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec3f50-786f-4ec6-8c0e-22d5bc971e62 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:41.903432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec3f50-786f-4ec6-8c0e-22d5bc971e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:41.903708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec3f50-786f-4ec6-8c0e-22d5bc971e62 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:41.903875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 148/284] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:41 2022] GET /identity/v3/users/ffdcecaa0de5459ea36d0afcbd7f155d => generated 297 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:41.908770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec3f50-786f-4ec6-8c0e-22d5bc971e62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:41.908876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429b65f-f48f-4736-99c4-047ef62b81a0 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:41.908973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec3f50-786f-4ec6-8c0e-22d5bc971e62 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:41.935895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 137/285] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:51:41 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:51:41.935895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec3f50-786f-4ec6-8c0e-22d5bc971e62 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:42.020513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:42.025179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429b65f-f48f-4736-99c4-047ef62b81a0 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:42.046733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec3f50-786f-4ec6-8c0e-22d5bc971e62 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:42.064995 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9e47-a143-4d33-ab5e-847542484b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:42.065766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9e47-a143-4d33-ab5e-847542484b38 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:42.066299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9e47-a143-4d33-ab5e-847542484b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:42.066589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9e47-a143-4d33-ab5e-847542484b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:42.067474 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb9e47-a143-4d33-ab5e-847542484b38 None admin] RBAC: Adding query filter params (role.id=729faf69df60450caeada9c53520224f, user.id=957c889e030746778fb50d1221cee726, scope.system=all) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:42.067789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb9e47-a143-4d33-ab5e-847542484b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:42.070068 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb9e47-a143-4d33-ab5e-847542484b38 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:42.076218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 149/286] 10.222.0.36 () {56 vars in 1308 bytes} [Sun Jun 26 02:51:41 2022] GET /identity/v3/role_assignments?user.id=957c889e030746778fb50d1221cee726&scope.system=all&role.id=729faf69df60450caeada9c53520224f => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:42.076939 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9e47-a143-4d33-ab5e-847542484b38 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:42.094667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ccd4-3393-4ebd-8323-5622cf5a478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:42.098162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ccd4-3393-4ebd-8323-5622cf5a478e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:42.098162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ccd4-3393-4ebd-8323-5622cf5a478e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:42.098162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ccd4-3393-4ebd-8323-5622cf5a478e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:42.114905 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2ccd4-3393-4ebd-8323-5622cf5a478e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-f0e2ccd4-3393-4ebd-8323-5622cf5a478e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:42.122895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:42.124307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:42.125236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 138/287] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:42.131881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ccd4-3393-4ebd-8323-5622cf5a478e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:42.165441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:42.216414 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9e47-a143-4d33-ab5e-847542484b38 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:42.264155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8769fb-1733-41c9-a8a1-7151050d5358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:42.265661 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8769fb-1733-41c9-a8a1-7151050d5358 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:42.265661 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8769fb-1733-41c9-a8a1-7151050d5358 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:42.265661 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8769fb-1733-41c9-a8a1-7151050d5358 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:42.266864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8769fb-1733-41c9-a8a1-7151050d5358 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:42.268383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8769fb-1733-41c9-a8a1-7151050d5358 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:42.270122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 150/288] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:42 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:42.276844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8769fb-1733-41c9-a8a1-7151050d5358 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:42.284996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ccd4-3393-4ebd-8323-5622cf5a478e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:42.324200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7cc9c-8268-4273-8c35-c5cc90a63553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:42.325232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7cc9c-8268-4273-8c35-c5cc90a63553 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:42.325729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7cc9c-8268-4273-8c35-c5cc90a63553 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:42.326230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7cc9c-8268-4273-8c35-c5cc90a63553 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:42.327258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7cc9c-8268-4273-8c35-c5cc90a63553 None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:42.327762 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7cc9c-8268-4273-8c35-c5cc90a63553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:42.329442 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7cc9c-8268-4273-8c35-c5cc90a63553 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:42.339966 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 139/289] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:42.345447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7cc9c-8268-4273-8c35-c5cc90a63553 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:42.348500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:42.400650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8769fb-1733-41c9-a8a1-7151050d5358 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:42.438239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:42.448690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd1e9b-4c76-4304-b0a3-cbf166cda9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:42.449910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd1e9b-4c76-4304-b0a3-cbf166cda9b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:42.450389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd1e9b-4c76-4304-b0a3-cbf166cda9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:42.450858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd1e9b-4c76-4304-b0a3-cbf166cda9b6 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/users/ffdcecaa0de5459ea36d0afcbd7f155d/roles/6e4d951189724f6d8905ef4c7b8c0015` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:42.453165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd1e9b-4c76-4304-b0a3-cbf166cda9b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb27a40f6d7647a9b0c4abb9026dde16, user_id=ffdcecaa0de5459ea36d0afcbd7f155d, role_id=6e4d951189724f6d8905ef4c7b8c0015)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:42.454846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd1e9b-4c76-4304-b0a3-cbf166cda9b6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:42.470239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7cc9c-8268-4273-8c35-c5cc90a63553 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:42.473862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 151/290] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:51:42 2022] PUT /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/users/ffdcecaa0de5459ea36d0afcbd7f155d/roles/6e4d951189724f6d8905ef4c7b8c0015 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 02:51:42.515358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb55c-0392-4940-83c7-900dd853082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:42.516526 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb55c-0392-4940-83c7-900dd853082f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:42.516957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb55c-0392-4940-83c7-900dd853082f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:42.517377 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb55c-0392-4940-83c7-900dd853082f None admin] PATH_INFO: `/v3/users/14199454c5874ee78e12168bf251ad20` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:42.518947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cb55c-0392-4940-83c7-900dd853082f None admin] RBAC: Authorizing `identity:get_user(user_id=14199454c5874ee78e12168bf251ad20)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:42.520907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cb55c-0392-4940-83c7-900dd853082f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:42.523412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 140/291] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:42 2022] GET /identity/v3/users/14199454c5874ee78e12168bf251ad20 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:42.532349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd1e9b-4c76-4304-b0a3-cbf166cda9b6 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:42.661718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd1e9b-4c76-4304-b0a3-cbf166cda9b6 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:42.698737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88f224-d04b-49ec-b944-bcb6f3d13257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:42.699696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88f224-d04b-49ec-b944-bcb6f3d13257 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:42.700122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88f224-d04b-49ec-b944-bcb6f3d13257 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:42.700557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88f224-d04b-49ec-b944-bcb6f3d13257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:42.761605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:42.777056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88f224-d04b-49ec-b944-bcb6f3d13257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:42.778960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88f224-d04b-49ec-b944-bcb6f3d13257 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:42.881680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 152/292] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:42.886818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb55c-0392-4940-83c7-900dd853082f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:43.007443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:43.033398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb55c-0392-4940-83c7-900dd853082f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:43.073697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b0fae-85c1-4981-b9b8-e262520fab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:43.074575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0fae-85c1-4981-b9b8-e262520fab93 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:43.074860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0fae-85c1-4981-b9b8-e262520fab93 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:43.075170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0fae-85c1-4981-b9b8-e262520fab93 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:43.076431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b0fae-85c1-4981-b9b8-e262520fab93 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:43.077942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b0fae-85c1-4981-b9b8-e262520fab93 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:43.079968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 141/293] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:42 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:43.085771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88f224-d04b-49ec-b944-bcb6f3d13257 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:43.177846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:43.188633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88f224-d04b-49ec-b944-bcb6f3d13257 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:43.237496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56f0a4-a0e6-4b96-9ded-3516c652a54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:43.238163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56f0a4-a0e6-4b96-9ded-3516c652a54b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:43.238446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56f0a4-a0e6-4b96-9ded-3516c652a54b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:43.238728 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56f0a4-a0e6-4b96-9ded-3516c652a54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:43.239600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56f0a4-a0e6-4b96-9ded-3516c652a54b None admin] RBAC: Adding query filter params (role.id=729faf69df60450caeada9c53520224f, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16, user.id=14199454c5874ee78e12168bf251ad20) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:43.239915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56f0a4-a0e6-4b96-9ded-3516c652a54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:43.241379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56f0a4-a0e6-4b96-9ded-3516c652a54b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:43.251079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 153/294] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:43 2022] GET /identity/v3/role_assignments?user.id=14199454c5874ee78e12168bf251ad20&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=729faf69df60450caeada9c53520224f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:44.403420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429559-7fb3-4519-a334-84dc3759b862 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:44.403953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429559-7fb3-4519-a334-84dc3759b862 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:44.403953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429559-7fb3-4519-a334-84dc3759b862 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:44.405718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 142/295] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:44.411279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee65c2-6020-4df0-94f4-0935cf10dc6c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:44.411669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee65c2-6020-4df0-94f4-0935cf10dc6c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:44.411831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee65c2-6020-4df0-94f4-0935cf10dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:44.429548 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-b8ee65c2-6020-4df0-94f4-0935cf10dc6c None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:44.430716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b8ee65c2-6020-4df0-94f4-0935cf10dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:44.503017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 154/296] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:44.522657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24429559-7fb3-4519-a334-84dc3759b862 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:44.535492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538312d-b23c-4e6c-9b26-9d54c6b70bd7 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:44.535816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538312d-b23c-4e6c-9b26-9d54c6b70bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:44.536065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538312d-b23c-4e6c-9b26-9d54c6b70bd7 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:44.537458 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 155/297] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:44.542830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956d997-3907-4edd-b77a-713799525725 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:44.543150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956d997-3907-4edd-b77a-713799525725 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:44.543456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956d997-3907-4edd-b77a-713799525725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:44.559824 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-b956d997-3907-4edd-b77a-713799525725 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:44.561028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b956d997-3907-4edd-b77a-713799525725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:44.629768 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 156/298] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:44.631241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0611-5f97-45e1-b7aa-817ef7f7b308 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:44.631525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0611-5f97-45e1-b7aa-817ef7f7b308 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:44.631808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0611-5f97-45e1-b7aa-817ef7f7b308 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:44.633231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 157/299] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:44.635845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24429559-7fb3-4519-a334-84dc3759b862 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:44.638649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c84b0-54ae-4b8f-8828-0d44ceb526be None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:44.638936 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c84b0-54ae-4b8f-8828-0d44ceb526be None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:44.639277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c84b0-54ae-4b8f-8828-0d44ceb526be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:44.655687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-558c84b0-54ae-4b8f-8828-0d44ceb526be None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:44.656796 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-558c84b0-54ae-4b8f-8828-0d44ceb526be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:44.667062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:44.674967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aa3bd-3069-4d29-aa35-c80947c02f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:44.675824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aa3bd-3069-4d29-aa35-c80947c02f82 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:44.676114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aa3bd-3069-4d29-aa35-c80947c02f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:44.676376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aa3bd-3069-4d29-aa35-c80947c02f82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:44.683653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:44.688205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aa3bd-3069-4d29-aa35-c80947c02f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-284aa3bd-3069-4d29-aa35-c80947c02f82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:44.696744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:44.697796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:44.698621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 143/300] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:44.699305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aa3bd-3069-4d29-aa35-c80947c02f82 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:44.732703 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 158/301] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:44.739889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c84b0-54ae-4b8f-8828-0d44ceb526be None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:44.807200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aa3bd-3069-4d29-aa35-c80947c02f82 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:44.841293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e45e9-e379-45f1-95d5-bc0256db7d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:44.841801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c84b0-54ae-4b8f-8828-0d44ceb526be None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:44.842085 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e45e9-e379-45f1-95d5-bc0256db7d6c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:44.842381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e45e9-e379-45f1-95d5-bc0256db7d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:44.842687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e45e9-e379-45f1-95d5-bc0256db7d6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:44.843867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e45e9-e379-45f1-95d5-bc0256db7d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:44.845317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e45e9-e379-45f1-95d5-bc0256db7d6c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:44.846947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 144/302] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:44.847724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e45e9-e379-45f1-95d5-bc0256db7d6c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:44.877947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b369456-c6bc-4fd2-bb53-c04942330bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:44.878617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b369456-c6bc-4fd2-bb53-c04942330bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:44.878901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b369456-c6bc-4fd2-bb53-c04942330bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:44.879207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b369456-c6bc-4fd2-bb53-c04942330bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:44.879957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b369456-c6bc-4fd2-bb53-c04942330bd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:44.880264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b369456-c6bc-4fd2-bb53-c04942330bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:44.881689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b369456-c6bc-4fd2-bb53-c04942330bd3 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:44.894262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 159/303] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:44.894262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec388-a114-4f9d-a007-332d91be4e4f None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:44.894262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec388-a114-4f9d-a007-332d91be4e4f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:44.894262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec388-a114-4f9d-a007-332d91be4e4f None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:44.894262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 160/304] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:44.894262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ec388-a114-4f9d-a007-332d91be4e4f None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:44.901792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:44.916134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:44.950663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e45e9-e379-45f1-95d5-bc0256db7d6c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:44.982660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e2ee-5b3b-4a06-ad8a-b16c7adf3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:44.983539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e2ee-5b3b-4a06-ad8a-b16c7adf3f0b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:44.983821 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e2ee-5b3b-4a06-ad8a-b16c7adf3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:44.984097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e2ee-5b3b-4a06-ad8a-b16c7adf3f0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:44.993616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ec388-a114-4f9d-a007-332d91be4e4f None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:44.994037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158e2ee-5b3b-4a06-ad8a-b16c7adf3f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-8158e2ee-5b3b-4a06-ad8a-b16c7adf3f0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:45.001598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:45.002491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:45.003437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 145/305] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:45.004241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e2ee-5b3b-4a06-ad8a-b16c7adf3f0b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:45.028180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca14187-219b-4985-a69f-60c1c6893763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:45.028852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca14187-219b-4985-a69f-60c1c6893763 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:45.029128 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca14187-219b-4985-a69f-60c1c6893763 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:45.029398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca14187-219b-4985-a69f-60c1c6893763 None admin] PATH_INFO: `/v3/groups` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:45.030102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca14187-219b-4985-a69f-60c1c6893763 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:45.031595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca14187-219b-4985-a69f-60c1c6893763 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:45.046105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 161/306] 10.222.0.36 () {60 vars in 1134 bytes} [Sun Jun 26 02:51:44 2022] POST /identity/v3/groups => generated 229 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:51:45.047133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b597779-4a30-47a4-be7e-557175969637 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:45.047417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b597779-4a30-47a4-be7e-557175969637 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:45.047695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b597779-4a30-47a4-be7e-557175969637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:45.072156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-3b597779-4a30-47a4-be7e-557175969637 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:45.073386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3b597779-4a30-47a4-be7e-557175969637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:45.112523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e2ee-5b3b-4a06-ad8a-b16c7adf3f0b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:45.139319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:45.143433 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:45.150875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 162/307] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:45.152252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b597779-4a30-47a4-be7e-557175969637 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:45.162174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7943b-af23-4a4e-b6c3-3b3538caffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:45.163370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7943b-af23-4a4e-b6c3-3b3538caffd3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:45.163800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7943b-af23-4a4e-b6c3-3b3538caffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:45.164332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7943b-af23-4a4e-b6c3-3b3538caffd3 None admin] PATH_INFO: `/v3/users/957c889e030746778fb50d1221cee726` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:45.165810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7943b-af23-4a4e-b6c3-3b3538caffd3 None admin] RBAC: Authorizing `identity:get_user(user_id=957c889e030746778fb50d1221cee726)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:45.167932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7943b-af23-4a4e-b6c3-3b3538caffd3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:45.169860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 146/308] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:45 2022] GET /identity/v3/users/957c889e030746778fb50d1221cee726 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:45.175018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7943b-af23-4a4e-b6c3-3b3538caffd3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:45.272435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b597779-4a30-47a4-be7e-557175969637 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:45.282372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7943b-af23-4a4e-b6c3-3b3538caffd3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:45.310310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010540a-c0fe-4194-9ab4-058f609de35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:45.311004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010540a-c0fe-4194-9ab4-058f609de35f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:45.311378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010540a-c0fe-4194-9ab4-058f609de35f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:45.311649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010540a-c0fe-4194-9ab4-058f609de35f None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:45.312410 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010540a-c0fe-4194-9ab4-058f609de35f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:45.312719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010540a-c0fe-4194-9ab4-058f609de35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:45.314114 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010540a-c0fe-4194-9ab4-058f609de35f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:45.319771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92d357-9d2c-4a60-ac98-5b7dccc89256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:45.321047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92d357-9d2c-4a60-ac98-5b7dccc89256 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:45.321493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92d357-9d2c-4a60-ac98-5b7dccc89256 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:45.321931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92d357-9d2c-4a60-ac98-5b7dccc89256 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:45.322477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 163/309] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:45.323269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010540a-c0fe-4194-9ab4-058f609de35f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:45.340104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92d357-9d2c-4a60-ac98-5b7dccc89256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-7c92d357-9d2c-4a60-ac98-5b7dccc89256 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:45.350140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:45.351033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:45.351826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:45.357672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 147/310] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:51:45.357672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92d357-9d2c-4a60-ac98-5b7dccc89256 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:45.394398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:45.411938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:45.440822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010540a-c0fe-4194-9ab4-058f609de35f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:45.466178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92d357-9d2c-4a60-ac98-5b7dccc89256 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:45.480105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf699f-082b-4b45-bc84-6f26c7a478f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:45.480984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf699f-082b-4b45-bc84-6f26c7a478f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:45.481261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf699f-082b-4b45-bc84-6f26c7a478f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:45.481539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf699f-082b-4b45-bc84-6f26c7a478f5 None admin] PATH_INFO: `/v3/system/users/957c889e030746778fb50d1221cee726/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:45.483224 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf699f-082b-4b45-bc84-6f26c7a478f5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=957c889e030746778fb50d1221cee726, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:45.484635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf699f-082b-4b45-bc84-6f26c7a478f5 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:45.507108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 164/311] 10.222.0.36 () {58 vars in 1334 bytes} [Sun Jun 26 02:51:45 2022] PUT /identity/v3/system/users/957c889e030746778fb50d1221cee726/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:45.509175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf699f-082b-4b45-bc84-6f26c7a478f5 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:45.513303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e6adb-690e-497f-a214-49e63c447ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:45.514754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e6adb-690e-497f-a214-49e63c447ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:45.515285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e6adb-690e-497f-a214-49e63c447ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:45.515791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e6adb-690e-497f-a214-49e63c447ae9 None admin] PATH_INFO: `/v3/users/e43b47b3545749fea191daa53b43f9ef` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:45.533686 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e6adb-690e-497f-a214-49e63c447ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=e43b47b3545749fea191daa53b43f9ef)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:45.535723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e6adb-690e-497f-a214-49e63c447ae9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:45.537986 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 148/312] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:45 2022] GET /identity/v3/users/e43b47b3545749fea191daa53b43f9ef => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:45.546637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e6adb-690e-497f-a214-49e63c447ae9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:45.639461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf699f-082b-4b45-bc84-6f26c7a478f5 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:45.666537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:45.683752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3621924-06cc-438e-9c46-168e3fcf9d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:45.683934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3621924-06cc-438e-9c46-168e3fcf9d14 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:45.684216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3621924-06cc-438e-9c46-168e3fcf9d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:45.684497 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3621924-06cc-438e-9c46-168e3fcf9d14 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:45.684597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e6adb-690e-497f-a214-49e63c447ae9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:45.685254 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3621924-06cc-438e-9c46-168e3fcf9d14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:45.685561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3621924-06cc-438e-9c46-168e3fcf9d14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:45.687629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3621924-06cc-438e-9c46-168e3fcf9d14 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:45.696655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 165/313] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:45.702110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3621924-06cc-438e-9c46-168e3fcf9d14 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:45.702243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:45.725207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d663a-cd5e-4fbb-b296-9353e36d43dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:45.726103 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d663a-cd5e-4fbb-b296-9353e36d43dc None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:45.726241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d663a-cd5e-4fbb-b296-9353e36d43dc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:45.726405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d663a-cd5e-4fbb-b296-9353e36d43dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:45.727276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d663a-cd5e-4fbb-b296-9353e36d43dc None admin] RBAC: Adding query filter params (role.id=6e4d951189724f6d8905ef4c7b8c0015, user.id=e43b47b3545749fea191daa53b43f9ef, scope.system=all) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:45.727628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d663a-cd5e-4fbb-b296-9353e36d43dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:45.729149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d663a-cd5e-4fbb-b296-9353e36d43dc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:45.739839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 149/314] 10.222.0.36 () {56 vars in 1308 bytes} [Sun Jun 26 02:51:45 2022] GET /identity/v3/role_assignments?user.id=e43b47b3545749fea191daa53b43f9ef&scope.system=all&role.id=6e4d951189724f6d8905ef4c7b8c0015 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:45.844211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3621924-06cc-438e-9c46-168e3fcf9d14 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:45.880637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eca590-5fd0-406a-84fc-e2f8af3e85fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:45.881843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eca590-5fd0-406a-84fc-e2f8af3e85fa None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:45.882272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eca590-5fd0-406a-84fc-e2f8af3e85fa None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:45.882711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eca590-5fd0-406a-84fc-e2f8af3e85fa None admin] PATH_INFO: `/v3/users/ffdcecaa0de5459ea36d0afcbd7f155d` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:45.884176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eca590-5fd0-406a-84fc-e2f8af3e85fa None admin] RBAC: Authorizing `identity:get_user(user_id=ffdcecaa0de5459ea36d0afcbd7f155d)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:45.885804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eca590-5fd0-406a-84fc-e2f8af3e85fa None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:45.888045 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 166/315] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:45 2022] GET /identity/v3/users/ffdcecaa0de5459ea36d0afcbd7f155d => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:45.896447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d663a-cd5e-4fbb-b296-9353e36d43dc None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:45.999607 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d663a-cd5e-4fbb-b296-9353e36d43dc None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:46.036349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9d902-ce36-4c45-94e8-9a80e0421a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:46.037248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9d902-ce36-4c45-94e8-9a80e0421a3b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:46.037667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9d902-ce36-4c45-94e8-9a80e0421a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:46.038078 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9d902-ce36-4c45-94e8-9a80e0421a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:46.085296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:46.109646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9d902-ce36-4c45-94e8-9a80e0421a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:46.111369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9d902-ce36-4c45-94e8-9a80e0421a3b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:46.231257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 150/316] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:46.232981 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eca590-5fd0-406a-84fc-e2f8af3e85fa None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:46.288596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:46.341019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eca590-5fd0-406a-84fc-e2f8af3e85fa None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:46.374723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e6b4f-95ad-482f-b812-c92b8f063f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:46.375848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e6b4f-95ad-482f-b812-c92b8f063f15 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:46.376268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e6b4f-95ad-482f-b812-c92b8f063f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:46.376686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e6b4f-95ad-482f-b812-c92b8f063f15 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:46.378035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e6b4f-95ad-482f-b812-c92b8f063f15 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:46.379670 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e6b4f-95ad-482f-b812-c92b8f063f15 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:46.381837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 167/317] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:46 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:46.387498 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9d902-ce36-4c45-94e8-9a80e0421a3b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:46.465063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:46.487948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9d902-ce36-4c45-94e8-9a80e0421a3b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:46.522291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8a19d-6f90-4e76-839a-e353ecf8fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:46.522957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8a19d-6f90-4e76-839a-e353ecf8fcaa None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:46.523275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8a19d-6f90-4e76-839a-e353ecf8fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:46.523685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8a19d-6f90-4e76-839a-e353ecf8fcaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:46.524521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8a19d-6f90-4e76-839a-e353ecf8fcaa None admin] RBAC: Adding query filter params (role.id=6e4d951189724f6d8905ef4c7b8c0015, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16, user.id=ffdcecaa0de5459ea36d0afcbd7f155d) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:46.524832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8a19d-6f90-4e76-839a-e353ecf8fcaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:46.526289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8a19d-6f90-4e76-839a-e353ecf8fcaa None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:46.539214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 151/318] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:51:46 2022] GET /identity/v3/role_assignments?user.id=ffdcecaa0de5459ea36d0afcbd7f155d&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=6e4d951189724f6d8905ef4c7b8c0015 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:47.131025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd6ad-cc7a-497d-b64f-b3f5cb484a87 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:47.131569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd6ad-cc7a-497d-b64f-b3f5cb484a87 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:47.131569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd6ad-cc7a-497d-b64f-b3f5cb484a87 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:47.132966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 168/319] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:47.138598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25c26-26c7-49c9-9eb4-0caf2d556a33 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:47.138872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25c26-26c7-49c9-9eb4-0caf2d556a33 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:47.139214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd25c26-26c7-49c9-9eb4-0caf2d556a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:47.156496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3dd25c26-26c7-49c9-9eb4-0caf2d556a33 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:47.157693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3dd25c26-26c7-49c9-9eb4-0caf2d556a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:47.231188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 152/320] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:47.253903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd6ad-cc7a-497d-b64f-b3f5cb484a87 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:47.362264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd6ad-cc7a-497d-b64f-b3f5cb484a87 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:47.383228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:47.399301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867f0fc-b60b-4139-9714-8eb872373302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:47.400109 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f0fc-b60b-4139-9714-8eb872373302 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:47.400393 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f0fc-b60b-4139-9714-8eb872373302 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:47.400667 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f0fc-b60b-4139-9714-8eb872373302 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:47.401846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867f0fc-b60b-4139-9714-8eb872373302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:47.403360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867f0fc-b60b-4139-9714-8eb872373302 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:47.405218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 169/321] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:51:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:47.410830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd25c26-26c7-49c9-9eb4-0caf2d556a33 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:47.485970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:47.522824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd25c26-26c7-49c9-9eb4-0caf2d556a33 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:47.558740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e0bed-c6a6-48de-a57a-07bca7113a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:47.559453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e0bed-c6a6-48de-a57a-07bca7113a62 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:47.559737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e0bed-c6a6-48de-a57a-07bca7113a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:47.560017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e0bed-c6a6-48de-a57a-07bca7113a62 None admin] PATH_INFO: `/v3/groups` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:47.560736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e0bed-c6a6-48de-a57a-07bca7113a62 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:47.562265 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e0bed-c6a6-48de-a57a-07bca7113a62 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:47.578911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 153/322] 10.222.0.36 () {60 vars in 1134 bytes} [Sun Jun 26 02:51:47 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:51:47.641865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872f6ed-b1f7-4b8e-b82d-3b6275b895d1 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:47.642086 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872f6ed-b1f7-4b8e-b82d-3b6275b895d1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:47.642333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872f6ed-b1f7-4b8e-b82d-3b6275b895d1 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:47.643981 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 170/323] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:47.649659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767d1f1-bf5d-4530-862e-2c8d2713dcd1 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:47.649967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767d1f1-bf5d-4530-862e-2c8d2713dcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:47.650225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767d1f1-bf5d-4530-862e-2c8d2713dcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:47.668616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2767d1f1-bf5d-4530-862e-2c8d2713dcd1 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:47.669826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2767d1f1-bf5d-4530-862e-2c8d2713dcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:47.744836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 154/324] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:47.768311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872f6ed-b1f7-4b8e-b82d-3b6275b895d1 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:47.800774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc917b-0fd6-4d90-b398-e87532362c9b None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:47.801065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc917b-0fd6-4d90-b398-e87532362c9b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:47.801401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc917b-0fd6-4d90-b398-e87532362c9b None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:47.803228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 155/325] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:51:47.808159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336432-8c3d-4d40-8e1f-87af11a9b5da None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:47.808447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336432-8c3d-4d40-8e1f-87af11a9b5da None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:47.808865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336432-8c3d-4d40-8e1f-87af11a9b5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:47.830229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-d0336432-8c3d-4d40-8e1f-87af11a9b5da None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:47.831990 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d0336432-8c3d-4d40-8e1f-87af11a9b5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:47.889997 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872f6ed-b1f7-4b8e-b82d-3b6275b895d1 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:47.915147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:47.920847 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 156/326] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:47.937267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed6172-26d0-4f30-b3cd-1fafa0b73a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:47.938081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed6172-26d0-4f30-b3cd-1fafa0b73a2c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:47.938373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed6172-26d0-4f30-b3cd-1fafa0b73a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:47.938640 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed6172-26d0-4f30-b3cd-1fafa0b73a2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:47.942419 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0336432-8c3d-4d40-8e1f-87af11a9b5da None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:47.952085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed6172-26d0-4f30-b3cd-1fafa0b73a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-dbed6172-26d0-4f30-b3cd-1fafa0b73a2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:47.959024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:47.960107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:47.961220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 171/327] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:47.965628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed6172-26d0-4f30-b3cd-1fafa0b73a2c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:48.019653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:48.081969 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0336432-8c3d-4d40-8e1f-87af11a9b5da None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:48.087969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed6172-26d0-4f30-b3cd-1fafa0b73a2c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:48.129268 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66bd65-cafe-4d76-b944-fc0895db439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:48.130665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66bd65-cafe-4d76-b944-fc0895db439b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:48.131243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66bd65-cafe-4d76-b944-fc0895db439b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:48.131821 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66bd65-cafe-4d76-b944-fc0895db439b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:48.133493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7d8e5-3fb1-43bf-99a4-0470c3e6ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:48.134166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7d8e5-3fb1-43bf-99a4-0470c3e6ac20 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:48.134448 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7d8e5-3fb1-43bf-99a4-0470c3e6ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:48.134723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7d8e5-3fb1-43bf-99a4-0470c3e6ac20 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:48.135699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7d8e5-3fb1-43bf-99a4-0470c3e6ac20 None admin] RBAC: Adding query filter params (name=member) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:48.136008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7d8e5-3fb1-43bf-99a4-0470c3e6ac20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:48.137746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7d8e5-3fb1-43bf-99a4-0470c3e6ac20 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:48.145631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66bd65-cafe-4d76-b944-fc0895db439b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:48.147740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 172/328] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:48.155999 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7d8e5-3fb1-43bf-99a4-0470c3e6ac20 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-cf66bd65-cafe-4d76-b944-fc0895db439b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:48.162539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:48.163574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:48.164549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 157/329] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:51:48.172915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66bd65-cafe-4d76-b944-fc0895db439b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:48.233023 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:48.278301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7d8e5-3fb1-43bf-99a4-0470c3e6ac20 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:48.286531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66bd65-cafe-4d76-b944-fc0895db439b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:48.290300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:48.318524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4e8c4-9fb0-4dc0-9d72-2238bad363b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:48.319699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4e8c4-9fb0-4dc0-9d72-2238bad363b5 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:48.320072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4e8c4-9fb0-4dc0-9d72-2238bad363b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:48.320441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4e8c4-9fb0-4dc0-9d72-2238bad363b5 None admin] PATH_INFO: `/v3/users/957c889e030746778fb50d1221cee726` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:48.322001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4e8c4-9fb0-4dc0-9d72-2238bad363b5 None admin] RBAC: Authorizing `identity:get_user(user_id=957c889e030746778fb50d1221cee726)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:48.323959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4e8c4-9fb0-4dc0-9d72-2238bad363b5 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:48.324609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac822e-b454-40cb-ae9c-20cd730d791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:48.325442 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac822e-b454-40cb-ae9c-20cd730d791f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:48.325859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac822e-b454-40cb-ae9c-20cd730d791f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:48.326326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 173/330] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:48 2022] GET /identity/v3/users/957c889e030746778fb50d1221cee726 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:48.326470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac822e-b454-40cb-ae9c-20cd730d791f None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:48.328139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac822e-b454-40cb-ae9c-20cd730d791f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:48.328139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac822e-b454-40cb-ae9c-20cd730d791f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:48.329053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac822e-b454-40cb-ae9c-20cd730d791f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:48.331846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4e8c4-9fb0-4dc0-9d72-2238bad363b5 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:48.338678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 158/331] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:48.344256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac822e-b454-40cb-ae9c-20cd730d791f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:48.439107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4e8c4-9fb0-4dc0-9d72-2238bad363b5 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:48.452027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac822e-b454-40cb-ae9c-20cd730d791f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:48.466353 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:48.477226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862948b-b912-413b-8aef-627933795420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:48.478310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862948b-b912-413b-8aef-627933795420 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:48.478800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862948b-b912-413b-8aef-627933795420 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:48.479321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862948b-b912-413b-8aef-627933795420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:48.481160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862948b-b912-413b-8aef-627933795420 None admin] RBAC: Adding query filter params (role.id=729faf69df60450caeada9c53520224f, user.id=957c889e030746778fb50d1221cee726, scope.system=all) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:48.481709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862948b-b912-413b-8aef-627933795420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:48.483896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862948b-b912-413b-8aef-627933795420 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:48.487980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943888a4-4efe-4b30-9518-fad108d846a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:48.488872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943888a4-4efe-4b30-9518-fad108d846a3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:48.489153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943888a4-4efe-4b30-9518-fad108d846a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:48.489429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943888a4-4efe-4b30-9518-fad108d846a3 None admin] PATH_INFO: `/v3/users/e43b47b3545749fea191daa53b43f9ef` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:48.490735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943888a4-4efe-4b30-9518-fad108d846a3 None admin] RBAC: Authorizing `identity:get_user(user_id=e43b47b3545749fea191daa53b43f9ef)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:48.492233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943888a4-4efe-4b30-9518-fad108d846a3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:48.493899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 159/332] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:48 2022] GET /identity/v3/users/e43b47b3545749fea191daa53b43f9ef => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:48.499585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943888a4-4efe-4b30-9518-fad108d846a3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:48.501739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 174/333] 10.222.0.36 () {56 vars in 1308 bytes} [Sun Jun 26 02:51:48 2022] GET /identity/v3/role_assignments?user.id=957c889e030746778fb50d1221cee726&scope.system=all&role.id=729faf69df60450caeada9c53520224f => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:48.609800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943888a4-4efe-4b30-9518-fad108d846a3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:48.646080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301bac-cccf-40a5-9a35-da6a07587543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:48.646971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301bac-cccf-40a5-9a35-da6a07587543 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:48.647278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301bac-cccf-40a5-9a35-da6a07587543 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:48.647556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301bac-cccf-40a5-9a35-da6a07587543 None admin] PATH_INFO: `/v3/system/users/e43b47b3545749fea191daa53b43f9ef/roles/6e4d951189724f6d8905ef4c7b8c0015` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:48.649069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6301bac-cccf-40a5-9a35-da6a07587543 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e43b47b3545749fea191daa53b43f9ef, role_id=6e4d951189724f6d8905ef4c7b8c0015)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:48.650469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6301bac-cccf-40a5-9a35-da6a07587543 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:48.668856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 160/334] 10.222.0.36 () {58 vars in 1334 bytes} [Sun Jun 26 02:51:48 2022] PUT /identity/v3/system/users/e43b47b3545749fea191daa53b43f9ef/roles/6e4d951189724f6d8905ef4c7b8c0015 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:49.882495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f8a5c-8e13-45d9-b7d6-6f6645ccdafc None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:49.883564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f8a5c-8e13-45d9-b7d6-6f6645ccdafc None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:49.884056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f8a5c-8e13-45d9-b7d6-6f6645ccdafc None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:49.885657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 175/335] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:49.892645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c8021-5cfc-4961-be17-7d335cd7c6a3 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:49.893478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c8021-5cfc-4961-be17-7d335cd7c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:49.893945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c8021-5cfc-4961-be17-7d335cd7c6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:49.915167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-496c8021-5cfc-4961-be17-7d335cd7c6a3 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:49.917022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-496c8021-5cfc-4961-be17-7d335cd7c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:49.970386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:50.004248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 161/336] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:50.040911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f8a5c-8e13-45d9-b7d6-6f6645ccdafc None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:50.087451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:50.160290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f8a5c-8e13-45d9-b7d6-6f6645ccdafc None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:50.198828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a973149-addc-41e0-9e36-3b014d44964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:50.200056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a973149-addc-41e0-9e36-3b014d44964b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:50.200525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a973149-addc-41e0-9e36-3b014d44964b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:50.200980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a973149-addc-41e0-9e36-3b014d44964b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:50.214712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a973149-addc-41e0-9e36-3b014d44964b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-1a973149-addc-41e0-9e36-3b014d44964b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:50.227206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:50.228241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:50.229029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:50.229632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd54c8-e0ea-4499-a8bf-8567e10fb7ec None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:50.229632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd54c8-e0ea-4499-a8bf-8567e10fb7ec None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:50.229632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd54c8-e0ea-4499-a8bf-8567e10fb7ec None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:50.230359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 162/337] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:50.232096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 176/338] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:50.240012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd54c8-e0ea-4499-a8bf-8567e10fb7ec None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:50.241076 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa9c62-27f8-40e7-9998-e208d05988c1 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:50.241618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa9c62-27f8-40e7-9998-e208d05988c1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:50.242086 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa9c62-27f8-40e7-9998-e208d05988c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:50.263823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-07fa9c62-27f8-40e7-9998-e208d05988c1 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:50.265759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-07fa9c62-27f8-40e7-9998-e208d05988c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:50.366767 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 177/339] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:50.396608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd54c8-e0ea-4499-a8bf-8567e10fb7ec None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:50.435741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cd797-b844-4095-845d-dc984df6aba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:50.436453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cd797-b844-4095-845d-dc984df6aba0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:50.436735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cd797-b844-4095-845d-dc984df6aba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:50.437002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cd797-b844-4095-845d-dc984df6aba0 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:50.437754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cd797-b844-4095-845d-dc984df6aba0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:50.438055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cd797-b844-4095-845d-dc984df6aba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:50.439481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cd797-b844-4095-845d-dc984df6aba0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:50.448148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 163/340] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:50.454094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa9c62-27f8-40e7-9998-e208d05988c1 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:50.456579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cd797-b844-4095-845d-dc984df6aba0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:50.500520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:50.512828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:50.618475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa9c62-27f8-40e7-9998-e208d05988c1 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:50.634462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cd797-b844-4095-845d-dc984df6aba0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:50.690095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b9898-b4af-4bdc-b336-1d5882ab4ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:50.690666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b9898-b4af-4bdc-b336-1d5882ab4ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:50.690944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b9898-b4af-4bdc-b336-1d5882ab4ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:50.691239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b9898-b4af-4bdc-b336-1d5882ab4ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:50.715318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a144793-f4d5-4f05-957b-469b9a7d2013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:50.716214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a144793-f4d5-4f05-957b-469b9a7d2013 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:50.716492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a144793-f4d5-4f05-957b-469b9a7d2013 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:50.716765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a144793-f4d5-4f05-957b-469b9a7d2013 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:50.739586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a144793-f4d5-4f05-957b-469b9a7d2013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5a144793-f4d5-4f05-957b-469b9a7d2013 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:50.750579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:50.751536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:50.752305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:50.759580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 164/341] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:51:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:51:50.780224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a144793-f4d5-4f05-957b-469b9a7d2013 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:50.840263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b9898-b4af-4bdc-b336-1d5882ab4ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:50.842098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b9898-b4af-4bdc-b336-1d5882ab4ec8 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:50.896622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:50.899580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a144793-f4d5-4f05-957b-469b9a7d2013 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:50.909725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:50.969162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ad7cf-c5fe-449c-8fcd-e940b0402525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:50.970375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ad7cf-c5fe-449c-8fcd-e940b0402525 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:50.971834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ad7cf-c5fe-449c-8fcd-e940b0402525 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:50.972463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ad7cf-c5fe-449c-8fcd-e940b0402525 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:50.974393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ad7cf-c5fe-449c-8fcd-e940b0402525 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:50.975116 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ad7cf-c5fe-449c-8fcd-e940b0402525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:50.977421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ad7cf-c5fe-449c-8fcd-e940b0402525 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:50.995040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 165/342] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:51:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:50.996669 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98a77d-746b-4317-85e6-0dd5ee3839f9 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:50.997237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98a77d-746b-4317-85e6-0dd5ee3839f9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:50.997712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98a77d-746b-4317-85e6-0dd5ee3839f9 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:50.999224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 166/343] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:51.001125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98a77d-746b-4317-85e6-0dd5ee3839f9 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:51.068027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 178/344] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:51.069461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350db8-5661-4cde-8a1a-0da93fe288a3 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:51.069840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350db8-5661-4cde-8a1a-0da93fe288a3 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:51.070209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350db8-5661-4cde-8a1a-0da93fe288a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:51.093577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4e350db8-5661-4cde-8a1a-0da93fe288a3 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:51.094897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4e350db8-5661-4cde-8a1a-0da93fe288a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:51.149620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98a77d-746b-4317-85e6-0dd5ee3839f9 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:51.187956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929626-d5e9-4b5a-8b9c-575d5685561b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:51.189000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929626-d5e9-4b5a-8b9c-575d5685561b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:51.189417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929626-d5e9-4b5a-8b9c-575d5685561b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:51.189830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929626-d5e9-4b5a-8b9c-575d5685561b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:51.222651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:51.269329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 179/345] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:51.270331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e350db8-5661-4cde-8a1a-0da93fe288a3 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:51.275550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53929626-d5e9-4b5a-8b9c-575d5685561b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:51.278762 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53929626-d5e9-4b5a-8b9c-575d5685561b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:51.384720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:51.444917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 167/346] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:51.446102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929626-d5e9-4b5a-8b9c-575d5685561b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:51.461137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e350db8-5661-4cde-8a1a-0da93fe288a3 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:51.518372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:51.540846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a74b-4af9-4957-9a42-37f3c4190009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:51.542336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a74b-4af9-4957-9a42-37f3c4190009 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:51.542924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a74b-4af9-4957-9a42-37f3c4190009 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:51.545054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a74b-4af9-4957-9a42-37f3c4190009 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:51.546594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5a74b-4af9-4957-9a42-37f3c4190009 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:51.548349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5a74b-4af9-4957-9a42-37f3c4190009 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:51.552208 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 180/347] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:51 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:51.553295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a74b-4af9-4957-9a42-37f3c4190009 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:51.592794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929626-d5e9-4b5a-8b9c-575d5685561b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:51.654034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73869273-45d5-495b-8bc1-8aac3fed73ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:51.655147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73869273-45d5-495b-8bc1-8aac3fed73ba None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:51.655748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73869273-45d5-495b-8bc1-8aac3fed73ba None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:51.656987 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73869273-45d5-495b-8bc1-8aac3fed73ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:51.677420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73869273-45d5-495b-8bc1-8aac3fed73ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-73869273-45d5-495b-8bc1-8aac3fed73ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:51.688309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:51.689427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:51.690506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:51.693589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 168/348] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:51.694677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73869273-45d5-495b-8bc1-8aac3fed73ba None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:51.762579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a74b-4af9-4957-9a42-37f3c4190009 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:51.812523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:51.832966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67cebf-c9f0-4b01-a500-37c3d96564e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:51.835775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67cebf-c9f0-4b01-a500-37c3d96564e6 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:51.836193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67cebf-c9f0-4b01-a500-37c3d96564e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:51.836683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67cebf-c9f0-4b01-a500-37c3d96564e6 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:51.839209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67cebf-c9f0-4b01-a500-37c3d96564e6 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:51.841949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67cebf-c9f0-4b01-a500-37c3d96564e6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:51.846531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 181/349] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:51 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:51.852478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67cebf-c9f0-4b01-a500-37c3d96564e6 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:51.889995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73869273-45d5-495b-8bc1-8aac3fed73ba None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:51.929959 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:51.956028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c3c38-de3a-4866-8ba0-3ff96f0205c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:51.957177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c3c38-de3a-4866-8ba0-3ff96f0205c1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:51.957596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c3c38-de3a-4866-8ba0-3ff96f0205c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:51.958005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c3c38-de3a-4866-8ba0-3ff96f0205c1 None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:51.966771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c3c38-de3a-4866-8ba0-3ff96f0205c1 None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:51.969245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c3c38-de3a-4866-8ba0-3ff96f0205c1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:51.973383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 169/350] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:51:51 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:51.974646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c3c38-de3a-4866-8ba0-3ff96f0205c1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:52.061138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67cebf-c9f0-4b01-a500-37c3d96564e6 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:52.103590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f890-0b38-4140-8899-08eea66ca6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:52.104274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f890-0b38-4140-8899-08eea66ca6cd None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.104559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f890-0b38-4140-8899-08eea66ca6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.105099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f890-0b38-4140-8899-08eea66ca6cd None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.105852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f890-0b38-4140-8899-08eea66ca6cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:52.106158 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f890-0b38-4140-8899-08eea66ca6cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:52.108329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f890-0b38-4140-8899-08eea66ca6cd None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:52.119141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 182/351] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:52.120354 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f890-0b38-4140-8899-08eea66ca6cd None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:52.129263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c3c38-de3a-4866-8ba0-3ff96f0205c1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:52.171476 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40724252-cb0a-4555-980b-b2164a1fa263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:52.172359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724252-cb0a-4555-980b-b2164a1fa263 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.172638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724252-cb0a-4555-980b-b2164a1fa263 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.172915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724252-cb0a-4555-980b-b2164a1fa263 None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.174086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40724252-cb0a-4555-980b-b2164a1fa263 None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:52.176241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40724252-cb0a-4555-980b-b2164a1fa263 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:52.177224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 170/352] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:51:51 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:52.178542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6c01-08bc-487a-a0bf-8b662e799f0c None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.178710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6c01-08bc-487a-a0bf-8b662e799f0c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.178945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a6c01-08bc-487a-a0bf-8b662e799f0c None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.180335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 171/353] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:52.181247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d453f-a64e-4027-9e58-f7769ca66dd8 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.181529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d453f-a64e-4027-9e58-f7769ca66dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.181800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d453f-a64e-4027-9e58-f7769ca66dd8 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.190884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 172/354] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:52.190884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d453f-a64e-4027-9e58-f7769ca66dd8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:52.204559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:52.259450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:52.264104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f890-0b38-4140-8899-08eea66ca6cd None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:52.313655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95806997-84e9-4666-94d2-b814721290b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:52.314201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95806997-84e9-4666-94d2-b814721290b4 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.314479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95806997-84e9-4666-94d2-b814721290b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.314752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95806997-84e9-4666-94d2-b814721290b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.318055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95806997-84e9-4666-94d2-b814721290b4 None admin] RBAC: Adding query filter params (group.id=e3ef4a5cc0604f7ab953c4a633d45b45, role.id=729faf69df60450caeada9c53520224f, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:52.318055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95806997-84e9-4666-94d2-b814721290b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:52.318055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95806997-84e9-4666-94d2-b814721290b4 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:52.326420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 183/355] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Jun 26 02:51:52 2022] GET /identity/v3/role_assignments?group.id=e3ef4a5cc0604f7ab953c4a633d45b45&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=729faf69df60450caeada9c53520224f => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:52.327925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95806997-84e9-4666-94d2-b814721290b4 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:52.336995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d453f-a64e-4027-9e58-f7769ca66dd8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:52.382860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af831c-fcd5-4a98-b0c5-354af9a995d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:52.383591 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af831c-fcd5-4a98-b0c5-354af9a995d8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.383875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af831c-fcd5-4a98-b0c5-354af9a995d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.384154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af831c-fcd5-4a98-b0c5-354af9a995d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.484834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95806997-84e9-4666-94d2-b814721290b4 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:52.486822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af831c-fcd5-4a98-b0c5-354af9a995d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:52.490588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af831c-fcd5-4a98-b0c5-354af9a995d8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:52.511701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:52.541507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75d38b-af92-4e7b-9dd9-4b7b51e550c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:52.542887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75d38b-af92-4e7b-9dd9-4b7b51e550c7 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.543192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75d38b-af92-4e7b-9dd9-4b7b51e550c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.543468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75d38b-af92-4e7b-9dd9-4b7b51e550c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.544624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75d38b-af92-4e7b-9dd9-4b7b51e550c7 None admin] RBAC: Adding query filter params (group.id=e3ef4a5cc0604f7ab953c4a633d45b45, role.id=c81f6283cf3a418bad94b56a1e9ea2b3, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:52.544905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75d38b-af92-4e7b-9dd9-4b7b51e550c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:52.546420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75d38b-af92-4e7b-9dd9-4b7b51e550c7 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:52.552357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:52.553829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 184/356] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Jun 26 02:51:52 2022] GET /identity/v3/role_assignments?group.id=e3ef4a5cc0604f7ab953c4a633d45b45&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=c81f6283cf3a418bad94b56a1e9ea2b3 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:52.556837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791272-94fb-4572-b808-1894b95ba24a None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.556837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791272-94fb-4572-b808-1894b95ba24a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.556837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791272-94fb-4572-b808-1894b95ba24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.579025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-98791272-94fb-4572-b808-1894b95ba24a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:52.581238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-98791272-94fb-4572-b808-1894b95ba24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:52.616486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 173/357] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:52.617811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7f64-335c-44fb-9a5c-000c2e8bba9f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.618100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7f64-335c-44fb-9a5c-000c2e8bba9f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.618376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7f64-335c-44fb-9a5c-000c2e8bba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.641491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-bdcc7f64-335c-44fb-9a5c-000c2e8bba9f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:52.642700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-bdcc7f64-335c-44fb-9a5c-000c2e8bba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:52.676146 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 185/358] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:52.677873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d71cc1-6b7e-4382-88a6-1522ecdac82c None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.678359 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d71cc1-6b7e-4382-88a6-1522ecdac82c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.678829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d71cc1-6b7e-4382-88a6-1522ecdac82c None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.680403 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 186/359] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:52.681300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d71cc1-6b7e-4382-88a6-1522ecdac82c None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:52.730350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 174/360] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:52.732697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97454f45-64cf-45b0-87c0-524b466cd200 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.733299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97454f45-64cf-45b0-87c0-524b466cd200 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.733299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97454f45-64cf-45b0-87c0-524b466cd200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.753185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-97454f45-64cf-45b0-87c0-524b466cd200 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:52.754444 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-97454f45-64cf-45b0-87c0-524b466cd200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:52.830755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d71cc1-6b7e-4382-88a6-1522ecdac82c None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:52.847106 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 175/361] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:52.847932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97454f45-64cf-45b0-87c0-524b466cd200 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:52.853150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:52.866507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:52.903751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884566a-2c33-446f-8965-447376f2f04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:52.904647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884566a-2c33-446f-8965-447376f2f04a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:52.905031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884566a-2c33-446f-8965-447376f2f04a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:52.905285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884566a-2c33-446f-8965-447376f2f04a None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:52.906538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884566a-2c33-446f-8965-447376f2f04a None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:52.908040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884566a-2c33-446f-8965-447376f2f04a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:52.909840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 187/362] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:52 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:52.911410 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884566a-2c33-446f-8965-447376f2f04a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:52.984146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97454f45-64cf-45b0-87c0-524b466cd200 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:53.027498 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ede519-d904-410f-be31-785bb7da293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:53.028691 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ede519-d904-410f-be31-785bb7da293a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:53.029162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ede519-d904-410f-be31-785bb7da293a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:53.029627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ede519-d904-410f-be31-785bb7da293a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:53.040563 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ede519-d904-410f-be31-785bb7da293a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:53.049551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884566a-2c33-446f-8965-447376f2f04a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-11ede519-d904-410f-be31-785bb7da293a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:53.050749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:53.051626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 26 02:51:53.052431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:53.055104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 176/363] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:53.056120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ede519-d904-410f-be31-785bb7da293a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:53.098279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b280ed-f7b3-4d8f-83ba-a03934c5c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:53.099049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b280ed-f7b3-4d8f-83ba-a03934c5c675 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:53.099338 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b280ed-f7b3-4d8f-83ba-a03934c5c675 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:53.099613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b280ed-f7b3-4d8f-83ba-a03934c5c675 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:53.115181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b280ed-f7b3-4d8f-83ba-a03934c5c675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-c2b280ed-f7b3-4d8f-83ba-a03934c5c675 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:53.122891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:53.123858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:53.124647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:53.127065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 188/364] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:51:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:53.128077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b280ed-f7b3-4d8f-83ba-a03934c5c675 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:53.154727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:53.180135 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:53.200787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ede519-d904-410f-be31-785bb7da293a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:53.238714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5787b-f38f-4722-a819-32c3f54ac9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:53.239546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5787b-f38f-4722-a819-32c3f54ac9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:53.239840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5787b-f38f-4722-a819-32c3f54ac9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:53.240256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5787b-f38f-4722-a819-32c3f54ac9a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:53.247630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b280ed-f7b3-4d8f-83ba-a03934c5c675 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:53.251273 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5787b-f38f-4722-a819-32c3f54ac9a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-20b5787b-f38f-4722-a819-32c3f54ac9a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:53.259198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:53.260072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:53.260846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:53.261441 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 177/365] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:51:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:53.262521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5787b-f38f-4722-a819-32c3f54ac9a1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:53.298387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45592d0a-b5ca-4ca8-8a1c-8acc7d15f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:53.299885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592d0a-b5ca-4ca8-8a1c-8acc7d15f233 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:53.300365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592d0a-b5ca-4ca8-8a1c-8acc7d15f233 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:53.300894 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592d0a-b5ca-4ca8-8a1c-8acc7d15f233 None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:53.302336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45592d0a-b5ca-4ca8-8a1c-8acc7d15f233 None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:53.304277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45592d0a-b5ca-4ca8-8a1c-8acc7d15f233 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:53.306250 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 189/366] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:51:53 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:53.307231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45592d0a-b5ca-4ca8-8a1c-8acc7d15f233 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:53.372287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5787b-f38f-4722-a819-32c3f54ac9a1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:53.402240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:53.408643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39575407-999f-4179-8286-1c3bba6788e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:53.409331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39575407-999f-4179-8286-1c3bba6788e1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:53.409613 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39575407-999f-4179-8286-1c3bba6788e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:53.409971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39575407-999f-4179-8286-1c3bba6788e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:53.410649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39575407-999f-4179-8286-1c3bba6788e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:53.410956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39575407-999f-4179-8286-1c3bba6788e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:53.412748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39575407-999f-4179-8286-1c3bba6788e1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:53.419157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45592d0a-b5ca-4ca8-8a1c-8acc7d15f233 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:53.422942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 178/367] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:53.423799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39575407-999f-4179-8286-1c3bba6788e1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:53.432198 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:53.459167 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8aae7c-bff4-4c5a-8b77-0579c2e3c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:53.460239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8aae7c-bff4-4c5a-8b77-0579c2e3c707 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:53.460711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8aae7c-bff4-4c5a-8b77-0579c2e3c707 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:53.461199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8aae7c-bff4-4c5a-8b77-0579c2e3c707 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:53.462237 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8aae7c-bff4-4c5a-8b77-0579c2e3c707 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:53.462775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8aae7c-bff4-4c5a-8b77-0579c2e3c707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:53.464460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8aae7c-bff4-4c5a-8b77-0579c2e3c707 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:53.473967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 190/368] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:51:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:53.475267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8aae7c-bff4-4c5a-8b77-0579c2e3c707 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:53.546291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39575407-999f-4179-8286-1c3bba6788e1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:53.584075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a62a4-2fcd-4b7e-9b2a-c2ffecd22c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:53.584419 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a62a4-2fcd-4b7e-9b2a-c2ffecd22c62 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:53.584628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a62a4-2fcd-4b7e-9b2a-c2ffecd22c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:53.584907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a62a4-2fcd-4b7e-9b2a-c2ffecd22c62 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:53.585800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a62a4-2fcd-4b7e-9b2a-c2ffecd22c62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:53.586114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a62a4-2fcd-4b7e-9b2a-c2ffecd22c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:53.587762 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a62a4-2fcd-4b7e-9b2a-c2ffecd22c62 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:53.594287 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8aae7c-bff4-4c5a-8b77-0579c2e3c707 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:53.600493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 179/369] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:53.601842 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a62a4-2fcd-4b7e-9b2a-c2ffecd22c62 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:53.638924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999832c-2c94-4899-b376-d9a5853e89b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:53.639977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999832c-2c94-4899-b376-d9a5853e89b3 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:53.640464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999832c-2c94-4899-b376-d9a5853e89b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:53.640919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999832c-2c94-4899-b376-d9a5853e89b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:53.642055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999832c-2c94-4899-b376-d9a5853e89b3 None admin] RBAC: Adding query filter params (group.id=e3ef4a5cc0604f7ab953c4a633d45b45, role.id=729faf69df60450caeada9c53520224f, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:53.642603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999832c-2c94-4899-b376-d9a5853e89b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:53.644269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999832c-2c94-4899-b376-d9a5853e89b3 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:53.650773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 191/370] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Jun 26 02:51:53 2022] GET /identity/v3/role_assignments?group.id=e3ef4a5cc0604f7ab953c4a633d45b45&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=729faf69df60450caeada9c53520224f => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:53.651850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999832c-2c94-4899-b376-d9a5853e89b3 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:53.665996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:53.694146 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:53.722269 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a62a4-2fcd-4b7e-9b2a-c2ffecd22c62 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:53.760497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e70d31-564e-4a3f-95c1-a215e97aa261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:53.761154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e70d31-564e-4a3f-95c1-a215e97aa261 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:53.761439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e70d31-564e-4a3f-95c1-a215e97aa261 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:53.761714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e70d31-564e-4a3f-95c1-a215e97aa261 None admin] PATH_INFO: `/v3/users/e43b47b3545749fea191daa53b43f9ef` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:53.763153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e70d31-564e-4a3f-95c1-a215e97aa261 None admin] RBAC: Authorizing `identity:get_user(user_id=e43b47b3545749fea191daa53b43f9ef)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:53.764943 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e70d31-564e-4a3f-95c1-a215e97aa261 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:53.767004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 180/371] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:51:53 2022] GET /identity/v3/users/e43b47b3545749fea191daa53b43f9ef => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:53.772490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999832c-2c94-4899-b376-d9a5853e89b3 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:53.772939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e70d31-564e-4a3f-95c1-a215e97aa261 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:53.812509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3d7d1-8077-4100-bca4-cf10290e9c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:53.813586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3d7d1-8077-4100-bca4-cf10290e9c0f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:53.814058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3d7d1-8077-4100-bca4-cf10290e9c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:53.814521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3d7d1-8077-4100-bca4-cf10290e9c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:53.886590 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e70d31-564e-4a3f-95c1-a215e97aa261 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:53.905535 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3d7d1-8077-4100-bca4-cf10290e9c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:53.908363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3d7d1-8077-4100-bca4-cf10290e9c0f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:53.914624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:53.929318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781cdd4-bcca-4666-9a23-315ff581872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:53.930064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781cdd4-bcca-4666-9a23-315ff581872f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:53.930349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781cdd4-bcca-4666-9a23-315ff581872f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:53.930627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781cdd4-bcca-4666-9a23-315ff581872f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:53.959605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:54.023163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781cdd4-bcca-4666-9a23-315ff581872f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:54.024657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781cdd4-bcca-4666-9a23-315ff581872f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:54.062889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 192/372] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:54.063904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3d7d1-8077-4100-bca4-cf10290e9c0f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:54.129831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 181/373] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:54.130709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781cdd4-bcca-4666-9a23-315ff581872f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:54.155077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:54.225628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3d7d1-8077-4100-bca4-cf10290e9c0f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:54.237397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781cdd4-bcca-4666-9a23-315ff581872f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:54.274525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1706f-4a44-4ae6-873b-4a7d38357a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:54.275456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1706f-4a44-4ae6-873b-4a7d38357a89 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:54.275740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1706f-4a44-4ae6-873b-4a7d38357a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:54.276075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1706f-4a44-4ae6-873b-4a7d38357a89 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:54.277329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1706f-4a44-4ae6-873b-4a7d38357a89 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:54.278810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1706f-4a44-4ae6-873b-4a7d38357a89 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:54.281002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 182/374] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:54 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:54.281853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1706f-4a44-4ae6-873b-4a7d38357a89 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:54.304363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e191b00-17d1-49e3-835f-485b5942335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:54.305041 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191b00-17d1-49e3-835f-485b5942335c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:54.305310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191b00-17d1-49e3-835f-485b5942335c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:54.305583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191b00-17d1-49e3-835f-485b5942335c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:54.306428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e191b00-17d1-49e3-835f-485b5942335c None admin] RBAC: Adding query filter params (role.id=6e4d951189724f6d8905ef4c7b8c0015, user.id=e43b47b3545749fea191daa53b43f9ef, scope.system=all) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:54.306738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e191b00-17d1-49e3-835f-485b5942335c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:54.308231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e191b00-17d1-49e3-835f-485b5942335c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:54.311342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:54.329307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 193/375] 10.222.0.36 () {56 vars in 1308 bytes} [Sun Jun 26 02:51:54 2022] GET /identity/v3/role_assignments?user.id=e43b47b3545749fea191daa53b43f9ef&scope.system=all&role.id=6e4d951189724f6d8905ef4c7b8c0015 => generated 510 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:54.330240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e191b00-17d1-49e3-835f-485b5942335c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:54.382833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:54.399340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1706f-4a44-4ae6-873b-4a7d38357a89 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:54.436500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a6a5a-d62c-4787-bebd-597c9bfb7c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:54.437384 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6a5a-d62c-4787-bebd-597c9bfb7c43 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:54.437665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6a5a-d62c-4787-bebd-597c9bfb7c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:54.437937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a6a5a-d62c-4787-bebd-597c9bfb7c43 None admin] PATH_INFO: `/v3/projects/898f4bc074784aa394c0f3456d694f9e` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:54.440249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a6a5a-d62c-4787-bebd-597c9bfb7c43 None admin] RBAC: Authorizing `identity:get_project(project_id=898f4bc074784aa394c0f3456d694f9e)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:54.441697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a6a5a-d62c-4787-bebd-597c9bfb7c43 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:54.443453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 183/376] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:54 2022] GET /identity/v3/projects/898f4bc074784aa394c0f3456d694f9e => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:54.449261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a6a5a-d62c-4787-bebd-597c9bfb7c43 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:54.491087 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e191b00-17d1-49e3-835f-485b5942335c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:54.551023 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26b460-cc3c-41af-b6a8-72387995f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:54.551914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26b460-cc3c-41af-b6a8-72387995f460 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:54.552193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26b460-cc3c-41af-b6a8-72387995f460 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:54.552467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26b460-cc3c-41af-b6a8-72387995f460 None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:54.553774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26b460-cc3c-41af-b6a8-72387995f460 None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:54.555642 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26b460-cc3c-41af-b6a8-72387995f460 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:54.557039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 194/377] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:51:54 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:54.563393 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26b460-cc3c-41af-b6a8-72387995f460 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:54.661056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a6a5a-d62c-4787-bebd-597c9bfb7c43 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:54.667531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:54.712066 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26b460-cc3c-41af-b6a8-72387995f460 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:54.746587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be56e6-0b4c-4b0e-9272-8fc0cf47cabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:54.747559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be56e6-0b4c-4b0e-9272-8fc0cf47cabe None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:54.747815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be56e6-0b4c-4b0e-9272-8fc0cf47cabe None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:54.748084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be56e6-0b4c-4b0e-9272-8fc0cf47cabe None admin] PATH_INFO: `/v3/groups/9ec58393e2624d158ba95bdd8fd1a5b0` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:54.751933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdae9f-c96d-4b0d-85e8-ce2c766c79f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:54.752719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdae9f-c96d-4b0d-85e8-ce2c766c79f1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:54.753126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdae9f-c96d-4b0d-85e8-ce2c766c79f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:54.753400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdae9f-c96d-4b0d-85e8-ce2c766c79f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:54.753872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be56e6-0b4c-4b0e-9272-8fc0cf47cabe None admin] RBAC: Authorizing `identity:get_group(group_id=9ec58393e2624d158ba95bdd8fd1a5b0)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:54.754229 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdae9f-c96d-4b0d-85e8-ce2c766c79f1 None admin] RBAC: Adding query filter params (group.id=e3ef4a5cc0604f7ab953c4a633d45b45, role.id=c81f6283cf3a418bad94b56a1e9ea2b3, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:54.754532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdae9f-c96d-4b0d-85e8-ce2c766c79f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:54.755371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be56e6-0b4c-4b0e-9272-8fc0cf47cabe None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:54.755997 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdae9f-c96d-4b0d-85e8-ce2c766c79f1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:54.757335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 184/378] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:51:54 2022] GET /identity/v3/groups/9ec58393e2624d158ba95bdd8fd1a5b0 => generated 229 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:54.758691 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cf808-d24f-42f1-a256-61edd0238597 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:54.759167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cf808-d24f-42f1-a256-61edd0238597 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:54.759447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cf808-d24f-42f1-a256-61edd0238597 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:54.760920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 185/379] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:54.762101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 195/380] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Jun 26 02:51:54 2022] GET /identity/v3/role_assignments?group.id=e3ef4a5cc0604f7ab953c4a633d45b45&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=c81f6283cf3a418bad94b56a1e9ea2b3 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:54.766310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdae9f-c96d-4b0d-85e8-ce2c766c79f1 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:54.766820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050c0e4-1d9c-4160-b2cc-60d2d7badea8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:54.767151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050c0e4-1d9c-4160-b2cc-60d2d7badea8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:54.767435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050c0e4-1d9c-4160-b2cc-60d2d7badea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:54.792100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e050c0e4-1d9c-4160-b2cc-60d2d7badea8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:54.796358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e050c0e4-1d9c-4160-b2cc-60d2d7badea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:54.831601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:54.935390 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 186/381] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:54.955754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdae9f-c96d-4b0d-85e8-ce2c766c79f1 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:54.982166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:55.001440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89da52-a214-44b0-b7cc-5a19a0b11469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:55.002044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89da52-a214-44b0-b7cc-5a19a0b11469 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:55.002324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89da52-a214-44b0-b7cc-5a19a0b11469 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:55.002598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89da52-a214-44b0-b7cc-5a19a0b11469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:55.003471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89da52-a214-44b0-b7cc-5a19a0b11469 None admin] RBAC: Adding query filter params (group.id=9ec58393e2624d158ba95bdd8fd1a5b0, role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=898f4bc074784aa394c0f3456d694f9e) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:55.003778 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89da52-a214-44b0-b7cc-5a19a0b11469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:55.005298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89da52-a214-44b0-b7cc-5a19a0b11469 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:55.014751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 196/382] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Jun 26 02:51:54 2022] GET /identity/v3/role_assignments?group.id=9ec58393e2624d158ba95bdd8fd1a5b0&scope.project.id=898f4bc074784aa394c0f3456d694f9e&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:55.021121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050c0e4-1d9c-4160-b2cc-60d2d7badea8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:55.143848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050c0e4-1d9c-4160-b2cc-60d2d7badea8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:55.196450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d09a5-6a02-4ece-95a9-685de6239098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:55.197278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d09a5-6a02-4ece-95a9-685de6239098 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:55.197555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d09a5-6a02-4ece-95a9-685de6239098 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:55.197828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d09a5-6a02-4ece-95a9-685de6239098 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:55.213896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d09a5-6a02-4ece-95a9-685de6239098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-a73d09a5-6a02-4ece-95a9-685de6239098 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:55.222193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:55.224032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:55.225937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 187/383] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:55.231149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89da52-a214-44b0-b7cc-5a19a0b11469 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:55.351081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89da52-a214-44b0-b7cc-5a19a0b11469 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:55.388928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae786743-f733-432c-bd04-96044d3e3c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:55.389938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae786743-f733-432c-bd04-96044d3e3c71 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:55.390371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae786743-f733-432c-bd04-96044d3e3c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:55.390780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae786743-f733-432c-bd04-96044d3e3c71 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:55.391735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae786743-f733-432c-bd04-96044d3e3c71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:55.392192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae786743-f733-432c-bd04-96044d3e3c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:55.393715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae786743-f733-432c-bd04-96044d3e3c71 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:55.405080 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 197/384] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:55.410930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d09a5-6a02-4ece-95a9-685de6239098 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:55.433732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:55.502390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9d0a8-1aa1-4863-bfb2-5ef1cf4b3cf3 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:55.502922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9d0a8-1aa1-4863-bfb2-5ef1cf4b3cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:55.503472 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9d0a8-1aa1-4863-bfb2-5ef1cf4b3cf3 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:55.505067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 198/385] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:55.511964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5b086-1a88-42ed-84b2-b22836895032 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:55.511964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5b086-1a88-42ed-84b2-b22836895032 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:55.511964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5b086-1a88-42ed-84b2-b22836895032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:55.543153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-c9d5b086-1a88-42ed-84b2-b22836895032 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:55.544362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c9d5b086-1a88-42ed-84b2-b22836895032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:55.594913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d09a5-6a02-4ece-95a9-685de6239098 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:55.596501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:55.624271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 199/386] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:55.652090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5b086-1a88-42ed-84b2-b22836895032 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:55.662469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc64d1e-03d0-4b4d-ad26-6cf55e1f3e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:55.663439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc64d1e-03d0-4b4d-ad26-6cf55e1f3e76 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:55.663724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc64d1e-03d0-4b4d-ad26-6cf55e1f3e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:55.664004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc64d1e-03d0-4b4d-ad26-6cf55e1f3e76 None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:55.667782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc64d1e-03d0-4b4d-ad26-6cf55e1f3e76 None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:55.669267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc64d1e-03d0-4b4d-ad26-6cf55e1f3e76 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:55.676428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 188/387] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:51:55 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:55.677362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc64d1e-03d0-4b4d-ad26-6cf55e1f3e76 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:55.767434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5b086-1a88-42ed-84b2-b22836895032 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:55.802110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09797070-4d1a-4370-a482-7ee1f0726f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:55.802939 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09797070-4d1a-4370-a482-7ee1f0726f60 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:55.803250 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09797070-4d1a-4370-a482-7ee1f0726f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:55.803523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09797070-4d1a-4370-a482-7ee1f0726f60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:55.819036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09797070-4d1a-4370-a482-7ee1f0726f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-09797070-4d1a-4370-a482-7ee1f0726f60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:55.822633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:55.823506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:55.824290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 200/388] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:51:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:51:55.829853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:55.831466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09797070-4d1a-4370-a482-7ee1f0726f60 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:55.859229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc64d1e-03d0-4b4d-ad26-6cf55e1f3e76 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:55.876924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:55.918066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa77db9-d4bc-46d3-96c7-92e0e30ca952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:55.919446 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa77db9-d4bc-46d3-96c7-92e0e30ca952 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:55.919918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa77db9-d4bc-46d3-96c7-92e0e30ca952 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:55.920431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa77db9-d4bc-46d3-96c7-92e0e30ca952 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:55.921937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa77db9-d4bc-46d3-96c7-92e0e30ca952 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:55.923697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa77db9-d4bc-46d3-96c7-92e0e30ca952 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:55.925717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 189/389] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:55 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:55.931650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa77db9-d4bc-46d3-96c7-92e0e30ca952 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:55.938179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09797070-4d1a-4370-a482-7ee1f0726f60 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:55.980171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb528318-cb3b-485c-addf-ddf234f6a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:55.980948 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb528318-cb3b-485c-addf-ddf234f6a8dc None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:55.981231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb528318-cb3b-485c-addf-ddf234f6a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:55.981505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb528318-cb3b-485c-addf-ddf234f6a8dc None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:55.982260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb528318-cb3b-485c-addf-ddf234f6a8dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:55.982569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb528318-cb3b-485c-addf-ddf234f6a8dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:55.984291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb528318-cb3b-485c-addf-ddf234f6a8dc None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:55.993181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 201/390] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:51:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:55.998743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb528318-cb3b-485c-addf-ddf234f6a8dc None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:56.111417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa77db9-d4bc-46d3-96c7-92e0e30ca952 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:56.169645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb528318-cb3b-485c-addf-ddf234f6a8dc None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:56.171261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:56.182783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ec245-514b-411b-8f06-6a64a5f963df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:56.183722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ec245-514b-411b-8f06-6a64a5f963df None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:56.184003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ec245-514b-411b-8f06-6a64a5f963df None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:56.184263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ec245-514b-411b-8f06-6a64a5f963df None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/groups/e3ef4a5cc0604f7ab953c4a633d45b45/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:56.188024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ec245-514b-411b-8f06-6a64a5f963df None admin] RBAC: Authorizing `identity:create_grant(project_id=cefdac4b6cbd48da9ac73336c23c3d58, group_id=e3ef4a5cc0604f7ab953c4a633d45b45, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:56.189701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ec245-514b-411b-8f06-6a64a5f963df None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:56.218907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 190/391] 10.222.0.36 () {58 vars in 1442 bytes} [Sun Jun 26 02:51:55 2022] PUT /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/groups/e3ef4a5cc0604f7ab953c4a633d45b45/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 02:51:56.223775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f6b0b-f198-4200-8780-d910ea977f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:56.224708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6b0b-f198-4200-8780-d910ea977f80 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:56.224992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6b0b-f198-4200-8780-d910ea977f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:56.225262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f6b0b-f198-4200-8780-d910ea977f80 None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:56.226910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f6b0b-f198-4200-8780-d910ea977f80 None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:56.228502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f6b0b-f198-4200-8780-d910ea977f80 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:56.231011 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 202/392] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:51:55 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:56.237194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ec245-514b-411b-8f06-6a64a5f963df None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:56.263408 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:56.367803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ec245-514b-411b-8f06-6a64a5f963df None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:56.414081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9aca1-18f0-448c-ad67-20a74ba83df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:56.415112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9aca1-18f0-448c-ad67-20a74ba83df4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:56.415401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9aca1-18f0-448c-ad67-20a74ba83df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:56.415677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9aca1-18f0-448c-ad67-20a74ba83df4 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:56.418960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9aca1-18f0-448c-ad67-20a74ba83df4 None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:56.420648 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9aca1-18f0-448c-ad67-20a74ba83df4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:56.422583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 191/393] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:56 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:56.428357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f6b0b-f198-4200-8780-d910ea977f80 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:56.552606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f6b0b-f198-4200-8780-d910ea977f80 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:56.588342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334e64b-fdf3-4998-ace8-2138c01a71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:56.589294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334e64b-fdf3-4998-ace8-2138c01a71c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:56.589590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334e64b-fdf3-4998-ace8-2138c01a71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:56.589867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334e64b-fdf3-4998-ace8-2138c01a71c6 None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/groups/e3ef4a5cc0604f7ab953c4a633d45b45/roles/c81f6283cf3a418bad94b56a1e9ea2b3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:56.592208 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334e64b-fdf3-4998-ace8-2138c01a71c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=cefdac4b6cbd48da9ac73336c23c3d58, group_id=e3ef4a5cc0604f7ab953c4a633d45b45, role_id=c81f6283cf3a418bad94b56a1e9ea2b3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:56.593667 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334e64b-fdf3-4998-ace8-2138c01a71c6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:56.612316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 203/394] 10.222.0.36 () {58 vars in 1442 bytes} [Sun Jun 26 02:51:56 2022] PUT /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58/groups/e3ef4a5cc0604f7ab953c4a633d45b45/roles/c81f6283cf3a418bad94b56a1e9ea2b3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:56.758860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea2ea-62c2-4143-ab40-af10bfcff19f None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:56.759126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea2ea-62c2-4143-ab40-af10bfcff19f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:56.759363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea2ea-62c2-4143-ab40-af10bfcff19f None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:56.761029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 192/395] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:51:56.766692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5bfc9-a477-44d1-a071-0aa76957977e None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:56.767017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5bfc9-a477-44d1-a071-0aa76957977e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:56.767279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5bfc9-a477-44d1-a071-0aa76957977e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:56.794776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-74f5bfc9-a477-44d1-a071-0aa76957977e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:56.796107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-74f5bfc9-a477-44d1-a071-0aa76957977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:56.830114 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:56.885888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 204/396] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:56.909950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea2ea-62c2-4143-ab40-af10bfcff19f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:56.997020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:57.028609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea2ea-62c2-4143-ab40-af10bfcff19f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:57.070381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42186a8f-41c1-4106-bf73-9e247f9fbf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:57.071229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186a8f-41c1-4106-bf73-9e247f9fbf86 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:57.071513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186a8f-41c1-4106-bf73-9e247f9fbf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:57.071788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186a8f-41c1-4106-bf73-9e247f9fbf86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:57.084984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42186a8f-41c1-4106-bf73-9e247f9fbf86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-42186a8f-41c1-4106-bf73-9e247f9fbf86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:57.092722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:57.093676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:57.094583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 193/397] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:57.099913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5bfc9-a477-44d1-a071-0aa76957977e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:57.251209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5bfc9-a477-44d1-a071-0aa76957977e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:57.292871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc755fab-384e-43dc-82c6-d0af96417884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:57.293463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc755fab-384e-43dc-82c6-d0af96417884 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:57.293746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc755fab-384e-43dc-82c6-d0af96417884 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:57.294019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc755fab-384e-43dc-82c6-d0af96417884 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:57.294777 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc755fab-384e-43dc-82c6-d0af96417884 None admin] RBAC: Adding query filter params (name=member) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:57.295111 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc755fab-384e-43dc-82c6-d0af96417884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:57.296579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc755fab-384e-43dc-82c6-d0af96417884 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:57.311121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 205/398] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:57.316649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42186a8f-41c1-4106-bf73-9e247f9fbf86 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:57.353614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fb66e-2975-450d-9161-8b03bd87db35 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:57.354101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fb66e-2975-450d-9161-8b03bd87db35 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:57.354606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fb66e-2975-450d-9161-8b03bd87db35 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:57.356406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 206/399] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:51:57.361990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792d42-1547-44c6-bd58-864fcbffb580 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:57.362319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792d42-1547-44c6-bd58-864fcbffb580 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:57.362553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792d42-1547-44c6-bd58-864fcbffb580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:57.404048 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-73792d42-1547-44c6-bd58-864fcbffb580 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:57.405381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-73792d42-1547-44c6-bd58-864fcbffb580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:57.441160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:57.446964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42186a8f-41c1-4106-bf73-9e247f9fbf86 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:57.485082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c384aad-2be5-43ac-ba3b-c6bf3e19362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:57.486349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c384aad-2be5-43ac-ba3b-c6bf3e19362b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:57.486838 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c384aad-2be5-43ac-ba3b-c6bf3e19362b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:57.487355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c384aad-2be5-43ac-ba3b-c6bf3e19362b None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:57.488743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c384aad-2be5-43ac-ba3b-c6bf3e19362b None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:57.490433 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c384aad-2be5-43ac-ba3b-c6bf3e19362b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:57.492998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 194/400] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:51:57 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:57.500499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c384aad-2be5-43ac-ba3b-c6bf3e19362b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:57.514014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:57.588400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 207/401] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:51:57.615350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c384aad-2be5-43ac-ba3b-c6bf3e19362b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:57.626379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73792d42-1547-44c6-bd58-864fcbffb580 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:57.651903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551be3b0-fe8d-493f-9e43-201be466a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:57.652792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be3b0-fe8d-493f-9e43-201be466a386 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:57.653076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be3b0-fe8d-493f-9e43-201be466a386 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:57.653353 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551be3b0-fe8d-493f-9e43-201be466a386 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:57.654604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551be3b0-fe8d-493f-9e43-201be466a386 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:57.656113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551be3b0-fe8d-493f-9e43-201be466a386 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:57.658145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 195/402] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:57 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:57.663645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551be3b0-fe8d-493f-9e43-201be466a386 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:57.747499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:57.769195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551be3b0-fe8d-493f-9e43-201be466a386 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:57.804404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6865ad8-e3c7-446f-9d1c-2a3e7ec05b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:57.805406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6865ad8-e3c7-446f-9d1c-2a3e7ec05b0e None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:57.805694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6865ad8-e3c7-446f-9d1c-2a3e7ec05b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:57.805974 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6865ad8-e3c7-446f-9d1c-2a3e7ec05b0e None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/groups/e3ef4a5cc0604f7ab953c4a633d45b45/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:57.808110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6865ad8-e3c7-446f-9d1c-2a3e7ec05b0e None admin] RBAC: Authorizing `identity:create_grant(project_id=eb27a40f6d7647a9b0c4abb9026dde16, group_id=e3ef4a5cc0604f7ab953c4a633d45b45, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:57.809570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6865ad8-e3c7-446f-9d1c-2a3e7ec05b0e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:57.831447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 196/403] 10.222.0.36 () {58 vars in 1442 bytes} [Sun Jun 26 02:51:57 2022] PUT /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/groups/e3ef4a5cc0604f7ab953c4a633d45b45/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 02:51:57.851460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73792d42-1547-44c6-bd58-864fcbffb580 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:57.882194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473ea5a-8ec0-4153-a7a7-44bd3181fdb8 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:57.882604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473ea5a-8ec0-4153-a7a7-44bd3181fdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:57.882888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473ea5a-8ec0-4153-a7a7-44bd3181fdb8 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:57.884597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 197/404] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:51:57.891625 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e6e7-4212-4acb-970b-de0ec110935b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:57.892319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e6e7-4212-4acb-970b-de0ec110935b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:57.892784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e6e7-4212-4acb-970b-de0ec110935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:57.914360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0716e6e7-4212-4acb-970b-de0ec110935b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:57.915991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0716e6e7-4212-4acb-970b-de0ec110935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:57.927240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec6987-71a9-499f-a3f1-971ddf389be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:57.928089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec6987-71a9-499f-a3f1-971ddf389be1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:57.928372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec6987-71a9-499f-a3f1-971ddf389be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:57.928641 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec6987-71a9-499f-a3f1-971ddf389be1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:57.948615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec6987-71a9-499f-a3f1-971ddf389be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-67ec6987-71a9-499f-a3f1-971ddf389be1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:57.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:57.960034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:51:57.960852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 208/405] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:51:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:57.964435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec6987-71a9-499f-a3f1-971ddf389be1 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:57.995411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:58.045213 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 198/406] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:58.080255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e6e7-4212-4acb-970b-de0ec110935b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:58.120098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec6987-71a9-499f-a3f1-971ddf389be1 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:58.150291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:58.159538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526403d-c1aa-49ea-a08f-fe584bb83d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:58.160251 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526403d-c1aa-49ea-a08f-fe584bb83d9f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:58.160493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526403d-c1aa-49ea-a08f-fe584bb83d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:58.160783 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526403d-c1aa-49ea-a08f-fe584bb83d9f None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:58.161527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526403d-c1aa-49ea-a08f-fe584bb83d9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:58.161828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526403d-c1aa-49ea-a08f-fe584bb83d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:58.163263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526403d-c1aa-49ea-a08f-fe584bb83d9f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:58.174800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 209/407] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:51:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:58.180587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526403d-c1aa-49ea-a08f-fe584bb83d9f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:58.208625 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e6e7-4212-4acb-970b-de0ec110935b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:58.248161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d11e0-e557-4f11-aef1-208281e2ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:58.249155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d11e0-e557-4f11-aef1-208281e2ea6e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:58.249532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d11e0-e557-4f11-aef1-208281e2ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:58.249926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d11e0-e557-4f11-aef1-208281e2ea6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:58.261182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d11e0-e557-4f11-aef1-208281e2ea6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-487d11e0-e557-4f11-aef1-208281e2ea6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:58.269288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:58.270406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:51:58.271371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:58.272418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 199/408] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:51:58.274512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:58.280203 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d11e0-e557-4f11-aef1-208281e2ea6e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:58.309483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526403d-c1aa-49ea-a08f-fe584bb83d9f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:58.344879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f36e-1d95-4f6e-ac98-4188ba7d7396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:58.346195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f36e-1d95-4f6e-ac98-4188ba7d7396 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:58.346744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f36e-1d95-4f6e-ac98-4188ba7d7396 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:58.347255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f36e-1d95-4f6e-ac98-4188ba7d7396 None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:58.348738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4f36e-1d95-4f6e-ac98-4188ba7d7396 None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:58.350385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4f36e-1d95-4f6e-ac98-4188ba7d7396 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:58.352608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 210/409] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:51:58 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:51:58.359795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f36e-1d95-4f6e-ac98-4188ba7d7396 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:58.503024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d11e0-e557-4f11-aef1-208281e2ea6e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:58.544944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:58.548555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f36e-1d95-4f6e-ac98-4188ba7d7396 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:58.573120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd476b-11da-4aca-96ca-04be39a30ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:58.573803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd476b-11da-4aca-96ca-04be39a30ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:58.574081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd476b-11da-4aca-96ca-04be39a30ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:58.574360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd476b-11da-4aca-96ca-04be39a30ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:58.575215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd476b-11da-4aca-96ca-04be39a30ff2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:58.575454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd476b-11da-4aca-96ca-04be39a30ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:58.576917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd476b-11da-4aca-96ca-04be39a30ff2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:58.600098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e3e29-6225-4224-bebc-42f4a6b97c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:58.600332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 200/410] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:58.601230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd476b-11da-4aca-96ca-04be39a30ff2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:58.601937 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3e29-6225-4224-bebc-42f4a6b97c32 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:58.602450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3e29-6225-4224-bebc-42f4a6b97c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:58.602918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3e29-6225-4224-bebc-42f4a6b97c32 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:58.604398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e3e29-6225-4224-bebc-42f4a6b97c32 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:58.606056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e3e29-6225-4224-bebc-42f4a6b97c32 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:58.608079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 211/411] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:58 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:58.616361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e3e29-6225-4224-bebc-42f4a6b97c32 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:58.643387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:58.716424 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd476b-11da-4aca-96ca-04be39a30ff2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:58.758529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bd8de-aeba-4218-8cb1-a0169985d403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:58.759350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bd8de-aeba-4218-8cb1-a0169985d403 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:58.759629 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bd8de-aeba-4218-8cb1-a0169985d403 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:58.759903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bd8de-aeba-4218-8cb1-a0169985d403 None admin] PATH_INFO: `/v3/groups/9ec58393e2624d158ba95bdd8fd1a5b0` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:58.762719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bd8de-aeba-4218-8cb1-a0169985d403 None admin] RBAC: Authorizing `identity:get_group(group_id=9ec58393e2624d158ba95bdd8fd1a5b0)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:58.764263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bd8de-aeba-4218-8cb1-a0169985d403 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:58.766255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 201/412] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:51:58 2022] GET /identity/v3/groups/9ec58393e2624d158ba95bdd8fd1a5b0 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:58.779987 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bd8de-aeba-4218-8cb1-a0169985d403 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:58.789830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e3e29-6225-4224-bebc-42f4a6b97c32 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:58.823573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86ef9f-b9ae-48ef-a690-d054e2c3bf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:58.824706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86ef9f-b9ae-48ef-a690-d054e2c3bf1f None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:58.824985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86ef9f-b9ae-48ef-a690-d054e2c3bf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:58.826588 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86ef9f-b9ae-48ef-a690-d054e2c3bf1f None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/groups/e3ef4a5cc0604f7ab953c4a633d45b45/roles/c81f6283cf3a418bad94b56a1e9ea2b3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:58.830348 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86ef9f-b9ae-48ef-a690-d054e2c3bf1f None admin] RBAC: Authorizing `identity:create_grant(project_id=eb27a40f6d7647a9b0c4abb9026dde16, group_id=e3ef4a5cc0604f7ab953c4a633d45b45, role_id=c81f6283cf3a418bad94b56a1e9ea2b3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:58.832900 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86ef9f-b9ae-48ef-a690-d054e2c3bf1f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:58.859801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 212/413] 10.222.0.36 () {58 vars in 1442 bytes} [Sun Jun 26 02:51:58 2022] PUT /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16/groups/e3ef4a5cc0604f7ab953c4a633d45b45/roles/c81f6283cf3a418bad94b56a1e9ea2b3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:58.875624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:58.944729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bd8de-aeba-4218-8cb1-a0169985d403 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:58.994675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edcb53-a445-42cc-a621-4abb5e3adc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:58.995615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edcb53-a445-42cc-a621-4abb5e3adc36 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:58.995899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edcb53-a445-42cc-a621-4abb5e3adc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:58.996183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edcb53-a445-42cc-a621-4abb5e3adc36 None admin] PATH_INFO: `/v3/projects/898f4bc074784aa394c0f3456d694f9e` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:58.999062 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edcb53-a445-42cc-a621-4abb5e3adc36 None admin] RBAC: Authorizing `identity:get_project(project_id=898f4bc074784aa394c0f3456d694f9e)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:59.000566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edcb53-a445-42cc-a621-4abb5e3adc36 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:59.002358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 202/414] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:58 2022] GET /identity/v3/projects/898f4bc074784aa394c0f3456d694f9e => generated 344 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:59.008243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86ef9f-b9ae-48ef-a690-d054e2c3bf1f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:59.075849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55168c96-b02a-4df0-ba69-bf85b6d002c6 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:59.076196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55168c96-b02a-4df0-ba69-bf85b6d002c6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:59.076487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55168c96-b02a-4df0-ba69-bf85b6d002c6 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:59.077928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 203/415] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:51:59.097715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4f7b7-bce3-4e72-8661-1b6eb400845d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:59.098335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4f7b7-bce3-4e72-8661-1b6eb400845d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:59.098832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4f7b7-bce3-4e72-8661-1b6eb400845d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:59.116875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:59.117603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7cf4f7b7-bce3-4e72-8661-1b6eb400845d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:59.118808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7cf4f7b7-bce3-4e72-8661-1b6eb400845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:59.154807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86ef9f-b9ae-48ef-a690-d054e2c3bf1f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:59.194423 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 204/416] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:51:59.205213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a7588-8d01-40c8-8368-87da56602a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:59.206132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a7588-8d01-40c8-8368-87da56602a2e None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:59.206417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a7588-8d01-40c8-8368-87da56602a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:59.206703 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a7588-8d01-40c8-8368-87da56602a2e None admin] PATH_INFO: `/v3/projects/898f4bc074784aa394c0f3456d694f9e/groups/9ec58393e2624d158ba95bdd8fd1a5b0/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:59.211490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a7588-8d01-40c8-8368-87da56602a2e None admin] RBAC: Authorizing `identity:create_grant(project_id=898f4bc074784aa394c0f3456d694f9e, group_id=9ec58393e2624d158ba95bdd8fd1a5b0, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:59.212964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a7588-8d01-40c8-8368-87da56602a2e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:59.224849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4f7b7-bce3-4e72-8661-1b6eb400845d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:59.241554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 213/417] 10.222.0.36 () {58 vars in 1442 bytes} [Sun Jun 26 02:51:59 2022] PUT /identity/v3/projects/898f4bc074784aa394c0f3456d694f9e/groups/9ec58393e2624d158ba95bdd8fd1a5b0/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:51:59.285593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:59.342834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4f7b7-bce3-4e72-8661-1b6eb400845d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:59.382346 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f110b23-cedf-4fc5-a898-6e0505a9f3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:59.383584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110b23-cedf-4fc5-a898-6e0505a9f3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:59.384162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110b23-cedf-4fc5-a898-6e0505a9f3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:59.384639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110b23-cedf-4fc5-a898-6e0505a9f3c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:59.397256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f110b23-cedf-4fc5-a898-6e0505a9f3c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-3f110b23-cedf-4fc5-a898-6e0505a9f3c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:51:59.405840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:51:59.406797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:51:59.407729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:51:59.410706 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 205/418] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:51:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:51:59.417291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a7588-8d01-40c8-8368-87da56602a2e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:59.532192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a7588-8d01-40c8-8368-87da56602a2e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:59.562954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:59.569255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16482570-bc9e-48b2-9a1a-3d39e1e027b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:59.570336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16482570-bc9e-48b2-9a1a-3d39e1e027b1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:59.570630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16482570-bc9e-48b2-9a1a-3d39e1e027b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:59.571588 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16482570-bc9e-48b2-9a1a-3d39e1e027b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:59.572364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16482570-bc9e-48b2-9a1a-3d39e1e027b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:51:59.572673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16482570-bc9e-48b2-9a1a-3d39e1e027b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:59.574093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16482570-bc9e-48b2-9a1a-3d39e1e027b1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:59.583622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 214/419] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:51:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:51:59.589207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f110b23-cedf-4fc5-a898-6e0505a9f3c1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:59.697042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f110b23-cedf-4fc5-a898-6e0505a9f3c1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:51:59.707816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:59.731592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e7d3b-0edc-499e-9111-11092bcaa17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:51:59.732253 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7d3b-0edc-499e-9111-11092bcaa17d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:59.732537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7d3b-0edc-499e-9111-11092bcaa17d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:59.732884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7d3b-0edc-499e-9111-11092bcaa17d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:59.770504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4061a-b792-469b-9be2-5285516a2134 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:59.770814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4061a-b792-469b-9be2-5285516a2134 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:59.771084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4061a-b792-469b-9be2-5285516a2134 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:59.772716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 215/420] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:51:59.780746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704d970-1a22-4af8-8349-df9b58bdecaf None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:51:59.781502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704d970-1a22-4af8-8349-df9b58bdecaf None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:51:59.781931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704d970-1a22-4af8-8349-df9b58bdecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:51:59.803779 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-7704d970-1a22-4af8-8349-df9b58bdecaf None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:51:59.805838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7704d970-1a22-4af8-8349-df9b58bdecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:51:59.832068 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e7d3b-0edc-499e-9111-11092bcaa17d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:51:59.833715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e7d3b-0edc-499e-9111-11092bcaa17d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:51:59.939394 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 206/421] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:51:59.945175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e7d3b-0edc-499e-9111-11092bcaa17d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:51:59.957448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:51:59.968516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 216/422] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:52:00.017460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704d970-1a22-4af8-8349-df9b58bdecaf None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:00.120357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704d970-1a22-4af8-8349-df9b58bdecaf None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:00.155538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0c0b6-4619-4413-8552-70ce8cbc9080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:00.156364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c0b6-4619-4413-8552-70ce8cbc9080 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:00.156643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c0b6-4619-4413-8552-70ce8cbc9080 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:00.156918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c0b6-4619-4413-8552-70ce8cbc9080 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:00.168137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0c0b6-4619-4413-8552-70ce8cbc9080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:00.176937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e7d3b-0edc-499e-9111-11092bcaa17d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:00.177504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-32d0c0b6-4619-4413-8552-70ce8cbc9080 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:00.180665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:00.181510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:52:00.182306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:00.191220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 217/423] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:00.197590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0c0b6-4619-4413-8552-70ce8cbc9080 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:00.253413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2a38f-b213-43e4-8b1d-e45770a12b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:00.256523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2a38f-b213-43e4-8b1d-e45770a12b5a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:00.256945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2a38f-b213-43e4-8b1d-e45770a12b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:00.257370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2a38f-b213-43e4-8b1d-e45770a12b5a None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:00.260957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2a38f-b213-43e4-8b1d-e45770a12b5a None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:00.266664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2a38f-b213-43e4-8b1d-e45770a12b5a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:00.268694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 207/424] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:51:59 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:00.274447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2a38f-b213-43e4-8b1d-e45770a12b5a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:00.368416 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0c0b6-4619-4413-8552-70ce8cbc9080 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:00.388355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:00.411181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec962e-37c4-410a-bc41-1fd852b4851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:00.412755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec962e-37c4-410a-bc41-1fd852b4851e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:00.413442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec962e-37c4-410a-bc41-1fd852b4851e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:00.413867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec962e-37c4-410a-bc41-1fd852b4851e None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:00.414761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec962e-37c4-410a-bc41-1fd852b4851e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:00.415300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec962e-37c4-410a-bc41-1fd852b4851e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:00.415430 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2a38f-b213-43e4-8b1d-e45770a12b5a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:00.417577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec962e-37c4-410a-bc41-1fd852b4851e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:00.428635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 218/425] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:00.430326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc319c4c-a87e-4cda-9613-aaf6d5d042d1 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:00.430946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc319c4c-a87e-4cda-9613-aaf6d5d042d1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:00.431840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc319c4c-a87e-4cda-9613-aaf6d5d042d1 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:00.433505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 219/426] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:00.434683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc319c4c-a87e-4cda-9613-aaf6d5d042d1 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:00.463531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f258809-2b83-4c0c-ae66-877f7e89a285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:00.464876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f258809-2b83-4c0c-ae66-877f7e89a285 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:00.465527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f258809-2b83-4c0c-ae66-877f7e89a285 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:00.466337 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f258809-2b83-4c0c-ae66-877f7e89a285 None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:00.467997 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f258809-2b83-4c0c-ae66-877f7e89a285 None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:00.470378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f258809-2b83-4c0c-ae66-877f7e89a285 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:00.472524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 208/427] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:52:00 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:00.474848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859d004-5e7f-47a2-8ce2-b9ca1420b322 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:00.475316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859d004-5e7f-47a2-8ce2-b9ca1420b322 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:00.475752 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859d004-5e7f-47a2-8ce2-b9ca1420b322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:00.487885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:00.494005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b859d004-5e7f-47a2-8ce2-b9ca1420b322 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:00.495280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b859d004-5e7f-47a2-8ce2-b9ca1420b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:00.562821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc319c4c-a87e-4cda-9613-aaf6d5d042d1 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:00.567063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 209/428] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:00.567063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859d004-5e7f-47a2-8ce2-b9ca1420b322 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:00.619912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b527913-9bbc-49fa-9220-6b59595bcf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:00.621035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527913-9bbc-49fa-9220-6b59595bcf12 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:00.621439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527913-9bbc-49fa-9220-6b59595bcf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:00.621827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527913-9bbc-49fa-9220-6b59595bcf12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:00.655319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:00.683371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859d004-5e7f-47a2-8ce2-b9ca1420b322 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:00.707844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b527913-9bbc-49fa-9220-6b59595bcf12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:00.709538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b527913-9bbc-49fa-9220-6b59595bcf12 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:00.724435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca56238-e5a7-483e-9567-ccb975c8c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:00.725411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca56238-e5a7-483e-9567-ccb975c8c189 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:00.725843 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca56238-e5a7-483e-9567-ccb975c8c189 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:00.726278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca56238-e5a7-483e-9567-ccb975c8c189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:00.727328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca56238-e5a7-483e-9567-ccb975c8c189 None admin] RBAC: Adding query filter params (group.id=e3ef4a5cc0604f7ab953c4a633d45b45, role.id=729faf69df60450caeada9c53520224f, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:00.727783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca56238-e5a7-483e-9567-ccb975c8c189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:00.729462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca56238-e5a7-483e-9567-ccb975c8c189 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:00.743925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 210/429] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Jun 26 02:52:00 2022] GET /identity/v3/role_assignments?group.id=e3ef4a5cc0604f7ab953c4a633d45b45&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=729faf69df60450caeada9c53520224f => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:00.745086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca56238-e5a7-483e-9567-ccb975c8c189 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:00.797523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:00.866032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 220/430] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:00.874442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b527913-9bbc-49fa-9220-6b59595bcf12 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:00.994810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca56238-e5a7-483e-9567-ccb975c8c189 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:00.999933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b527913-9bbc-49fa-9220-6b59595bcf12 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:01.060031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0f9c6-db47-45ef-81df-e950eea94d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:01.061338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0f9c6-db47-45ef-81df-e950eea94d9c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.061989 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0f9c6-db47-45ef-81df-e950eea94d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.062465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0f9c6-db47-45ef-81df-e950eea94d9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.069236 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2e585-c50f-4d48-8618-e434024c744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:01.070952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e585-c50f-4d48-8618-e434024c744e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.071490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e585-c50f-4d48-8618-e434024c744e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.074233 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2e585-c50f-4d48-8618-e434024c744e None admin] PATH_INFO: `/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.075752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2e585-c50f-4d48-8618-e434024c744e None admin] RBAC: Authorizing `identity:get_project(project_id=cefdac4b6cbd48da9ac73336c23c3d58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:01.077773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2e585-c50f-4d48-8618-e434024c744e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:01.080779 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 221/431] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:52:00 2022] GET /identity/v3/projects/cefdac4b6cbd48da9ac73336c23c3d58 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:01.089042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2e585-c50f-4d48-8618-e434024c744e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:01.090320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:01.094559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0f9c6-db47-45ef-81df-e950eea94d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-4ab0f9c6-db47-45ef-81df-e950eea94d9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:01.114920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:01.115899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 26 02:52:01.116840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:01.121750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 211/432] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:01.127968 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:01.128095 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0f9c6-db47-45ef-81df-e950eea94d9c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:01.269224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0f9c6-db47-45ef-81df-e950eea94d9c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:01.277172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2e585-c50f-4d48-8618-e434024c744e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:01.325052 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b5cb0-dd23-47f8-acb4-028188d90ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:01.325950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5cb0-dd23-47f8-acb4-028188d90ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.326234 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5cb0-dd23-47f8-acb4-028188d90ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.331014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5cb0-dd23-47f8-acb4-028188d90ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.331014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b5cb0-dd23-47f8-acb4-028188d90ee9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:01.331230 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69f10a-df32-4284-b813-3aa9ac81cd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:01.331317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b5cb0-dd23-47f8-acb4-028188d90ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:01.331396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f10a-df32-4284-b813-3aa9ac81cd21 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.331396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f10a-df32-4284-b813-3aa9ac81cd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.331396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f10a-df32-4284-b813-3aa9ac81cd21 None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.331582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b5cb0-dd23-47f8-acb4-028188d90ee9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:01.331648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69f10a-df32-4284-b813-3aa9ac81cd21 None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:01.332974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69f10a-df32-4284-b813-3aa9ac81cd21 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:01.341054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 222/433] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:52:01 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:01.342000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69f10a-df32-4284-b813-3aa9ac81cd21 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:01.356945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 212/434] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:52:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:01.363167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b5cb0-dd23-47f8-acb4-028188d90ee9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:01.447674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:01.457768 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:01.472561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69f10a-df32-4284-b813-3aa9ac81cd21 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:01.511548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b5cb0-dd23-47f8-acb4-028188d90ee9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:01.520055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b0275-a21b-4cc8-b04d-2119ff700935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:01.520724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0275-a21b-4cc8-b04d-2119ff700935 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.521007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0275-a21b-4cc8-b04d-2119ff700935 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.521307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0275-a21b-4cc8-b04d-2119ff700935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.522148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b0275-a21b-4cc8-b04d-2119ff700935 None admin] RBAC: Adding query filter params (group.id=e3ef4a5cc0604f7ab953c4a633d45b45, role.id=c81f6283cf3a418bad94b56a1e9ea2b3, scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:01.522471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b0275-a21b-4cc8-b04d-2119ff700935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:01.523951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b0275-a21b-4cc8-b04d-2119ff700935 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:01.529784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 223/435] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Jun 26 02:52:01 2022] GET /identity/v3/role_assignments?group.id=e3ef4a5cc0604f7ab953c4a633d45b45&scope.project.id=cefdac4b6cbd48da9ac73336c23c3d58&role.id=c81f6283cf3a418bad94b56a1e9ea2b3 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:01.535283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e965-61bb-4c17-b6ee-0e4abd47f270 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.535283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e965-61bb-4c17-b6ee-0e4abd47f270 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.535283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e965-61bb-4c17-b6ee-0e4abd47f270 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.537604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 224/436] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:01.539347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d485034-c2fb-4e3d-967b-c8a441e8b6ae None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.539630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d485034-c2fb-4e3d-967b-c8a441e8b6ae None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.539912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d485034-c2fb-4e3d-967b-c8a441e8b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.560639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54341c76-6ee7-43ca-b5a0-e241b21ed048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:01.561803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54341c76-6ee7-43ca-b5a0-e241b21ed048 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.562324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54341c76-6ee7-43ca-b5a0-e241b21ed048 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.562701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54341c76-6ee7-43ca-b5a0-e241b21ed048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.564275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5d485034-c2fb-4e3d-967b-c8a441e8b6ae None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:01.565823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5d485034-c2fb-4e3d-967b-c8a441e8b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:01.645044 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54341c76-6ee7-43ca-b5a0-e241b21ed048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:01.646592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54341c76-6ee7-43ca-b5a0-e241b21ed048 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:01.671487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 225/437] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:01.697043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d485034-c2fb-4e3d-967b-c8a441e8b6ae None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:01.721287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:01.767248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 213/438] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:01.772503 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54341c76-6ee7-43ca-b5a0-e241b21ed048 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:01.793482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:01.829575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d485034-c2fb-4e3d-967b-c8a441e8b6ae None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:01.877766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb45053-a67b-4254-8fb7-c3b2fb98ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:01.878612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45053-a67b-4254-8fb7-c3b2fb98ef20 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.880717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45053-a67b-4254-8fb7-c3b2fb98ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.880856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb45053-a67b-4254-8fb7-c3b2fb98ef20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.894148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb45053-a67b-4254-8fb7-c3b2fb98ef20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:01.897040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54341c76-6ee7-43ca-b5a0-e241b21ed048 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-beb45053-a67b-4254-8fb7-c3b2fb98ef20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:01.902323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:01.903288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:01.904077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 226/439] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:01.905321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735fb5c-5d83-4ff3-ae51-d229a1e02045 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.905321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735fb5c-5d83-4ff3-ae51-d229a1e02045 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.905493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735fb5c-5d83-4ff3-ae51-d229a1e02045 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.906792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 227/440] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:01.911597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735fb5c-5d83-4ff3-ae51-d229a1e02045 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:01.937425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560ef4c-e769-47c5-871a-884a297edbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:01.938400 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560ef4c-e769-47c5-871a-884a297edbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.938748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560ef4c-e769-47c5-871a-884a297edbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.939130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560ef4c-e769-47c5-871a-884a297edbb6 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.940360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560ef4c-e769-47c5-871a-884a297edbb6 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:01.941811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560ef4c-e769-47c5-871a-884a297edbb6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:01.943775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 214/441] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:52:01 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:01.944739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fa9a4-d010-4f04-93a4-0b845e2941bb None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:01.945005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fa9a4-d010-4f04-93a4-0b845e2941bb None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:01.945586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fa9a4-d010-4f04-93a4-0b845e2941bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:01.965983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ee0fa9a4-d010-4f04-93a4-0b845e2941bb None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:01.967305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ee0fa9a4-d010-4f04-93a4-0b845e2941bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:01.991316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:02.024828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735fb5c-5d83-4ff3-ae51-d229a1e02045 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:02.033616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 215/442] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:02.034444 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fa9a4-d010-4f04-93a4-0b845e2941bb None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:02.059897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19527d38-eefa-417b-af12-1a2137ec1266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:02.060566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19527d38-eefa-417b-af12-1a2137ec1266 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:02.060847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19527d38-eefa-417b-af12-1a2137ec1266 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:02.061122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19527d38-eefa-417b-af12-1a2137ec1266 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:02.061873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19527d38-eefa-417b-af12-1a2137ec1266 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:02.062177 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19527d38-eefa-417b-af12-1a2137ec1266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:02.063607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19527d38-eefa-417b-af12-1a2137ec1266 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:02.064934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:02.073570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 228/443] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:02.074357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19527d38-eefa-417b-af12-1a2137ec1266 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:02.132200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fa9a4-d010-4f04-93a4-0b845e2941bb None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:02.166158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf84108-b1b4-4d88-a217-dbd3f0705c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:02.167391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf84108-b1b4-4d88-a217-dbd3f0705c2d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:02.167669 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf84108-b1b4-4d88-a217-dbd3f0705c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:02.168089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf84108-b1b4-4d88-a217-dbd3f0705c2d None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:02.169130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf84108-b1b4-4d88-a217-dbd3f0705c2d None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:02.170645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf84108-b1b4-4d88-a217-dbd3f0705c2d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:02.172306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 216/444] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:52:02 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:02.173061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf84108-b1b4-4d88-a217-dbd3f0705c2d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:02.176781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19527d38-eefa-417b-af12-1a2137ec1266 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:02.206878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:02.214331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33238fd-92d6-4da0-90c6-5082bb3bd4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:02.214913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33238fd-92d6-4da0-90c6-5082bb3bd4cf None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:02.215453 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33238fd-92d6-4da0-90c6-5082bb3bd4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:02.215939 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33238fd-92d6-4da0-90c6-5082bb3bd4cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:02.227760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33238fd-92d6-4da0-90c6-5082bb3bd4cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-d33238fd-92d6-4da0-90c6-5082bb3bd4cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:02.235930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:02.236828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:02.237629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 229/445] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:02.238351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33238fd-92d6-4da0-90c6-5082bb3bd4cf None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:02.284865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf84108-b1b4-4d88-a217-dbd3f0705c2d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:02.295437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:02.318582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698270c-19d7-4ba6-9916-2958c6226749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:02.319354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698270c-19d7-4ba6-9916-2958c6226749 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:02.319639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698270c-19d7-4ba6-9916-2958c6226749 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:02.319918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698270c-19d7-4ba6-9916-2958c6226749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:02.339231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33238fd-92d6-4da0-90c6-5082bb3bd4cf None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:02.371948 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f154-fff5-4611-b971-06f2f713d266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:02.372606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f154-fff5-4611-b971-06f2f713d266 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:02.372881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f154-fff5-4611-b971-06f2f713d266 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:02.373181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f154-fff5-4611-b971-06f2f713d266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:02.374050 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45f154-fff5-4611-b971-06f2f713d266 None admin] RBAC: Adding query filter params (group.id=e3ef4a5cc0604f7ab953c4a633d45b45, role.id=729faf69df60450caeada9c53520224f, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:02.374365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45f154-fff5-4611-b971-06f2f713d266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:02.375844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45f154-fff5-4611-b971-06f2f713d266 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:02.381828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 230/446] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Jun 26 02:52:02 2022] GET /identity/v3/role_assignments?group.id=e3ef4a5cc0604f7ab953c4a633d45b45&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=729faf69df60450caeada9c53520224f => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:02.382509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f154-fff5-4611-b971-06f2f713d266 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:02.398962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698270c-19d7-4ba6-9916-2958c6226749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:02.400655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698270c-19d7-4ba6-9916-2958c6226749 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:02.437781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:02.504712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f154-fff5-4611-b971-06f2f713d266 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:02.526336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 217/447] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:02.527554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:02.532236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698270c-19d7-4ba6-9916-2958c6226749 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:02.552883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b812037-1d7d-4dd9-bf4c-4b36f903637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:02.553482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b812037-1d7d-4dd9-bf4c-4b36f903637b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:02.554440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b812037-1d7d-4dd9-bf4c-4b36f903637b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:02.554440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b812037-1d7d-4dd9-bf4c-4b36f903637b None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:02.554786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b812037-1d7d-4dd9-bf4c-4b36f903637b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:02.555222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b812037-1d7d-4dd9-bf4c-4b36f903637b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:02.556952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b812037-1d7d-4dd9-bf4c-4b36f903637b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:02.570461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 231/448] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:02.572101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b812037-1d7d-4dd9-bf4c-4b36f903637b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:02.651371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698270c-19d7-4ba6-9916-2958c6226749 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:02.682048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:02.689753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b812037-1d7d-4dd9-bf4c-4b36f903637b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:02.693599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918501e6-ce67-4d25-9499-b5cc3978b3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:02.694471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918501e6-ce67-4d25-9499-b5cc3978b3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:02.694755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918501e6-ce67-4d25-9499-b5cc3978b3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:02.695059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918501e6-ce67-4d25-9499-b5cc3978b3d7 None admin] PATH_INFO: `/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:02.697268 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918501e6-ce67-4d25-9499-b5cc3978b3d7 None admin] RBAC: Authorizing `identity:get_project(project_id=eb27a40f6d7647a9b0c4abb9026dde16)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:02.698747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918501e6-ce67-4d25-9499-b5cc3978b3d7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:02.700511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 218/449] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:52:02 2022] GET /identity/v3/projects/eb27a40f6d7647a9b0c4abb9026dde16 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:02.706818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918501e6-ce67-4d25-9499-b5cc3978b3d7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:02.728619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefced7-4800-4612-b230-09c148610fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:02.729283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefced7-4800-4612-b230-09c148610fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:02.729563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefced7-4800-4612-b230-09c148610fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:02.729820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefced7-4800-4612-b230-09c148610fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:02.783854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:02.804094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefced7-4800-4612-b230-09c148610fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:02.805723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefced7-4800-4612-b230-09c148610fa4 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:02.809546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918501e6-ce67-4d25-9499-b5cc3978b3d7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:02.841675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5042a-d665-45df-8246-f92fda827b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:02.842568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5042a-d665-45df-8246-f92fda827b45 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:02.842851 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5042a-d665-45df-8246-f92fda827b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:02.843157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5042a-d665-45df-8246-f92fda827b45 None admin] PATH_INFO: `/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:02.844327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5042a-d665-45df-8246-f92fda827b45 None admin] RBAC: Authorizing `identity:get_group(group_id=e3ef4a5cc0604f7ab953c4a633d45b45)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:02.845782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5042a-d665-45df-8246-f92fda827b45 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:02.847454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 219/450] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:52:02 2022] GET /identity/v3/groups/e3ef4a5cc0604f7ab953c4a633d45b45 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:02.853343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5042a-d665-45df-8246-f92fda827b45 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:02.899562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 232/451] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 26 02:52:02.905104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefced7-4800-4612-b230-09c148610fa4 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:02.917194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:02.954824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5042a-d665-45df-8246-f92fda827b45 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:02.981756 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:02.988646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212494cf-d304-4b67-a992-4497ce532183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:02.989302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212494cf-d304-4b67-a992-4497ce532183 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:02.989581 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212494cf-d304-4b67-a992-4497ce532183 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:02.989854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212494cf-d304-4b67-a992-4497ce532183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:02.990682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212494cf-d304-4b67-a992-4497ce532183 None admin] RBAC: Adding query filter params (group.id=e3ef4a5cc0604f7ab953c4a633d45b45, role.id=c81f6283cf3a418bad94b56a1e9ea2b3, scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:02.991020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212494cf-d304-4b67-a992-4497ce532183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:02.992452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212494cf-d304-4b67-a992-4497ce532183 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:02.998232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 220/452] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Jun 26 02:52:02 2022] GET /identity/v3/role_assignments?group.id=e3ef4a5cc0604f7ab953c4a633d45b45&scope.project.id=eb27a40f6d7647a9b0c4abb9026dde16&role.id=c81f6283cf3a418bad94b56a1e9ea2b3 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:03.000547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefced7-4800-4612-b230-09c148610fa4 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:03.036901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c5da7-a134-4ab3-837e-4f060e294555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:03.037797 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5da7-a134-4ab3-837e-4f060e294555 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:03.038064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5da7-a134-4ab3-837e-4f060e294555 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:03.038335 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c5da7-a134-4ab3-837e-4f060e294555 None admin] PATH_INFO: `/v3/projects/898f4bc074784aa394c0f3456d694f9e` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:03.039622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c5da7-a134-4ab3-837e-4f060e294555 None admin] RBAC: Authorizing `identity:get_project(project_id=898f4bc074784aa394c0f3456d694f9e)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:03.041126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c5da7-a134-4ab3-837e-4f060e294555 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:03.043234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 233/453] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:52:02 2022] GET /identity/v3/projects/898f4bc074784aa394c0f3456d694f9e => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:03.049168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212494cf-d304-4b67-a992-4497ce532183 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:03.160454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212494cf-d304-4b67-a992-4497ce532183 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:03.188806 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:03.197873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9a1f6-977b-4ab7-8370-d17022484977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:03.198778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9a1f6-977b-4ab7-8370-d17022484977 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:03.199138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9a1f6-977b-4ab7-8370-d17022484977 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:03.199419 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9a1f6-977b-4ab7-8370-d17022484977 None admin] PATH_INFO: `/v3/groups/9ec58393e2624d158ba95bdd8fd1a5b0` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:03.200751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9a1f6-977b-4ab7-8370-d17022484977 None admin] RBAC: Authorizing `identity:get_group(group_id=9ec58393e2624d158ba95bdd8fd1a5b0)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:03.202196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9a1f6-977b-4ab7-8370-d17022484977 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:03.204230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 221/454] 10.222.0.36 () {56 vars in 1180 bytes} [Sun Jun 26 02:52:03 2022] GET /identity/v3/groups/9ec58393e2624d158ba95bdd8fd1a5b0 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:03.210157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c5da7-a134-4ab3-837e-4f060e294555 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:03.309300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c5da7-a134-4ab3-837e-4f060e294555 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:03.342690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c800ef7-1eb4-43a2-b36c-e5bb1eb5deb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:03.343369 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c800ef7-1eb4-43a2-b36c-e5bb1eb5deb0 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:03.343648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c800ef7-1eb4-43a2-b36c-e5bb1eb5deb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:03.343916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c800ef7-1eb4-43a2-b36c-e5bb1eb5deb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:03.344760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c800ef7-1eb4-43a2-b36c-e5bb1eb5deb0 None admin] RBAC: Adding query filter params (group.id=9ec58393e2624d158ba95bdd8fd1a5b0, role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=898f4bc074784aa394c0f3456d694f9e) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:03.345064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c800ef7-1eb4-43a2-b36c-e5bb1eb5deb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:03.346509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c800ef7-1eb4-43a2-b36c-e5bb1eb5deb0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:03.352322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 234/455] 10.222.0.36 () {56 vars in 1376 bytes} [Sun Jun 26 02:52:03 2022] GET /identity/v3/role_assignments?group.id=9ec58393e2624d158ba95bdd8fd1a5b0&scope.project.id=898f4bc074784aa394c0f3456d694f9e&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:05.762073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e33bed-6373-4e95-a752-4923874c355c None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:05.762588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e33bed-6373-4e95-a752-4923874c355c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:05.762588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e33bed-6373-4e95-a752-4923874c355c None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:05.764214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 222/456] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:05.769564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697a701-5c04-4d40-869c-098378ab4dbf None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:05.770368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697a701-5c04-4d40-869c-098378ab4dbf None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:05.770847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697a701-5c04-4d40-869c-098378ab4dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:05.795966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-1697a701-5c04-4d40-869c-098378ab4dbf None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:05.797479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1697a701-5c04-4d40-869c-098378ab4dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:05.807406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:05.892566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e8a83-8124-4ac5-96d4-fe88add74d63 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:05.893116 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e8a83-8124-4ac5-96d4-fe88add74d63 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:05.893527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e8a83-8124-4ac5-96d4-fe88add74d63 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:05.895310 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 223/457] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:05.898150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 235/458] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:05.914353 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a02845-25d7-4d76-9fe5-888d38395d0b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:05.914716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a02845-25d7-4d76-9fe5-888d38395d0b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:05.915022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a02845-25d7-4d76-9fe5-888d38395d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:05.924776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697a701-5c04-4d40-869c-098378ab4dbf None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:05.950642 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a8a02845-25d7-4d76-9fe5-888d38395d0b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:05.953978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a8a02845-25d7-4d76-9fe5-888d38395d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:06.071937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 224/459] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:06.089439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697a701-5c04-4d40-869c-098378ab4dbf None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:06.115322 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a02845-25d7-4d76-9fe5-888d38395d0b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:06.155740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7623d0-0304-45f9-8c7c-1e1e2d9648a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:06.156557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7623d0-0304-45f9-8c7c-1e1e2d9648a0 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:06.156846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7623d0-0304-45f9-8c7c-1e1e2d9648a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:06.157125 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7623d0-0304-45f9-8c7c-1e1e2d9648a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:06.179866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7623d0-0304-45f9-8c7c-1e1e2d9648a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:06.181619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7623d0-0304-45f9-8c7c-1e1e2d9648a0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:06.188153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-2a7623d0-0304-45f9-8c7c-1e1e2d9648a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:06.212192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:06.213289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:06.214340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:06.214340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:06.214340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:06.214340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:06.214616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 236/460] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:06.222025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7623d0-0304-45f9-8c7c-1e1e2d9648a0 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:06.287433 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a02845-25d7-4d76-9fe5-888d38395d0b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:06.332845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:06.349487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba598-8d84-47bf-80a9-8fa19879a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:06.350296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba598-8d84-47bf-80a9-8fa19879a911 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:06.350578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba598-8d84-47bf-80a9-8fa19879a911 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:06.350854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba598-8d84-47bf-80a9-8fa19879a911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:06.369508 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aba598-8d84-47bf-80a9-8fa19879a911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:06.371003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aba598-8d84-47bf-80a9-8fa19879a911 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:06.405646 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7623d0-0304-45f9-8c7c-1e1e2d9648a0 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-f6aba598-8d84-47bf-80a9-8fa19879a911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:06.407314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:06.408149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:06.408969 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:06.408969 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:06.408969 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:06.408969 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:06.415104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 225/461] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:06.420788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba598-8d84-47bf-80a9-8fa19879a911 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:06.462564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f68a85-b8e9-406f-bf13-998deb040056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:06.463794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f68a85-b8e9-406f-bf13-998deb040056 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:06.464428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f68a85-b8e9-406f-bf13-998deb040056 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:06.464880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f68a85-b8e9-406f-bf13-998deb040056 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:06.466275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f68a85-b8e9-406f-bf13-998deb040056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:06.466732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f68a85-b8e9-406f-bf13-998deb040056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:06.469040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f68a85-b8e9-406f-bf13-998deb040056 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:06.486781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 237/462] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:06.486781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f2d0-dc20-4079-92f0-79ad4d32d3bf None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:06.486781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f2d0-dc20-4079-92f0-79ad4d32d3bf None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:06.486781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f2d0-dc20-4079-92f0-79ad4d32d3bf None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:06.486781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 238/463] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:06.486781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28482e-163f-4d80-a2d8-5c614f529956 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:06.487292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28482e-163f-4d80-a2d8-5c614f529956 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:06.487292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28482e-163f-4d80-a2d8-5c614f529956 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:06.488564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 239/464] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:06.489117 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28482e-163f-4d80-a2d8-5c614f529956 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:06.552049 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba598-8d84-47bf-80a9-8fa19879a911 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:06.552935 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:06.586778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b311f24-e2e4-4e73-aba4-8ca7c2e4835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:06.587382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311f24-e2e4-4e73-aba4-8ca7c2e4835c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:06.587657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311f24-e2e4-4e73-aba4-8ca7c2e4835c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:06.587932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311f24-e2e4-4e73-aba4-8ca7c2e4835c None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:06.588650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b311f24-e2e4-4e73-aba4-8ca7c2e4835c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:06.588951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b311f24-e2e4-4e73-aba4-8ca7c2e4835c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:06.590330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b311f24-e2e4-4e73-aba4-8ca7c2e4835c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:06.603529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28482e-163f-4d80-a2d8-5c614f529956 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:06.607915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 226/465] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:06.612677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3f3c-a816-4ed2-af93-b4a53563043a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:06.612677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3f3c-a816-4ed2-af93-b4a53563043a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:06.612677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3f3c-a816-4ed2-af93-b4a53563043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:06.627108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3acc3f3c-a816-4ed2-af93-b4a53563043a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:06.628279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3acc3f3c-a816-4ed2-af93-b4a53563043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:06.646726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a6921-cce6-41eb-ba10-93f5db99283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:06.647428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a6921-cce6-41eb-ba10-93f5db99283f None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:06.647715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a6921-cce6-41eb-ba10-93f5db99283f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:06.647965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a6921-cce6-41eb-ba10-93f5db99283f None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:06.649223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a6921-cce6-41eb-ba10-93f5db99283f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:06.651276 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a6921-cce6-41eb-ba10-93f5db99283f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:06.658014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:06.677357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 240/466] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:52:06 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:06.678762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408397-fb17-4e98-87cc-e1ec956b1d99 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:06.679133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408397-fb17-4e98-87cc-e1ec956b1d99 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:06.679450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408397-fb17-4e98-87cc-e1ec956b1d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:06.703521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-c8408397-fb17-4e98-87cc-e1ec956b1d99 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:06.705098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c8408397-fb17-4e98-87cc-e1ec956b1d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:06.714237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 227/467] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:06.715584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3f3c-a816-4ed2-af93-b4a53563043a None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:06.814651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 241/468] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:06.816413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8408397-fb17-4e98-87cc-e1ec956b1d99 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:06.835053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3f3c-a816-4ed2-af93-b4a53563043a None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:06.869406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:06.880469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e226e-b7be-43c8-b824-20f5cd8de029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:06.881256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e226e-b7be-43c8-b824-20f5cd8de029 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:06.881598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e226e-b7be-43c8-b824-20f5cd8de029 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:06.881938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e226e-b7be-43c8-b824-20f5cd8de029 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:06.882717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e226e-b7be-43c8-b824-20f5cd8de029 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:06.884414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e226e-b7be-43c8-b824-20f5cd8de029 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:06.915134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 228/469] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:52:06 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:06.915134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e226e-b7be-43c8-b824-20f5cd8de029 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:06.958062 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:06.964994 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8408397-fb17-4e98-87cc-e1ec956b1d99 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:07.016419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ea51-bdeb-4a2e-ae32-e421e0c4769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:07.017259 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ea51-bdeb-4a2e-ae32-e421e0c4769a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:07.017544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ea51-bdeb-4a2e-ae32-e421e0c4769a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:07.017826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ea51-bdeb-4a2e-ae32-e421e0c4769a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:07.032743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ea51-bdeb-4a2e-ae32-e421e0c4769a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:07.034759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ea51-bdeb-4a2e-ae32-e421e0c4769a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:07.052128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e226e-b7be-43c8-b824-20f5cd8de029 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-fe04ea51-bdeb-4a2e-ae32-e421e0c4769a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:07.062379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:07.063356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:07.064226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:07.064226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:07.064226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:07.064226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:07.064226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 242/470] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:07.070437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ea51-bdeb-4a2e-ae32-e421e0c4769a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:07.095145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9eb87-a8e7-4c96-a509-2e93885180b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:07.096389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9eb87-a8e7-4c96-a509-2e93885180b2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:07.096665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9eb87-a8e7-4c96-a509-2e93885180b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:07.097012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9eb87-a8e7-4c96-a509-2e93885180b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:07.109361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9eb87-a8e7-4c96-a509-2e93885180b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:07.110855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9eb87-a8e7-4c96-a509-2e93885180b2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-17b9eb87-a8e7-4c96-a509-2e93885180b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:07.128284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:07.129164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:07.130477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:07.130477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:07.130477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:07.130477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:07.130477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 229/471] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:07.135392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9eb87-a8e7-4c96-a509-2e93885180b2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:07.183193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:07.191984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ea51-bdeb-4a2e-ae32-e421e0c4769a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:07.229703 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb52fbd-512d-4608-b577-50c9ecdcafac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:07.230376 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52fbd-512d-4608-b577-50c9ecdcafac None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:07.230664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52fbd-512d-4608-b577-50c9ecdcafac None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:07.230944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52fbd-512d-4608-b577-50c9ecdcafac None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:07.231752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb52fbd-512d-4608-b577-50c9ecdcafac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:07.232030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:07.232160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb52fbd-512d-4608-b577-50c9ecdcafac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:07.233808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb52fbd-512d-4608-b577-50c9ecdcafac None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:07.249500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 243/472] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:07.249500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d48f-5b47-415c-a188-b7f9ad09f2dd None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:07.249500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d48f-5b47-415c-a188-b7f9ad09f2dd None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:07.249500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883d48f-5b47-415c-a188-b7f9ad09f2dd None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:07.249500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 244/473] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:07.254194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883d48f-5b47-415c-a188-b7f9ad09f2dd None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:07.269513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9eb87-a8e7-4c96-a509-2e93885180b2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:07.313063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b126fce-55e4-4d9e-8579-998b84e2863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:07.314180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126fce-55e4-4d9e-8579-998b84e2863e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:07.314812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126fce-55e4-4d9e-8579-998b84e2863e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:07.315244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126fce-55e4-4d9e-8579-998b84e2863e None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:07.316282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b126fce-55e4-4d9e-8579-998b84e2863e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:07.316725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b126fce-55e4-4d9e-8579-998b84e2863e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:07.318778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b126fce-55e4-4d9e-8579-998b84e2863e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:07.334875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 230/474] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:07.342038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df295-ccb2-4f1e-901a-87edac6fe695 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:07.342479 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df295-ccb2-4f1e-901a-87edac6fe695 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:07.342896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df295-ccb2-4f1e-901a-87edac6fe695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:07.364092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-916df295-ccb2-4f1e-901a-87edac6fe695 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:07.365824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-916df295-ccb2-4f1e-901a-87edac6fe695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:07.366058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883d48f-5b47-415c-a188-b7f9ad09f2dd None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:07.402360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f206f-8583-4a72-aa0a-0d3549817e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:07.403211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f206f-8583-4a72-aa0a-0d3549817e7e None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:07.403589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f206f-8583-4a72-aa0a-0d3549817e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:07.404160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f206f-8583-4a72-aa0a-0d3549817e7e None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:07.404835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f206f-8583-4a72-aa0a-0d3549817e7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:07.406440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f206f-8583-4a72-aa0a-0d3549817e7e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:07.435015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 245/475] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:52:07 2022] POST /identity/v3/users => generated 248 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:07.435015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f206f-8583-4a72-aa0a-0d3549817e7e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:07.462647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:07.471365 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 231/476] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:07.505373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df295-ccb2-4f1e-901a-87edac6fe695 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:07.604179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f206f-8583-4a72-aa0a-0d3549817e7e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:07.638269 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:07.642953 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8ee5a-6716-41b1-8683-c62e89ac3978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:07.643846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8ee5a-6716-41b1-8683-c62e89ac3978 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:07.644133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8ee5a-6716-41b1-8683-c62e89ac3978 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:07.644415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8ee5a-6716-41b1-8683-c62e89ac3978 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:07.645212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8ee5a-6716-41b1-8683-c62e89ac3978 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:07.646696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8ee5a-6716-41b1-8683-c62e89ac3978 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:07.671316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 246/477] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:52:07 2022] POST /identity/v3/users => generated 249 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:07.677122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df295-ccb2-4f1e-901a-87edac6fe695 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:07.718082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950ce49-9f8a-4cc0-abac-d94b50ed8305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:07.718775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950ce49-9f8a-4cc0-abac-d94b50ed8305 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:07.719078 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950ce49-9f8a-4cc0-abac-d94b50ed8305 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:07.719359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950ce49-9f8a-4cc0-abac-d94b50ed8305 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:07.720125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950ce49-9f8a-4cc0-abac-d94b50ed8305 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:07.721604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950ce49-9f8a-4cc0-abac-d94b50ed8305 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:07.733215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.sql.core [None req-2950ce49-9f8a-4cc0-abac-d94b50ed8305 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 26 02:52:07.733215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 26 02:52:07.733215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [parameters: {'id': '9d81d23002bf480a83e02b5e063ad6ee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 26 02:52:07.733215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80128) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2950ce49-9f8a-4cc0-abac-d94b50ed8305 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application result = self._query(query) Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application conn.query(q) Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application result.read() Jun 26 02:52:07.750518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return ref.to_dict() Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 26 02:52:07.751496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application next(self.gen) Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application yield resource Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application next(self.gen) Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self.session.rollback() Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self.force_reraise() Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise self.value Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application session.commit() Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 26 02:52:07.753005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._prepare_impl() Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self.session.flush() Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._flush(objects) Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application compat.raise_( Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application flush_context.execute() Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rec.execute(self) Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 26 02:52:07.753955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 26 02:52:07.754888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application result = self._query(query) Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application conn.query(q) Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application result.read() Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 26 02:52:07.755713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [parameters: {'id': '9d81d23002bf480a83e02b5e063ad6ee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:07.756609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 26 02:52:07.757490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:07.758306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 232/478] 10.222.0.36 () {60 vars in 1131 bytes} [Sun Jun 26 02:52:07 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:07.760852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8ee5a-6716-41b1-8683-c62e89ac3978 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:07.843379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:07.885345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8ee5a-6716-41b1-8683-c62e89ac3978 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:07.926932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33feb4-d93f-44f9-9d1e-be58de11a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:07.927711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33feb4-d93f-44f9-9d1e-be58de11a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:07.927990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33feb4-d93f-44f9-9d1e-be58de11a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:07.928262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33feb4-d93f-44f9-9d1e-be58de11a3b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:07.940908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33feb4-d93f-44f9-9d1e-be58de11a3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-ce33feb4-d93f-44f9-9d1e-be58de11a3b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:07.948977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:07.949827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:07.950618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 247/479] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:07.956224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950ce49-9f8a-4cc0-abac-d94b50ed8305 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:08.113159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950ce49-9f8a-4cc0-abac-d94b50ed8305 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:08.149681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:08.162064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43938946-238e-450d-839e-97831ba31ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:08.162747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43938946-238e-450d-839e-97831ba31ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:08.163055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43938946-238e-450d-839e-97831ba31ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:08.163331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43938946-238e-450d-839e-97831ba31ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:08.164087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43938946-238e-450d-839e-97831ba31ce5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:08.164387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43938946-238e-450d-839e-97831ba31ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:08.165766 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43938946-238e-450d-839e-97831ba31ce5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:08.178563 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 233/480] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:09.385442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd7462-73f2-44a6-abb8-94832e15c911 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:09.385972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd7462-73f2-44a6-abb8-94832e15c911 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:09.385972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd7462-73f2-44a6-abb8-94832e15c911 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:09.388014 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 248/481] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:09.393027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835a3f2-2109-4d74-98d1-eaab4cf897dd None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:09.393818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835a3f2-2109-4d74-98d1-eaab4cf897dd None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:09.394327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835a3f2-2109-4d74-98d1-eaab4cf897dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:09.417290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2835a3f2-2109-4d74-98d1-eaab4cf897dd None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:09.418804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2835a3f2-2109-4d74-98d1-eaab4cf897dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:09.429977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d442d-b730-4513-98bf-b50d258f6719 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:09.430277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d442d-b730-4513-98bf-b50d258f6719 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:09.430564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d442d-b730-4513-98bf-b50d258f6719 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:09.432424 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 249/482] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:09.437164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceafd7-d43e-4899-a307-91125882271f None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:09.437451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceafd7-d43e-4899-a307-91125882271f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:09.437731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceafd7-d43e-4899-a307-91125882271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:09.467059 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-89ceafd7-d43e-4899-a307-91125882271f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:09.468253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-89ceafd7-d43e-4899-a307-91125882271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:09.491803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 234/483] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:09.520347 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835a3f2-2109-4d74-98d1-eaab4cf897dd None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:09.617369 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 250/484] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:09.631226 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835a3f2-2109-4d74-98d1-eaab4cf897dd None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:09.648674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ceafd7-d43e-4899-a307-91125882271f None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:09.654512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:09.685140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764362c-1377-44f0-9b35-92fa3691e202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:09.686270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764362c-1377-44f0-9b35-92fa3691e202 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:09.686867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764362c-1377-44f0-9b35-92fa3691e202 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:09.687299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764362c-1377-44f0-9b35-92fa3691e202 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:09.704984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764362c-1377-44f0-9b35-92fa3691e202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-7764362c-1377-44f0-9b35-92fa3691e202 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:09.718944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:09.720051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:09.720972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:09.728092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 235/485] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:09.734137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764362c-1377-44f0-9b35-92fa3691e202 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:09.759434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:09.859347 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764362c-1377-44f0-9b35-92fa3691e202 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:09.880940 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ceafd7-d43e-4899-a307-91125882271f None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:09.893944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afbc2b-7d1f-44e1-a3b0-9b39765c3390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:09.894647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbc2b-7d1f-44e1-a3b0-9b39765c3390 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:09.894932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbc2b-7d1f-44e1-a3b0-9b39765c3390 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:09.895251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbc2b-7d1f-44e1-a3b0-9b39765c3390 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:09.896117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbc2b-7d1f-44e1-a3b0-9b39765c3390 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:09.896438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbc2b-7d1f-44e1-a3b0-9b39765c3390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:09.897827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbc2b-7d1f-44e1-a3b0-9b39765c3390 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:09.906755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 236/486] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:09.908100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdb659-d7c1-47b3-81d5-5d420894d630 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:09.908503 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdb659-d7c1-47b3-81d5-5d420894d630 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:09.908789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdb659-d7c1-47b3-81d5-5d420894d630 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:09.910025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 237/487] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:09.911840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdb659-d7c1-47b3-81d5-5d420894d630 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:09.938693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f46f9-7854-48f9-8d40-3b60135b57f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:09.939787 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f46f9-7854-48f9-8d40-3b60135b57f6 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:09.940057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f46f9-7854-48f9-8d40-3b60135b57f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:09.940567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f46f9-7854-48f9-8d40-3b60135b57f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:09.953930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f46f9-7854-48f9-8d40-3b60135b57f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:09.959943 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-7b3f46f9-7854-48f9-8d40-3b60135b57f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:09.966272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:09.967269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:09.968062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:09.971075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 251/488] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:09.972363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372a93b-10f4-418c-a86c-7a9f0eb2a072 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:09.972649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372a93b-10f4-418c-a86c-7a9f0eb2a072 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:09.972930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372a93b-10f4-418c-a86c-7a9f0eb2a072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:09.995042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d372a93b-10f4-418c-a86c-7a9f0eb2a072 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:09.996323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d372a93b-10f4-418c-a86c-7a9f0eb2a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:10.025660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdb659-d7c1-47b3-81d5-5d420894d630 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:10.067260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb8272-4e10-4ef0-a637-07820aee531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:10.068064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb8272-4e10-4ef0-a637-07820aee531e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.068341 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb8272-4e10-4ef0-a637-07820aee531e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.068612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb8272-4e10-4ef0-a637-07820aee531e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.070955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 252/489] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:10.071718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372a93b-10f4-418c-a86c-7a9f0eb2a072 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:10.090113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb8272-4e10-4ef0-a637-07820aee531e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:10.100068 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb8272-4e10-4ef0-a637-07820aee531e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:10.121139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-65cb8272-4e10-4ef0-a637-07820aee531e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:10.125824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:10.127122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:10.128998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:10.128998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:10.128998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:10.128998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:10.131412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 238/490] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:10.132253 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb8272-4e10-4ef0-a637-07820aee531e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:10.178581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372a93b-10f4-418c-a86c-7a9f0eb2a072 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:10.215462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6bd0-55f1-4cba-91a0-d73c6502d280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:10.216167 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6bd0-55f1-4cba-91a0-d73c6502d280 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.216448 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6bd0-55f1-4cba-91a0-d73c6502d280 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.216787 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6bd0-55f1-4cba-91a0-d73c6502d280 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.217644 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f6bd0-55f1-4cba-91a0-d73c6502d280 None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:10.218060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f6bd0-55f1-4cba-91a0-d73c6502d280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:10.219494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f6bd0-55f1-4cba-91a0-d73c6502d280 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:10.227518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:10.230020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 253/491] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:10.231088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6bd0-55f1-4cba-91a0-d73c6502d280 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:10.239294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb8272-4e10-4ef0-a637-07820aee531e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:10.280166 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db981ad-89f4-47bd-9329-96524d7f53b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:10.281004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db981ad-89f4-47bd-9329-96524d7f53b0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.281283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db981ad-89f4-47bd-9329-96524d7f53b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.281926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db981ad-89f4-47bd-9329-96524d7f53b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.296145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db981ad-89f4-47bd-9329-96524d7f53b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-0db981ad-89f4-47bd-9329-96524d7f53b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:10.305764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:10.306823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:10.307757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:10.312583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 239/492] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:10.313549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db981ad-89f4-47bd-9329-96524d7f53b0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:10.364822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6bd0-55f1-4cba-91a0-d73c6502d280 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:10.374107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:10.400790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042a012-6aa5-4287-8d9b-985752b11223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:10.401492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042a012-6aa5-4287-8d9b-985752b11223 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.401733 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042a012-6aa5-4287-8d9b-985752b11223 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.402010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042a012-6aa5-4287-8d9b-985752b11223 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.402749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042a012-6aa5-4287-8d9b-985752b11223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:10.403065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042a012-6aa5-4287-8d9b-985752b11223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:10.404497 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042a012-6aa5-4287-8d9b-985752b11223 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:10.420288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 254/493] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:10.421088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042a012-6aa5-4287-8d9b-985752b11223 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:10.428313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db981ad-89f4-47bd-9329-96524d7f53b0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:10.466862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60a3bf-ef74-4c73-9208-1f7089a3e500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:10.467693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60a3bf-ef74-4c73-9208-1f7089a3e500 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.467979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60a3bf-ef74-4c73-9208-1f7089a3e500 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.468253 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60a3bf-ef74-4c73-9208-1f7089a3e500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.481781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60a3bf-ef74-4c73-9208-1f7089a3e500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:10.483379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60a3bf-ef74-4c73-9208-1f7089a3e500 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9c60a3bf-ef74-4c73-9208-1f7089a3e500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:10.502391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:10.503276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:10.504117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:10.504117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:10.504117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:10.504117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:10.504117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 240/494] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:10.504989 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4aa71-96a0-4e77-ab26-bb0f5bc96697 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.505258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4aa71-96a0-4e77-ab26-bb0f5bc96697 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.505532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4aa71-96a0-4e77-ab26-bb0f5bc96697 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.511055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 241/495] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:10.511055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4aa71-96a0-4e77-ab26-bb0f5bc96697 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:10.523138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:10.547048 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042a012-6aa5-4287-8d9b-985752b11223 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:10.585960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f425a1c-72b4-4ad2-b775-dbafeb40dc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:10.586639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f425a1c-72b4-4ad2-b775-dbafeb40dc7d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.586923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f425a1c-72b4-4ad2-b775-dbafeb40dc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.587225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f425a1c-72b4-4ad2-b775-dbafeb40dc7d None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.587991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f425a1c-72b4-4ad2-b775-dbafeb40dc7d None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:10.588299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f425a1c-72b4-4ad2-b775-dbafeb40dc7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:10.589724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f425a1c-72b4-4ad2-b775-dbafeb40dc7d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:10.602463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 255/496] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:10.602463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f425a1c-72b4-4ad2-b775-dbafeb40dc7d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:10.624692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4aa71-96a0-4e77-ab26-bb0f5bc96697 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:10.631404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:10.660357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbdf5b-1011-46c3-a597-9ad5f9633fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:10.661165 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbdf5b-1011-46c3-a597-9ad5f9633fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.661449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbdf5b-1011-46c3-a597-9ad5f9633fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.661734 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbdf5b-1011-46c3-a597-9ad5f9633fd9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.669669 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbdf5b-1011-46c3-a597-9ad5f9633fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:10.671389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbdf5b-1011-46c3-a597-9ad5f9633fd9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-89dbdf5b-1011-46c3-a597-9ad5f9633fd9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:10.687018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:10.692801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 242/497] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Jun 26 02:52:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27c525-9eef-4399-8771-af765ba949a5 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.693957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27c525-9eef-4399-8771-af765ba949a5 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.694790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27c525-9eef-4399-8771-af765ba949a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.709079 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2a27c525-9eef-4399-8771-af765ba949a5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:10.710320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2a27c525-9eef-4399-8771-af765ba949a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:10.716382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f425a1c-72b4-4ad2-b775-dbafeb40dc7d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:10.752466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fb12d-de45-4edc-86f7-8a2b01a24749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:10.753051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fb12d-de45-4edc-86f7-8a2b01a24749 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.753332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fb12d-de45-4edc-86f7-8a2b01a24749 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.753609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fb12d-de45-4edc-86f7-8a2b01a24749 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.754332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fb12d-de45-4edc-86f7-8a2b01a24749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:10.754640 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fb12d-de45-4edc-86f7-8a2b01a24749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:10.756105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fb12d-de45-4edc-86f7-8a2b01a24749 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:10.767868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 256/498] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:10.768697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fb12d-de45-4edc-86f7-8a2b01a24749 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:10.775949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:10.782021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 243/499] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:10.782830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27c525-9eef-4399-8771-af765ba949a5 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:10.863466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:10.873643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fb12d-de45-4edc-86f7-8a2b01a24749 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:10.880155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27c525-9eef-4399-8771-af765ba949a5 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:10.908725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cede890-b74c-49a8-8e70-40fc131c99e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:10.909521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede890-b74c-49a8-8e70-40fc131c99e2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.909800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede890-b74c-49a8-8e70-40fc131c99e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.910072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede890-b74c-49a8-8e70-40fc131c99e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.912367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e8964-4500-4b32-98e7-11b4e363c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:10.913035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e8964-4500-4b32-98e7-11b4e363c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.913312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e8964-4500-4b32-98e7-11b4e363c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.913582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e8964-4500-4b32-98e7-11b4e363c3a6 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.914410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e8964-4500-4b32-98e7-11b4e363c3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:10.914712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e8964-4500-4b32-98e7-11b4e363c3a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:10.916199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e8964-4500-4b32-98e7-11b4e363c3a6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:10.920363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cede890-b74c-49a8-8e70-40fc131c99e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:10.921816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cede890-b74c-49a8-8e70-40fc131c99e2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-6cede890-b74c-49a8-8e70-40fc131c99e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:10.938675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:10.939620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:10.945142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:10.945142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:10.945142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:10.945142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:10.945142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 257/500] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:10.945142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c327e-366f-4c7f-bd0a-a3b41f905300 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:10.945142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c327e-366f-4c7f-bd0a-a3b41f905300 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:10.945142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c327e-366f-4c7f-bd0a-a3b41f905300 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:10.945142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 258/501] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:10.945617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c327e-366f-4c7f-bd0a-a3b41f905300 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:10.953401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 244/502] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Jun 26 02:52:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:10.954491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e8964-4500-4b32-98e7-11b4e363c3a6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:11.010251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:11.047046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c327e-366f-4c7f-bd0a-a3b41f905300 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:11.052015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e8964-4500-4b32-98e7-11b4e363c3a6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:11.080204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af43b29-21be-4c03-9fe9-1bdca9426139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:11.080983 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af43b29-21be-4c03-9fe9-1bdca9426139 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.081261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af43b29-21be-4c03-9fe9-1bdca9426139 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.081533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af43b29-21be-4c03-9fe9-1bdca9426139 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.084894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba30cb-cc73-4a01-b810-fbc5a6cdd44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:11.085688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba30cb-cc73-4a01-b810-fbc5a6cdd44b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.085961 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba30cb-cc73-4a01-b810-fbc5a6cdd44b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.086231 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba30cb-cc73-4a01-b810-fbc5a6cdd44b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.088573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af43b29-21be-4c03-9fe9-1bdca9426139 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:11.090052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af43b29-21be-4c03-9fe9-1bdca9426139 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:11.096156 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba30cb-cc73-4a01-b810-fbc5a6cdd44b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-faba30cb-cc73-4a01-b810-fbc5a6cdd44b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:11.103624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:11.104647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:11.110484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 245/503] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-1af43b29-21be-4c03-9fe9-1bdca9426139 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:11.111334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:11.112252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:11.113300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:11.113300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:11.113300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:11.113300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:11.113300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:11.113300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:11.113300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:11.113300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:11.113300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 26 02:52:11.113300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:11.113889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba30cb-cc73-4a01-b810-fbc5a6cdd44b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:11.113975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 259/504] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:11.113975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2b9e-4ac4-409a-9d4f-7035d9e2fe45 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.113975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2b9e-4ac4-409a-9d4f-7035d9e2fe45 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.113975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2b9e-4ac4-409a-9d4f-7035d9e2fe45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.115633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:11.129843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-b06e2b9e-4ac4-409a-9d4f-7035d9e2fe45 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:11.131144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b06e2b9e-4ac4-409a-9d4f-7035d9e2fe45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:11.199283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 260/505] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:11.199916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e2b9e-4ac4-409a-9d4f-7035d9e2fe45 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:11.208556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba30cb-cc73-4a01-b810-fbc5a6cdd44b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:11.225284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:11.242692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a69c74-7beb-4402-a3b5-3da8aaa457ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:11.243416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a69c74-7beb-4402-a3b5-3da8aaa457ba None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.243698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a69c74-7beb-4402-a3b5-3da8aaa457ba None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.243972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a69c74-7beb-4402-a3b5-3da8aaa457ba None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.244692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a69c74-7beb-4402-a3b5-3da8aaa457ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:11.244995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a69c74-7beb-4402-a3b5-3da8aaa457ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:11.246389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a69c74-7beb-4402-a3b5-3da8aaa457ba None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:11.257895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 246/506] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:11.258792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a69c74-7beb-4402-a3b5-3da8aaa457ba None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:11.301012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e2b9e-4ac4-409a-9d4f-7035d9e2fe45 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:11.330710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:11.336195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902bdd3-bd5d-4ec1-b7ae-fdba7c220c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:11.336965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902bdd3-bd5d-4ec1-b7ae-fdba7c220c2d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.337373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902bdd3-bd5d-4ec1-b7ae-fdba7c220c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.337646 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902bdd3-bd5d-4ec1-b7ae-fdba7c220c2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.357513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a69c74-7beb-4402-a3b5-3da8aaa457ba None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:11.389980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fcd6c-2bef-49db-b1fc-8cf3f25d38e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:11.390646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fcd6c-2bef-49db-b1fc-8cf3f25d38e9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.390928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fcd6c-2bef-49db-b1fc-8cf3f25d38e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.391228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fcd6c-2bef-49db-b1fc-8cf3f25d38e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.391984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fcd6c-2bef-49db-b1fc-8cf3f25d38e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:11.392292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fcd6c-2bef-49db-b1fc-8cf3f25d38e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:11.393667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fcd6c-2bef-49db-b1fc-8cf3f25d38e9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:11.401302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 247/507] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:11.405941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fcd6c-2bef-49db-b1fc-8cf3f25d38e9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:11.406068 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902bdd3-bd5d-4ec1-b7ae-fdba7c220c2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:11.406068 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902bdd3-bd5d-4ec1-b7ae-fdba7c220c2d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:11.443064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:11.500870 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 261/508] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:11.501719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902bdd3-bd5d-4ec1-b7ae-fdba7c220c2d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:11.503173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fcd6c-2bef-49db-b1fc-8cf3f25d38e9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:11.531309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:11.536209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603de0e-8705-45e6-b721-31c6958c689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:11.536881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603de0e-8705-45e6-b721-31c6958c689c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.537157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603de0e-8705-45e6-b721-31c6958c689c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.537429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603de0e-8705-45e6-b721-31c6958c689c None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.538263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603de0e-8705-45e6-b721-31c6958c689c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:11.538567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603de0e-8705-45e6-b721-31c6958c689c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:11.540076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603de0e-8705-45e6-b721-31c6958c689c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:11.557435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 248/509] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Jun 26 02:52:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:11.558178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603de0e-8705-45e6-b721-31c6958c689c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:11.601034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902bdd3-bd5d-4ec1-b7ae-fdba7c220c2d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:11.633700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b8a1-7893-4274-8957-b6489da71745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:11.634492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b8a1-7893-4274-8957-b6489da71745 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.634773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b8a1-7893-4274-8957-b6489da71745 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.635049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b8a1-7893-4274-8957-b6489da71745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.644828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942b8a1-7893-4274-8957-b6489da71745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:11.646290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942b8a1-7893-4274-8957-b6489da71745 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:11.651230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:11.657935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603de0e-8705-45e6-b721-31c6958c689c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-0942b8a1-7893-4274-8957-b6489da71745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:11.663735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:11.664577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:11.665411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:11.665411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:11.665411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:11.665411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:11.665411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 262/510] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:11.667115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b8a1-7893-4274-8957-b6489da71745 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:11.693046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c50e2-b816-4937-a32e-93d536c5c470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:11.693851 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c50e2-b816-4937-a32e-93d536c5c470 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.694128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c50e2-b816-4937-a32e-93d536c5c470 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.694421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c50e2-b816-4937-a32e-93d536c5c470 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.702198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c50e2-b816-4937-a32e-93d536c5c470 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:11.703696 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c50e2-b816-4937-a32e-93d536c5c470 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2d2c50e2-b816-4937-a32e-93d536c5c470 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:11.718051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:11.719013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:11.719913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:11.719913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:11.719913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:11.719913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:11.719913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:11.719913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:11.719913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:11.719913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:11.719913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 26 02:52:11.719913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:11.719913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 249/511] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:11.720464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c50e2-b816-4937-a32e-93d536c5c470 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:11.753125 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:11.771868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b8a1-7893-4274-8957-b6489da71745 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:11.809561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653d8a-5a27-487e-805d-3a9a9f970cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:11.810285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653d8a-5a27-487e-805d-3a9a9f970cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.810569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653d8a-5a27-487e-805d-3a9a9f970cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.810845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653d8a-5a27-487e-805d-3a9a9f970cd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.820868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51653d8a-5a27-487e-805d-3a9a9f970cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:11.821091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c50e2-b816-4937-a32e-93d536c5c470 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:11.822389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51653d8a-5a27-487e-805d-3a9a9f970cd4 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-51653d8a-5a27-487e-805d-3a9a9f970cd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:11.840656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:11.841611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:11.842455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:11.842455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:11.842455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:11.842455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:11.842455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 263/512] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:11.842724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653d8a-5a27-487e-805d-3a9a9f970cd4 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:11.859915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0f239-2504-42bf-8cff-0e08608d7f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:11.860722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0f239-2504-42bf-8cff-0e08608d7f2c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.861007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0f239-2504-42bf-8cff-0e08608d7f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.861306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0f239-2504-42bf-8cff-0e08608d7f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.871918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0f239-2504-42bf-8cff-0e08608d7f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:11.873377 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0f239-2504-42bf-8cff-0e08608d7f2c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-24a0f239-2504-42bf-8cff-0e08608d7f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:11.891586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:11.892432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:11.893267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:11.893267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:11.893267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:11.893267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:11.893267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 250/513] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:11.893789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0f239-2504-42bf-8cff-0e08608d7f2c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:11.907616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:11.941788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653d8a-5a27-487e-805d-3a9a9f970cd4 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:11.974998 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb8772-640f-4da6-8f0c-7575d48f292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:11.975674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb8772-640f-4da6-8f0c-7575d48f292f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:11.976077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb8772-640f-4da6-8f0c-7575d48f292f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:11.976367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb8772-640f-4da6-8f0c-7575d48f292f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:11.980206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:11.994295 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0f239-2504-42bf-8cff-0e08608d7f2c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:12.027306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c42f4-9d2d-4b4b-9b85-5eadd0b6806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:12.027932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c42f4-9d2d-4b4b-9b85-5eadd0b6806a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:12.028218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c42f4-9d2d-4b4b-9b85-5eadd0b6806a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:12.028494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c42f4-9d2d-4b4b-9b85-5eadd0b6806a None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:12.029239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c42f4-9d2d-4b4b-9b85-5eadd0b6806a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:12.029662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c42f4-9d2d-4b4b-9b85-5eadd0b6806a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:12.031660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c42f4-9d2d-4b4b-9b85-5eadd0b6806a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:12.043598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb8772-640f-4da6-8f0c-7575d48f292f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:12.043723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 251/514] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:12.044493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c42f4-9d2d-4b4b-9b85-5eadd0b6806a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:12.045119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb8772-640f-4da6-8f0c-7575d48f292f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:12.122052 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:12.152515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 264/515] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:12.153349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb8772-640f-4da6-8f0c-7575d48f292f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:12.159848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c42f4-9d2d-4b4b-9b85-5eadd0b6806a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:12.186322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:12.193264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b21e3-f226-42c1-be00-36a1c98a37a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:12.193944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b21e3-f226-42c1-be00-36a1c98a37a9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:12.194222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b21e3-f226-42c1-be00-36a1c98a37a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:12.194492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b21e3-f226-42c1-be00-36a1c98a37a9 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:12.195363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b21e3-f226-42c1-be00-36a1c98a37a9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:12.195664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b21e3-f226-42c1-be00-36a1c98a37a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:12.197088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b21e3-f226-42c1-be00-36a1c98a37a9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:12.213888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 252/516] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Jun 26 02:52:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:12.214672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b21e3-f226-42c1-be00-36a1c98a37a9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:12.249913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb8772-640f-4da6-8f0c-7575d48f292f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:12.281838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762230a-0de1-4e26-a257-ccd6d979425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:12.283228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762230a-0de1-4e26-a257-ccd6d979425a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:12.283508 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762230a-0de1-4e26-a257-ccd6d979425a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:12.283776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762230a-0de1-4e26-a257-ccd6d979425a None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:12.284492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762230a-0de1-4e26-a257-ccd6d979425a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:12.284794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762230a-0de1-4e26-a257-ccd6d979425a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:12.286178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762230a-0de1-4e26-a257-ccd6d979425a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:12.298593 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 265/517] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:12.299367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762230a-0de1-4e26-a257-ccd6d979425a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:12.310692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b21e3-f226-42c1-be00-36a1c98a37a9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:12.335602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:12.344276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a62f-2583-4703-a2b8-50d6a71af09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:12.344936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a62f-2583-4703-a2b8-50d6a71af09d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:12.345216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a62f-2583-4703-a2b8-50d6a71af09d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:12.345491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a62f-2583-4703-a2b8-50d6a71af09d None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:12.346205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10a62f-2583-4703-a2b8-50d6a71af09d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:12.346506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10a62f-2583-4703-a2b8-50d6a71af09d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:12.347909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10a62f-2583-4703-a2b8-50d6a71af09d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:12.359549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 253/518] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:12.360370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a62f-2583-4703-a2b8-50d6a71af09d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:12.409507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:12.415613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762230a-0de1-4e26-a257-ccd6d979425a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:12.449956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306deef7-48a9-486f-8c1a-96dcfdd16766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:12.450625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306deef7-48a9-486f-8c1a-96dcfdd16766 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:12.450903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306deef7-48a9-486f-8c1a-96dcfdd16766 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:12.451228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306deef7-48a9-486f-8c1a-96dcfdd16766 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:12.451926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306deef7-48a9-486f-8c1a-96dcfdd16766 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:12.453420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306deef7-48a9-486f-8c1a-96dcfdd16766 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:12.459679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a62f-2583-4703-a2b8-50d6a71af09d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:12.474430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 266/519] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:52:12 2022] POST /identity/v3/users => generated 247 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:12.475366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306deef7-48a9-486f-8c1a-96dcfdd16766 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:12.504457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89717fb-b603-4ecb-a6a2-55c16ec9668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:12.505309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89717fb-b603-4ecb-a6a2-55c16ec9668a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:12.505590 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89717fb-b603-4ecb-a6a2-55c16ec9668a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:12.505856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89717fb-b603-4ecb-a6a2-55c16ec9668a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:12.518487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89717fb-b603-4ecb-a6a2-55c16ec9668a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:12.520059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89717fb-b603-4ecb-a6a2-55c16ec9668a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-d89717fb-b603-4ecb-a6a2-55c16ec9668a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:12.538605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:12.539649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:12.540468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:12.540468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:12.540468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:12.540468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:12.545132 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 254/520] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:12.546134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89717fb-b603-4ecb-a6a2-55c16ec9668a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:12.590549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:12.600372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306deef7-48a9-486f-8c1a-96dcfdd16766 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:12.638537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd1301-510a-48b1-992f-f9c4ba15b934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:12.639569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd1301-510a-48b1-992f-f9c4ba15b934 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:12.640033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd1301-510a-48b1-992f-f9c4ba15b934 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:12.640500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd1301-510a-48b1-992f-f9c4ba15b934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:12.663475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89717fb-b603-4ecb-a6a2-55c16ec9668a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:12.664634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:12.705295 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2e33e-4016-428f-b1c9-b0e72a23abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:12.706946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e33e-4016-428f-b1c9-b0e72a23abc2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:12.707434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e33e-4016-428f-b1c9-b0e72a23abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:12.707995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e33e-4016-428f-b1c9-b0e72a23abc2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:12.721004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd1301-510a-48b1-992f-f9c4ba15b934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:12.721339 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2e33e-4016-428f-b1c9-b0e72a23abc2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:12.722824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2e33e-4016-428f-b1c9-b0e72a23abc2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:12.723026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd1301-510a-48b1-992f-f9c4ba15b934 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-82b2e33e-4016-428f-b1c9-b0e72a23abc2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:12.737298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:12.738294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:12.739208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:12.739208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:12.739208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:12.739208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:12.739208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:12.739208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:12.739208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:12.739208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:12.739208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 26 02:52:12.739208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:12.739208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 255/521] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:12.739758 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2e33e-4016-428f-b1c9-b0e72a23abc2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:12.832368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 267/522] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:12.833573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd1301-510a-48b1-992f-f9c4ba15b934 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:12.841794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:12.845974 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2e33e-4016-428f-b1c9-b0e72a23abc2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:12.883880 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38b202-8aff-48ca-bcfc-98370e01ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:12.884830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38b202-8aff-48ca-bcfc-98370e01ad93 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:12.885113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38b202-8aff-48ca-bcfc-98370e01ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:12.885388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38b202-8aff-48ca-bcfc-98370e01ad93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:12.892472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38b202-8aff-48ca-bcfc-98370e01ad93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:12.893433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:12.893908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38b202-8aff-48ca-bcfc-98370e01ad93 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-cc38b202-8aff-48ca-bcfc-98370e01ad93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:12.909588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:12.910464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:12.911333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:12.911333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:12.911333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:12.911333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:12.911333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:12.911333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:12.911333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:12.911333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:12.911333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 256/523] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:12.911954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38b202-8aff-48ca-bcfc-98370e01ad93 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:12.947144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd1301-510a-48b1-992f-f9c4ba15b934 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:12.982344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca930cd2-95f2-4c42-a22e-62ba4774ad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:12.983035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930cd2-95f2-4c42-a22e-62ba4774ad76 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:12.983330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930cd2-95f2-4c42-a22e-62ba4774ad76 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:12.983605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930cd2-95f2-4c42-a22e-62ba4774ad76 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:12.984334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca930cd2-95f2-4c42-a22e-62ba4774ad76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:12.984645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca930cd2-95f2-4c42-a22e-62ba4774ad76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:12.986031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca930cd2-95f2-4c42-a22e-62ba4774ad76 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:12.997513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 268/524] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:12.998398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca930cd2-95f2-4c42-a22e-62ba4774ad76 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:13.028893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38b202-8aff-48ca-bcfc-98370e01ad93 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:13.065831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dc630-30b4-41e4-952e-07b041db8131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:13.066500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc630-30b4-41e4-952e-07b041db8131 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:13.066785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc630-30b4-41e4-952e-07b041db8131 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:13.067085 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc630-30b4-41e4-952e-07b041db8131 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:13.067931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dc630-30b4-41e4-952e-07b041db8131 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:13.068238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dc630-30b4-41e4-952e-07b041db8131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:13.069701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dc630-30b4-41e4-952e-07b041db8131 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:13.086666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 257/525] 10.222.0.36 () {56 vars in 1139 bytes} [Sun Jun 26 02:52:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:13.087706 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dc630-30b4-41e4-952e-07b041db8131 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:13.107216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:13.107585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca930cd2-95f2-4c42-a22e-62ba4774ad76 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:13.121200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:13.143601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7f318-bb28-45d5-9a93-f4ae3c6705f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:13.144409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f318-bb28-45d5-9a93-f4ae3c6705f0 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:13.144688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f318-bb28-45d5-9a93-f4ae3c6705f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:13.144962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f318-bb28-45d5-9a93-f4ae3c6705f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:13.155485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7f318-bb28-45d5-9a93-f4ae3c6705f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:13.156980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7f318-bb28-45d5-9a93-f4ae3c6705f0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-31b7f318-bb28-45d5-9a93-f4ae3c6705f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:13.173889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:13.174884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:13.175860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:13.175860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:13.175860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:13.175860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:13.175860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 269/526] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:13.176183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7f318-bb28-45d5-9a93-f4ae3c6705f0 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:13.207314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dc630-30b4-41e4-952e-07b041db8131 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:13.242499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd76df-0fdb-4e24-b9cb-dbbd616d3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:13.243291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd76df-0fdb-4e24-b9cb-dbbd616d3b9c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:13.243638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd76df-0fdb-4e24-b9cb-dbbd616d3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:13.244011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd76df-0fdb-4e24-b9cb-dbbd616d3b9c None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:13.244874 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd76df-0fdb-4e24-b9cb-dbbd616d3b9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:13.245155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd76df-0fdb-4e24-b9cb-dbbd616d3b9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:13.246683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd76df-0fdb-4e24-b9cb-dbbd616d3b9c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:13.264695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 258/527] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:13.265516 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd76df-0fdb-4e24-b9cb-dbbd616d3b9c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:13.289149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7f318-bb28-45d5-9a93-f4ae3c6705f0 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:13.324944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39a64e-fc01-44ae-b15f-9f2ac767ee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:13.325890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a64e-fc01-44ae-b15f-9f2ac767ee2c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:13.326228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a64e-fc01-44ae-b15f-9f2ac767ee2c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:13.326799 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a64e-fc01-44ae-b15f-9f2ac767ee2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:13.335498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39a64e-fc01-44ae-b15f-9f2ac767ee2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:13.337044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39a64e-fc01-44ae-b15f-9f2ac767ee2c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:13.341322 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-dc39a64e-fc01-44ae-b15f-9f2ac767ee2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:13.351941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:13.352780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:13.353690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:13.353690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:13.353690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:13.353690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:13.353690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:13.353690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:13.353690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:13.353690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:13.353690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 270/528] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:13.354617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39a64e-fc01-44ae-b15f-9f2ac767ee2c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:13.371554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd76df-0fdb-4e24-b9cb-dbbd616d3b9c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:13.380802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:13.406607 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31615292-e933-4cee-a2c3-bc1f8e7d86e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:13.407652 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31615292-e933-4cee-a2c3-bc1f8e7d86e9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:13.408111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31615292-e933-4cee-a2c3-bc1f8e7d86e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:13.408454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31615292-e933-4cee-a2c3-bc1f8e7d86e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:13.463318 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39a64e-fc01-44ae-b15f-9f2ac767ee2c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:13.480776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31615292-e933-4cee-a2c3-bc1f8e7d86e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:13.482707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31615292-e933-4cee-a2c3-bc1f8e7d86e9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:13.503378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e9bbc-d586-435e-9824-0e520a6c2a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:13.504045 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e9bbc-d586-435e-9824-0e520a6c2a16 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:13.504712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e9bbc-d586-435e-9824-0e520a6c2a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:13.504712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e9bbc-d586-435e-9824-0e520a6c2a16 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:13.505396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e9bbc-d586-435e-9824-0e520a6c2a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:13.505701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e9bbc-d586-435e-9824-0e520a6c2a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:13.507221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e9bbc-d586-435e-9824-0e520a6c2a16 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:13.524304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 271/529] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:13.524304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e9bbc-d586-435e-9824-0e520a6c2a16 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:13.563281 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:13.589613 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 259/530] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:13.590586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31615292-e933-4cee-a2c3-bc1f8e7d86e9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:13.616035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:13.632601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e9bbc-d586-435e-9824-0e520a6c2a16 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:13.665120 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961825b-7723-43ce-8e61-b612d09905c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:13.665772 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961825b-7723-43ce-8e61-b612d09905c8 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:13.666055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961825b-7723-43ce-8e61-b612d09905c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:13.666329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961825b-7723-43ce-8e61-b612d09905c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:13.667558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961825b-7723-43ce-8e61-b612d09905c8 None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=24319e5e83ed4caf9dd3ae4b3937b3fb) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:13.667862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961825b-7723-43ce-8e61-b612d09905c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:13.669302 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961825b-7723-43ce-8e61-b612d09905c8 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:13.683261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 272/531] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:13 2022] GET /identity/v3/role_assignments?user.id=24319e5e83ed4caf9dd3ae4b3937b3fb&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:13.684298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961825b-7723-43ce-8e61-b612d09905c8 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:13.708493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31615292-e933-4cee-a2c3-bc1f8e7d86e9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:13.760580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c94cd0-8fbd-4f34-93af-0f941ca6aec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:13.761176 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c94cd0-8fbd-4f34-93af-0f941ca6aec4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:13.761460 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c94cd0-8fbd-4f34-93af-0f941ca6aec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:13.761737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c94cd0-8fbd-4f34-93af-0f941ca6aec4 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:13.762555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c94cd0-8fbd-4f34-93af-0f941ca6aec4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:13.762868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c94cd0-8fbd-4f34-93af-0f941ca6aec4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:13.765442 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c94cd0-8fbd-4f34-93af-0f941ca6aec4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:13.787156 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 260/532] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:13.787156 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c94cd0-8fbd-4f34-93af-0f941ca6aec4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:13.837110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:13.838817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961825b-7723-43ce-8e61-b612d09905c8 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:13.881896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3732fa9-d821-4cb1-b6f7-1f9b99b97e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:13.882747 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3732fa9-d821-4cb1-b6f7-1f9b99b97e89 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:13.883056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3732fa9-d821-4cb1-b6f7-1f9b99b97e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:13.883759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3732fa9-d821-4cb1-b6f7-1f9b99b97e89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:13.892982 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3732fa9-d821-4cb1-b6f7-1f9b99b97e89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:13.894944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3732fa9-d821-4cb1-b6f7-1f9b99b97e89 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:13.906660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c94cd0-8fbd-4f34-93af-0f941ca6aec4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-d3732fa9-d821-4cb1-b6f7-1f9b99b97e89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:13.913408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:13.914243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:13.915143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:13.915143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:13.915143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:13.915143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:13.915143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:13.915143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:13.915143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:13.915143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:13.915553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 273/533] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:13.917332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3732fa9-d821-4cb1-b6f7-1f9b99b97e89 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:13.930189 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:13.946428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fbf41-d229-4822-be98-5b9a594a483f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:13.947344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fbf41-d229-4822-be98-5b9a594a483f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:13.947690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fbf41-d229-4822-be98-5b9a594a483f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:13.948028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fbf41-d229-4822-be98-5b9a594a483f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:13.959573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fbf41-d229-4822-be98-5b9a594a483f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:13.960743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fbf41-d229-4822-be98-5b9a594a483f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-479fbf41-d229-4822-be98-5b9a594a483f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:13.977839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:13.978904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:13.979962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:13.979962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:13.979962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:13.979962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:13.980874 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 261/534] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:13.981730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fbf41-d229-4822-be98-5b9a594a483f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:14.032316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3732fa9-d821-4cb1-b6f7-1f9b99b97e89 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:14.069291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c37c6-572f-4332-abb0-2e0b900775ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:14.069861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:14.071079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c37c6-572f-4332-abb0-2e0b900775ed None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:14.071576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c37c6-572f-4332-abb0-2e0b900775ed None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:14.072036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c37c6-572f-4332-abb0-2e0b900775ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:14.073069 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c37c6-572f-4332-abb0-2e0b900775ed None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=250c47daff26400c96a6b467d7cf5432) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:14.073536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c37c6-572f-4332-abb0-2e0b900775ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:14.075263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c37c6-572f-4332-abb0-2e0b900775ed None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:14.087013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fbf41-d229-4822-be98-5b9a594a483f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:14.087434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 274/535] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:13 2022] GET /identity/v3/role_assignments?user.id=250c47daff26400c96a6b467d7cf5432&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:14.088738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c37c6-572f-4332-abb0-2e0b900775ed None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:14.120911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e2b7-3e29-4262-90fe-22d36b7ab4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:14.121537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e2b7-3e29-4262-90fe-22d36b7ab4ab None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:14.121816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e2b7-3e29-4262-90fe-22d36b7ab4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:14.122134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946e2b7-3e29-4262-90fe-22d36b7ab4ab None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:14.123004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946e2b7-3e29-4262-90fe-22d36b7ab4ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:14.123316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946e2b7-3e29-4262-90fe-22d36b7ab4ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:14.131028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946e2b7-3e29-4262-90fe-22d36b7ab4ab None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:14.143372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 262/536] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:14.146535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e2b7-3e29-4262-90fe-22d36b7ab4ab None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:14.196845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:14.227082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c37c6-572f-4332-abb0-2e0b900775ed None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:14.265246 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b4b0c-54b7-40f0-b17f-db0d9621f0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:14.266329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b4b0c-54b7-40f0-b17f-db0d9621f0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:14.266798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b4b0c-54b7-40f0-b17f-db0d9621f0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:14.267311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b4b0c-54b7-40f0-b17f-db0d9621f0e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:14.268350 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b4b0c-54b7-40f0-b17f-db0d9621f0e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:14.268852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b4b0c-54b7-40f0-b17f-db0d9621f0e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:14.270475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b4b0c-54b7-40f0-b17f-db0d9621f0e7 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:14.283707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 275/537] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:14.296231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b4b0c-54b7-40f0-b17f-db0d9621f0e7 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:14.338845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946e2b7-3e29-4262-90fe-22d36b7ab4ab None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:14.390599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c51f1b-d251-4d75-be07-b52e7e19bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:14.391665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c51f1b-d251-4d75-be07-b52e7e19bce6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:14.392113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c51f1b-d251-4d75-be07-b52e7e19bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:14.392550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c51f1b-d251-4d75-be07-b52e7e19bce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:14.393542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c51f1b-d251-4d75-be07-b52e7e19bce6 None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=892be7ed998840de8b325316db3fdde4) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:14.395228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c51f1b-d251-4d75-be07-b52e7e19bce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:14.396849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c51f1b-d251-4d75-be07-b52e7e19bce6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:14.410566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 263/538] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:14 2022] GET /identity/v3/role_assignments?user.id=892be7ed998840de8b325316db3fdde4&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:14.444832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b4b0c-54b7-40f0-b17f-db0d9621f0e7 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:14.479912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:14.485385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008da53-55d1-469e-b998-bcd493406585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:14.486272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008da53-55d1-469e-b998-bcd493406585 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:14.486915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008da53-55d1-469e-b998-bcd493406585 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:14.487217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008da53-55d1-469e-b998-bcd493406585 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:14.496400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008da53-55d1-469e-b998-bcd493406585 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:14.497984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008da53-55d1-469e-b998-bcd493406585 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-3008da53-55d1-469e-b998-bcd493406585 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:14.514139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:14.515097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:14.515941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:14.515941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:14.515941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:14.515941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:14.515941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:14.515941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:14.515941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:14.515941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:14.515941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 276/539] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:14.524277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c51f1b-d251-4d75-be07-b52e7e19bce6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:14.540759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ba39-f516-4d8a-989e-c264a9ee9823 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:14.541048 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ba39-f516-4d8a-989e-c264a9ee9823 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:14.541237 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ba39-f516-4d8a-989e-c264a9ee9823 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:14.543291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 277/540] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:14.546964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:14.549639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395179e4-1b5c-46b9-900a-79a53e08cc5a None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:14.550082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395179e4-1b5c-46b9-900a-79a53e08cc5a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:14.550295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395179e4-1b5c-46b9-900a-79a53e08cc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:14.573847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-395179e4-1b5c-46b9-900a-79a53e08cc5a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:14.576112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-395179e4-1b5c-46b9-900a-79a53e08cc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:14.694070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c51f1b-d251-4d75-be07-b52e7e19bce6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:14.728417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 278/541] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:52:14.736752 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124732f5-e3c4-4ae7-832e-2b39a20762c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:14.737434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124732f5-e3c4-4ae7-832e-2b39a20762c1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:14.737715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124732f5-e3c4-4ae7-832e-2b39a20762c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:14.737990 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124732f5-e3c4-4ae7-832e-2b39a20762c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:14.738791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124732f5-e3c4-4ae7-832e-2b39a20762c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:14.739128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124732f5-e3c4-4ae7-832e-2b39a20762c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:14.740630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124732f5-e3c4-4ae7-832e-2b39a20762c1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:14.752984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395179e4-1b5c-46b9-900a-79a53e08cc5a None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:14.773913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 264/542] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:14.792610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124732f5-e3c4-4ae7-832e-2b39a20762c1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:14.881079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395179e4-1b5c-46b9-900a-79a53e08cc5a None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:14.904601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:14.916905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b071f99-8ea5-4b2c-95ff-6a8eaf5c8bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:14.917857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b071f99-8ea5-4b2c-95ff-6a8eaf5c8bbd None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:14.918143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b071f99-8ea5-4b2c-95ff-6a8eaf5c8bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:14.918416 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b071f99-8ea5-4b2c-95ff-6a8eaf5c8bbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:14.927753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:14.930342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b071f99-8ea5-4b2c-95ff-6a8eaf5c8bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-2b071f99-8ea5-4b2c-95ff-6a8eaf5c8bbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:14.938270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:14.939187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:14.939966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:14.943252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 279/543] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:14.959248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b071f99-8ea5-4b2c-95ff-6a8eaf5c8bbd None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:14.964624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124732f5-e3c4-4ae7-832e-2b39a20762c1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:15.019979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88485b47-0500-493a-b23a-f870ccd617c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:15.020648 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88485b47-0500-493a-b23a-f870ccd617c8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:15.020931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88485b47-0500-493a-b23a-f870ccd617c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:15.021205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88485b47-0500-493a-b23a-f870ccd617c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:15.022049 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88485b47-0500-493a-b23a-f870ccd617c8 None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=4169682bfc5043a3a3d4c638dae2a3bc) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:15.022360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88485b47-0500-493a-b23a-f870ccd617c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:15.023840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88485b47-0500-493a-b23a-f870ccd617c8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:15.045529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 265/544] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:14 2022] GET /identity/v3/role_assignments?user.id=4169682bfc5043a3a3d4c638dae2a3bc&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:15.114522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b071f99-8ea5-4b2c-95ff-6a8eaf5c8bbd None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:15.150191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd3359-add7-449c-967d-ea31465aec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:15.150895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd3359-add7-449c-967d-ea31465aec6a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:15.151209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd3359-add7-449c-967d-ea31465aec6a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:15.151490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd3359-add7-449c-967d-ea31465aec6a None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:15.152271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd3359-add7-449c-967d-ea31465aec6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:15.152579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd3359-add7-449c-967d-ea31465aec6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:15.154108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd3359-add7-449c-967d-ea31465aec6a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:15.163923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 280/545] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:15.169940 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88485b47-0500-493a-b23a-f870ccd617c8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:15.283329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88485b47-0500-493a-b23a-f870ccd617c8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:15.325922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03319e82-b9d3-44c6-b395-0d315124f0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:15.326651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03319e82-b9d3-44c6-b395-0d315124f0ac None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:15.326937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03319e82-b9d3-44c6-b395-0d315124f0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:15.327248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03319e82-b9d3-44c6-b395-0d315124f0ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:15.330006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:15.338468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03319e82-b9d3-44c6-b395-0d315124f0ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:15.340034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03319e82-b9d3-44c6-b395-0d315124f0ac None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-03319e82-b9d3-44c6-b395-0d315124f0ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:15.358576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:15.359520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:15.360355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:15.360355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:15.360355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:15.360355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:15.360355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 266/546] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:15.365754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd3359-add7-449c-967d-ea31465aec6a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:15.426364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:15.493899 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd3359-add7-449c-967d-ea31465aec6a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:15.546922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293f4cc-274d-4f62-bf4e-c769b3d49361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:15.547626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f4cc-274d-4f62-bf4e-c769b3d49361 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:15.547911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f4cc-274d-4f62-bf4e-c769b3d49361 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:15.548192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f4cc-274d-4f62-bf4e-c769b3d49361 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:15.548934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293f4cc-274d-4f62-bf4e-c769b3d49361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:15.549244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293f4cc-274d-4f62-bf4e-c769b3d49361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:15.550648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293f4cc-274d-4f62-bf4e-c769b3d49361 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:15.564462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 281/547] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:15.570125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03319e82-b9d3-44c6-b395-0d315124f0ac None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:15.699249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03319e82-b9d3-44c6-b395-0d315124f0ac None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:15.746036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1639d-d5bd-487d-b8f2-9fc0b2859a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:15.746876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1639d-d5bd-487d-b8f2-9fc0b2859a2a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:15.747193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1639d-d5bd-487d-b8f2-9fc0b2859a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:15.747473 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1639d-d5bd-487d-b8f2-9fc0b2859a2a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:15.758967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1639d-d5bd-487d-b8f2-9fc0b2859a2a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:15.760487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1639d-d5bd-487d-b8f2-9fc0b2859a2a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-20c1639d-d5bd-487d-b8f2-9fc0b2859a2a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:15.774970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:15.777175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:15.779471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:15.779471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:15.779471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:15.779471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:15.779471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:15.779471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:15.779471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:15.779471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:15.779471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:15.779471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:15.779471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 267/548] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:15.784165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293f4cc-274d-4f62-bf4e-c769b3d49361 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:15.946815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293f4cc-274d-4f62-bf4e-c769b3d49361 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:15.949319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:15.992017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a02e66-0da4-4ea5-aaa3-a707582c4f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:15.992740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a02e66-0da4-4ea5-aaa3-a707582c4f4a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:15.993027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a02e66-0da4-4ea5-aaa3-a707582c4f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:15.993300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a02e66-0da4-4ea5-aaa3-a707582c4f4a None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:15.994150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a02e66-0da4-4ea5-aaa3-a707582c4f4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:15.994459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a02e66-0da4-4ea5-aaa3-a707582c4f4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:15.995940 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a02e66-0da4-4ea5-aaa3-a707582c4f4a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:16.038595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 282/549] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Jun 26 02:52:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:16.044646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1639d-d5bd-487d-b8f2-9fc0b2859a2a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:16.110592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:16.165617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1639d-d5bd-487d-b8f2-9fc0b2859a2a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:16.199202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1370c-c4ec-4d47-a91a-03513947c247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:16.199933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1370c-c4ec-4d47-a91a-03513947c247 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:16.200149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1370c-c4ec-4d47-a91a-03513947c247 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:16.200425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1370c-c4ec-4d47-a91a-03513947c247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:16.286344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1370c-c4ec-4d47-a91a-03513947c247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:16.287852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1370c-c4ec-4d47-a91a-03513947c247 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:16.354636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:16.359662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a8a5f-7e96-40bb-9d9a-0f93fb9ebb3b None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:16.360222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a8a5f-7e96-40bb-9d9a-0f93fb9ebb3b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:16.360737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a8a5f-7e96-40bb-9d9a-0f93fb9ebb3b None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:16.363099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 283/550] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:16.371114 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb261-f444-428c-a515-7752add270bb None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:16.371669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb261-f444-428c-a515-7752add270bb None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:16.372145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb261-f444-428c-a515-7752add270bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:16.412070 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-08ecb261-f444-428c-a515-7752add270bb None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:16.413285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-08ecb261-f444-428c-a515-7752add270bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:16.418842 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 268/551] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:16.424570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1370c-c4ec-4d47-a91a-03513947c247 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:16.556258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 284/552] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:52:16.561303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc61bc-749f-4017-9fe9-740c8783c7c8 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:16.561811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc61bc-749f-4017-9fe9-740c8783c7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:16.562423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc61bc-749f-4017-9fe9-740c8783c7c8 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:16.564292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 285/553] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:16.569505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6962c9-8560-46ee-8a28-af63dae9a671 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:16.570022 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6962c9-8560-46ee-8a28-af63dae9a671 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:16.570487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6962c9-8560-46ee-8a28-af63dae9a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:16.596462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1370c-c4ec-4d47-a91a-03513947c247 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:16.599620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-1b6962c9-8560-46ee-8a28-af63dae9a671 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:16.601010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1b6962c9-8560-46ee-8a28-af63dae9a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:16.641049 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69655a5-6e92-48ee-82f9-274372da1cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:16.641859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69655a5-6e92-48ee-82f9-274372da1cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:16.642138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69655a5-6e92-48ee-82f9-274372da1cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:16.642414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69655a5-6e92-48ee-82f9-274372da1cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:16.656605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69655a5-6e92-48ee-82f9-274372da1cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:16.658073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69655a5-6e92-48ee-82f9-274372da1cd7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:16.670701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:16.679262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 286/554] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:52:16.680416 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6962c9-8560-46ee-8a28-af63dae9a671 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-d69655a5-6e92-48ee-82f9-274372da1cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:16.680833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:16.681812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:16.686328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:16.686328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:16.686328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:16.686328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:16.686328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 269/555] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:16.688022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69655a5-6e92-48ee-82f9-274372da1cd7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:16.723931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:16.802880 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69655a5-6e92-48ee-82f9-274372da1cd7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:16.823615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6962c9-8560-46ee-8a28-af63dae9a671 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:16.848855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a246d-c87c-4066-91a7-2f5f3ae08ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:16.849616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a246d-c87c-4066-91a7-2f5f3ae08ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:16.849935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a246d-c87c-4066-91a7-2f5f3ae08ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:16.850216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a246d-c87c-4066-91a7-2f5f3ae08ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:16.851209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a246d-c87c-4066-91a7-2f5f3ae08ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:16.851518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a246d-c87c-4066-91a7-2f5f3ae08ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:16.853580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a246d-c87c-4066-91a7-2f5f3ae08ad8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:16.860116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d5675-1380-41c5-b392-bfb1a3def06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:16.861181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d5675-1380-41c5-b392-bfb1a3def06a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:16.862084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d5675-1380-41c5-b392-bfb1a3def06a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:16.862566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d5675-1380-41c5-b392-bfb1a3def06a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:16.867456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 270/556] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:16.868343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a246d-c87c-4066-91a7-2f5f3ae08ad8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:16.879140 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d5675-1380-41c5-b392-bfb1a3def06a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-624d5675-1380-41c5-b392-bfb1a3def06a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:16.887443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:16.888461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:16.889288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:16.893773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 287/557] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:16.895008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d5675-1380-41c5-b392-bfb1a3def06a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:16.933569 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:16.977930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a246d-c87c-4066-91a7-2f5f3ae08ad8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:16.982627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:17.002191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d5675-1380-41c5-b392-bfb1a3def06a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:17.011215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df4f31-9c78-4fe8-a209-a3f16816331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:17.012025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4f31-9c78-4fe8-a209-a3f16816331b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.012313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4f31-9c78-4fe8-a209-a3f16816331b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.012594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4f31-9c78-4fe8-a209-a3f16816331b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.023227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df4f31-9c78-4fe8-a209-a3f16816331b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-23df4f31-9c78-4fe8-a209-a3f16816331b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:17.030798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:17.032378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 271/558] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:17.033221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df4f31-9c78-4fe8-a209-a3f16816331b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:17.042554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a987fa-b00c-47b7-bddc-9841cbb21375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:17.043685 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a987fa-b00c-47b7-bddc-9841cbb21375 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.044160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a987fa-b00c-47b7-bddc-9841cbb21375 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.044707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a987fa-b00c-47b7-bddc-9841cbb21375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.052294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a987fa-b00c-47b7-bddc-9841cbb21375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:17.054137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a987fa-b00c-47b7-bddc-9841cbb21375 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-84a987fa-b00c-47b7-bddc-9841cbb21375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:17.069105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:17.070103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:17.071270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:17.071270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:17.071270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:17.071270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:17.071270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:17.071270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:17.071270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:17.071270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:17.073336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 288/559] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:17.074705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849d7c3-ed0a-45e3-9cb2-2cb4ad07d248 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.075150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849d7c3-ed0a-45e3-9cb2-2cb4ad07d248 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.075572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849d7c3-ed0a-45e3-9cb2-2cb4ad07d248 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.077039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 289/560] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:17.077843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849d7c3-ed0a-45e3-9cb2-2cb4ad07d248 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:17.146174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df4f31-9c78-4fe8-a209-a3f16816331b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:17.167464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:17.182467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ae7c0-5433-4c0c-804e-c9fd21fed579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:17.183117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae7c0-5433-4c0c-804e-c9fd21fed579 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.183407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae7c0-5433-4c0c-804e-c9fd21fed579 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.183817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae7c0-5433-4c0c-804e-c9fd21fed579 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.184436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ae7c0-5433-4c0c-804e-c9fd21fed579 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:17.184745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ae7c0-5433-4c0c-804e-c9fd21fed579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:17.186217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ae7c0-5433-4c0c-804e-c9fd21fed579 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:17.187349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849d7c3-ed0a-45e3-9cb2-2cb4ad07d248 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:17.198771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 272/561] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:17.198771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ae7c0-5433-4c0c-804e-c9fd21fed579 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:17.228566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3381afb-e1cf-41fd-8c88-df1566b590a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:17.229240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381afb-e1cf-41fd-8c88-df1566b590a9 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.229518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381afb-e1cf-41fd-8c88-df1566b590a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.229792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3381afb-e1cf-41fd-8c88-df1566b590a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.230541 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3381afb-e1cf-41fd-8c88-df1566b590a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:17.230843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3381afb-e1cf-41fd-8c88-df1566b590a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:17.232373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3381afb-e1cf-41fd-8c88-df1566b590a9 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:17.240354 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 290/562] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:17.241577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c8a62-7d69-45c6-8a63-9c7805ccf7c2 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.241860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c8a62-7d69-45c6-8a63-9c7805ccf7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.242133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c8a62-7d69-45c6-8a63-9c7805ccf7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.247871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:17.259118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-9e7c8a62-7d69-45c6-8a63-9c7805ccf7c2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:17.260292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9e7c8a62-7d69-45c6-8a63-9c7805ccf7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:17.307483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ae7c0-5433-4c0c-804e-c9fd21fed579 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:17.343015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 291/563] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:17.343015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c8a62-7d69-45c6-8a63-9c7805ccf7c2 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:17.353873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b48dd-9f07-44ac-adb1-c7cc5d1fb585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:17.354653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b48dd-9f07-44ac-adb1-c7cc5d1fb585 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.355020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b48dd-9f07-44ac-adb1-c7cc5d1fb585 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.355477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b48dd-9f07-44ac-adb1-c7cc5d1fb585 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.356574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b48dd-9f07-44ac-adb1-c7cc5d1fb585 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:17.356834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b48dd-9f07-44ac-adb1-c7cc5d1fb585 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:17.358557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b48dd-9f07-44ac-adb1-c7cc5d1fb585 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:17.372013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 273/564] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:17.373132 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b48dd-9f07-44ac-adb1-c7cc5d1fb585 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:17.421568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:17.449927 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c8a62-7d69-45c6-8a63-9c7805ccf7c2 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:17.484335 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c01402-acd8-4ca5-94b0-4943883d1ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:17.485145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01402-acd8-4ca5-94b0-4943883d1ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.485523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01402-acd8-4ca5-94b0-4943883d1ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.485794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01402-acd8-4ca5-94b0-4943883d1ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.487959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:17.492297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b48dd-9f07-44ac-adb1-c7cc5d1fb585 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:17.506316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c01402-acd8-4ca5-94b0-4943883d1ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:17.507821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c01402-acd8-4ca5-94b0-4943883d1ea5 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-71c01402-acd8-4ca5-94b0-4943883d1ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:17.525260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:17.526231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:17.527161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:17.527161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:17.527161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:17.527161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:17.527161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 292/565] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:17.527852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c01402-acd8-4ca5-94b0-4943883d1ea5 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:17.532574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc61d0e-40eb-41ad-b1cd-a2d742d09a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:17.533389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc61d0e-40eb-41ad-b1cd-a2d742d09a95 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.533665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc61d0e-40eb-41ad-b1cd-a2d742d09a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.533941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc61d0e-40eb-41ad-b1cd-a2d742d09a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.544641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc61d0e-40eb-41ad-b1cd-a2d742d09a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:17.546088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc61d0e-40eb-41ad-b1cd-a2d742d09a95 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-afc61d0e-40eb-41ad-b1cd-a2d742d09a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:17.563685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:17.564713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:17.565624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:17.565624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:17.565624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:17.565624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:17.565624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 274/566] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:17.565917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc61d0e-40eb-41ad-b1cd-a2d742d09a95 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:17.629188 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c01402-acd8-4ca5-94b0-4943883d1ea5 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:17.663101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:17.663589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb27b4-a6be-4bd1-bc1d-82a6dbd6c3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:17.664174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb27b4-a6be-4bd1-bc1d-82a6dbd6c3da None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.664458 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb27b4-a6be-4bd1-bc1d-82a6dbd6c3da None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.664802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb27b4-a6be-4bd1-bc1d-82a6dbd6c3da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.670088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc61d0e-40eb-41ad-b1cd-a2d742d09a95 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:17.675806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb27b4-a6be-4bd1-bc1d-82a6dbd6c3da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-6adb27b4-a6be-4bd1-bc1d-82a6dbd6c3da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:17.683480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:17.684430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:17.685381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 293/567] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:17.686102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6175b-f2f7-40ef-8adf-5904a46276d9 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.686169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6175b-f2f7-40ef-8adf-5904a46276d9 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.686477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6175b-f2f7-40ef-8adf-5904a46276d9 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.687875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 294/568] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:17.688563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6175b-f2f7-40ef-8adf-5904a46276d9 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:17.707474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc859f7-8c82-41f9-919a-797e8c9c7727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:17.708131 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc859f7-8c82-41f9-919a-797e8c9c7727 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.708417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc859f7-8c82-41f9-919a-797e8c9c7727 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.708698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc859f7-8c82-41f9-919a-797e8c9c7727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.709529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc859f7-8c82-41f9-919a-797e8c9c7727 None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=d585280109eb4773adf7d56fd722a4b4) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:17.709849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc859f7-8c82-41f9-919a-797e8c9c7727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:17.711322 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc859f7-8c82-41f9-919a-797e8c9c7727 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:17.716863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 275/569] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:17 2022] GET /identity/v3/role_assignments?user.id=d585280109eb4773adf7d56fd722a4b4&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:17.717653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc859f7-8c82-41f9-919a-797e8c9c7727 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:17.739678 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:17.805047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6175b-f2f7-40ef-8adf-5904a46276d9 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:17.845508 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f7bbd-47db-4d39-a2ae-038eb962c54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:17.846226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f7bbd-47db-4d39-a2ae-038eb962c54c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.846582 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f7bbd-47db-4d39-a2ae-038eb962c54c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.847124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f7bbd-47db-4d39-a2ae-038eb962c54c None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.847871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f7bbd-47db-4d39-a2ae-038eb962c54c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:17.848184 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f7bbd-47db-4d39-a2ae-038eb962c54c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:17.849616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f7bbd-47db-4d39-a2ae-038eb962c54c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:17.851373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc859f7-8c82-41f9-919a-797e8c9c7727 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:17.867646 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 295/570] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:17.867646 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f7bbd-47db-4d39-a2ae-038eb962c54c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:17.906262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2067d13-cbb9-4192-9baa-8c4a1c8fdda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:17.906935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2067d13-cbb9-4192-9baa-8c4a1c8fdda6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.907262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2067d13-cbb9-4192-9baa-8c4a1c8fdda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.907536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2067d13-cbb9-4192-9baa-8c4a1c8fdda6 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.908253 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2067d13-cbb9-4192-9baa-8c4a1c8fdda6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:17.908566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2067d13-cbb9-4192-9baa-8c4a1c8fdda6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:17.910391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2067d13-cbb9-4192-9baa-8c4a1c8fdda6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:17.923191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 276/571] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:17.924419 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef87af-5d14-44bf-bbfe-8e98c20c21c4 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:17.924707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef87af-5d14-44bf-bbfe-8e98c20c21c4 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:17.924982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef87af-5d14-44bf-bbfe-8e98c20c21c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:17.942381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2bef87af-5d14-44bf-bbfe-8e98c20c21c4 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:17.943593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2bef87af-5d14-44bf-bbfe-8e98c20c21c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:17.956423 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:17.975970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f7bbd-47db-4d39-a2ae-038eb962c54c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:17.984780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:18.019151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 277/572] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:18.019151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef87af-5d14-44bf-bbfe-8e98c20c21c4 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.020321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43bd2b-2b31-401d-bcef-6260edca4d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:18.021158 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43bd2b-2b31-401d-bcef-6260edca4d76 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:18.021437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43bd2b-2b31-401d-bcef-6260edca4d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:18.021709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43bd2b-2b31-401d-bcef-6260edca4d76 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:18.022466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43bd2b-2b31-401d-bcef-6260edca4d76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:18.022820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43bd2b-2b31-401d-bcef-6260edca4d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:18.024265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43bd2b-2b31-401d-bcef-6260edca4d76 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:18.039057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 296/573] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:18.039963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43bd2b-2b31-401d-bcef-6260edca4d76 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.124336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef87af-5d14-44bf-bbfe-8e98c20c21c4 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:18.143540 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43bd2b-2b31-401d-bcef-6260edca4d76 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:18.167749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849bc43-c461-4718-95bf-d582b2558e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:18.168553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849bc43-c461-4718-95bf-d582b2558e55 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:18.169135 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849bc43-c461-4718-95bf-d582b2558e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:18.169407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849bc43-c461-4718-95bf-d582b2558e55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:18.176732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849bc43-c461-4718-95bf-d582b2558e55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:18.178209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849bc43-c461-4718-95bf-d582b2558e55 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:18.182063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f625d-984a-49eb-8eae-f3ea8bed676a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:18.183216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f625d-984a-49eb-8eae-f3ea8bed676a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:18.183695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f625d-984a-49eb-8eae-f3ea8bed676a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:18.184174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f625d-984a-49eb-8eae-f3ea8bed676a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:18.192288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f625d-984a-49eb-8eae-f3ea8bed676a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-6849bc43-c461-4718-95bf-d582b2558e55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:18.192436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:18.193501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:18.194486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:18.194486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:18.194486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:18.194486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:18.194486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:18.194486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:18.194486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:18.194486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:18.194486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:18.194486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:18.194486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 278/574] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:18.195103 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849bc43-c461-4718-95bf-d582b2558e55 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.196712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f625d-984a-49eb-8eae-f3ea8bed676a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:18.209382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-de1f625d-984a-49eb-8eae-f3ea8bed676a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:18.212660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:18.213606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:18.214547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:18.214547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:18.214547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:18.214547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:18.214547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:18.214547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:18.214547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:18.214547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:18.214547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 26 02:52:18.214547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:18.214547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 297/575] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:18.215644 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f625d-984a-49eb-8eae-f3ea8bed676a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.244099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:18.313639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849bc43-c461-4718-95bf-d582b2558e55 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:18.316120 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f625d-984a-49eb-8eae-f3ea8bed676a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:18.351598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010c42c-a0c1-4863-8055-de541fed873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:18.352427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c42c-a0c1-4863-8055-de541fed873b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:18.352707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c42c-a0c1-4863-8055-de541fed873b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:18.353001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c42c-a0c1-4863-8055-de541fed873b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:18.354242 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80925f96-a3d6-416a-abf2-fbe932b2561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:18.355238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80925f96-a3d6-416a-abf2-fbe932b2561c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:18.355668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80925f96-a3d6-416a-abf2-fbe932b2561c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:18.355944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80925f96-a3d6-416a-abf2-fbe932b2561c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:18.364211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010c42c-a0c1-4863-8055-de541fed873b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:18.365665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010c42c-a0c1-4863-8055-de541fed873b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:18.366386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80925f96-a3d6-416a-abf2-fbe932b2561c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-80925f96-a3d6-416a-abf2-fbe932b2561c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:18.374152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:18.375147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:18.376008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 279/576] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:18.376702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80925f96-a3d6-416a-abf2-fbe932b2561c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-4010c42c-a0c1-4863-8055-de541fed873b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:18.389730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:18.390817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:18.391972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:18.391972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:18.391972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:18.391972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:18.392757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 298/577] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:18.393594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010c42c-a0c1-4863-8055-de541fed873b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.452402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:18.488607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:18.493773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80925f96-a3d6-416a-abf2-fbe932b2561c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:18.511576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010c42c-a0c1-4863-8055-de541fed873b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:18.529362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8a6f7-54d6-445b-bfd7-1c255bbaa4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:18.530029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8a6f7-54d6-445b-bfd7-1c255bbaa4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:18.530308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8a6f7-54d6-445b-bfd7-1c255bbaa4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:18.530579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8a6f7-54d6-445b-bfd7-1c255bbaa4e3 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:18.531453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8a6f7-54d6-445b-bfd7-1c255bbaa4e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:18.531763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8a6f7-54d6-445b-bfd7-1c255bbaa4e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:18.533187 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8a6f7-54d6-445b-bfd7-1c255bbaa4e3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:18.549498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2494d-4940-4a92-a157-20ea1edb07e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:18.550198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 280/578] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:18.550590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2494d-4940-4a92-a157-20ea1edb07e2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:18.551003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8a6f7-54d6-445b-bfd7-1c255bbaa4e3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.551244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2494d-4940-4a92-a157-20ea1edb07e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:18.551742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2494d-4940-4a92-a157-20ea1edb07e2 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:18.552597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2494d-4940-4a92-a157-20ea1edb07e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:18.552957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2494d-4940-4a92-a157-20ea1edb07e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:18.554416 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2494d-4940-4a92-a157-20ea1edb07e2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:18.573820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 299/579] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:18.574942 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2494d-4940-4a92-a157-20ea1edb07e2 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.662173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8a6f7-54d6-445b-bfd7-1c255bbaa4e3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:18.681619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2494d-4940-4a92-a157-20ea1edb07e2 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:18.687895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:18.697827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47be52c-0606-412b-8b21-5f26672aea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:18.698471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47be52c-0606-412b-8b21-5f26672aea09 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:18.698753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47be52c-0606-412b-8b21-5f26672aea09 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:18.699055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47be52c-0606-412b-8b21-5f26672aea09 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:18.699803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47be52c-0606-412b-8b21-5f26672aea09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:18.700107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47be52c-0606-412b-8b21-5f26672aea09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:18.701757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47be52c-0606-412b-8b21-5f26672aea09 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:18.709797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 281/580] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:18.714929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47be52c-0606-412b-8b21-5f26672aea09 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.719397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d9fc2-83b6-4d70-9dd5-12920c9f62fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:18.720073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9fc2-83b6-4d70-9dd5-12920c9f62fc None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:18.720358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9fc2-83b6-4d70-9dd5-12920c9f62fc None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:18.720663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9fc2-83b6-4d70-9dd5-12920c9f62fc None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:18.721397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d9fc2-83b6-4d70-9dd5-12920c9f62fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:18.721704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d9fc2-83b6-4d70-9dd5-12920c9f62fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:18.723143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d9fc2-83b6-4d70-9dd5-12920c9f62fc None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:18.730264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:18.736533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 300/581] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:18.737222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d9fc2-83b6-4d70-9dd5-12920c9f62fc None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.825034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47be52c-0606-412b-8b21-5f26672aea09 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:18.844033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d9fc2-83b6-4d70-9dd5-12920c9f62fc None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:18.861948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad6c9-7149-4c1e-8aec-ebbe07830c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:18.862753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad6c9-7149-4c1e-8aec-ebbe07830c39 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:18.863065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad6c9-7149-4c1e-8aec-ebbe07830c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:18.863345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad6c9-7149-4c1e-8aec-ebbe07830c39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:18.874879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad6c9-7149-4c1e-8aec-ebbe07830c39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:18.876838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fba29-889f-4ecc-ac5f-6743303072c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:18.878555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad6c9-7149-4c1e-8aec-ebbe07830c39 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:18.878666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fba29-889f-4ecc-ac5f-6743303072c3 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:18.878666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fba29-889f-4ecc-ac5f-6743303072c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:18.878666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fba29-889f-4ecc-ac5f-6743303072c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:18.890567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fba29-889f-4ecc-ac5f-6743303072c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:18.892069 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fba29-889f-4ecc-ac5f-6743303072c3 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-52aad6c9-7149-4c1e-8aec-ebbe07830c39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:18.897229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:18.898108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:18.898973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:18.898973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:18.898973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:18.898973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:18.898973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 282/582] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:18.899825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad6c9-7149-4c1e-8aec-ebbe07830c39 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-da3fba29-889f-4ecc-ac5f-6743303072c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:18.913681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:18.914565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:18.916013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:18.916013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:18.916013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:18.916013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:18.916013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 301/583] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:18.916013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fba29-889f-4ecc-ac5f-6743303072c3 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:18.949980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:18.970065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:19.014700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad6c9-7149-4c1e-8aec-ebbe07830c39 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.021186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fba29-889f-4ecc-ac5f-6743303072c3 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.048277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f695b47-c764-455d-adcc-034de14db805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.049075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695b47-c764-455d-adcc-034de14db805 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.049357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695b47-c764-455d-adcc-034de14db805 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.049631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695b47-c764-455d-adcc-034de14db805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.055364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3379e8b-16f2-48df-afdf-445f7ead16a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.056169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3379e8b-16f2-48df-afdf-445f7ead16a0 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.056455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3379e8b-16f2-48df-afdf-445f7ead16a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.056740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3379e8b-16f2-48df-afdf-445f7ead16a0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.060593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f695b47-c764-455d-adcc-034de14db805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.062036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f695b47-c764-455d-adcc-034de14db805 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.064918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3379e8b-16f2-48df-afdf-445f7ead16a0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.066367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3379e8b-16f2-48df-afdf-445f7ead16a0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5f695b47-c764-455d-adcc-034de14db805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:19.079535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:19.080389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:19.081251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:19.081251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:19.081251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:19.081251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-f3379e8b-16f2-48df-afdf-445f7ead16a0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:19.081485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:19.082320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 302/584] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:19.083288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3379e8b-16f2-48df-afdf-445f7ead16a0 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.086118 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 283/585] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:19.086963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f695b47-c764-455d-adcc-034de14db805 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.179506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:19.189221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3379e8b-16f2-48df-afdf-445f7ead16a0 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.189496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f695b47-c764-455d-adcc-034de14db805 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.200269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:19.224655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b12e0a-5a5e-438b-902d-1968d0d0deee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.225175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb784be1-9719-42e4-84bc-e828658806ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.225326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b12e0a-5a5e-438b-902d-1968d0d0deee None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.225603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b12e0a-5a5e-438b-902d-1968d0d0deee None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.225903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b12e0a-5a5e-438b-902d-1968d0d0deee None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.226007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb784be1-9719-42e4-84bc-e828658806ef None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.226254 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb784be1-9719-42e4-84bc-e828658806ef None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.226490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb784be1-9719-42e4-84bc-e828658806ef None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.226718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b12e0a-5a5e-438b-902d-1968d0d0deee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:19.227059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b12e0a-5a5e-438b-902d-1968d0d0deee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.227494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb784be1-9719-42e4-84bc-e828658806ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:19.227758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb784be1-9719-42e4-84bc-e828658806ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.228519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b12e0a-5a5e-438b-902d-1968d0d0deee None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.229378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb784be1-9719-42e4-84bc-e828658806ef None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.249452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 284/586] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:19.249452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b12e0a-5a5e-438b-902d-1968d0d0deee None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.249739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 303/587] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:19.249739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb784be1-9719-42e4-84bc-e828658806ef None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.347904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b12e0a-5a5e-438b-902d-1968d0d0deee None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.353699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb784be1-9719-42e4-84bc-e828658806ef None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.381193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5b7e-6612-44d0-b898-e47bd197cdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.381864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5b7e-6612-44d0-b898-e47bd197cdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.382141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5b7e-6612-44d0-b898-e47bd197cdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.382401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd5b7e-6612-44d0-b898-e47bd197cdf5 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.383280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd5b7e-6612-44d0-b898-e47bd197cdf5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:19.383584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd5b7e-6612-44d0-b898-e47bd197cdf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.385022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd5b7e-6612-44d0-b898-e47bd197cdf5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.390565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb6911-2f5d-418f-9b06-af32aa84e228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.391265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb6911-2f5d-418f-9b06-af32aa84e228 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.391537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb6911-2f5d-418f-9b06-af32aa84e228 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.391819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb6911-2f5d-418f-9b06-af32aa84e228 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.392563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb6911-2f5d-418f-9b06-af32aa84e228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:19.392875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb6911-2f5d-418f-9b06-af32aa84e228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.394498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb6911-2f5d-418f-9b06-af32aa84e228 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.404376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 285/588] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:19.405425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5b7e-6612-44d0-b898-e47bd197cdf5 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.409060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 304/589] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:19.409895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb6911-2f5d-418f-9b06-af32aa84e228 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.422194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:19.442792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:19.518218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb6911-2f5d-418f-9b06-af32aa84e228 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.525647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd5b7e-6612-44d0-b898-e47bd197cdf5 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.558557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bf3b8-c5d0-44ca-9f75-ed68e35fa05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.559748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bf3b8-c5d0-44ca-9f75-ed68e35fa05e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.560235 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bf3b8-c5d0-44ca-9f75-ed68e35fa05e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.560679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bf3b8-c5d0-44ca-9f75-ed68e35fa05e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.561435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f636b0d-8adc-46bc-9cc0-2e37ce5630f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.562240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f636b0d-8adc-46bc-9cc0-2e37ce5630f5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.562517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f636b0d-8adc-46bc-9cc0-2e37ce5630f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.562788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f636b0d-8adc-46bc-9cc0-2e37ce5630f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.569216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bf3b8-c5d0-44ca-9f75-ed68e35fa05e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.570257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f636b0d-8adc-46bc-9cc0-2e37ce5630f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.570699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bf3b8-c5d0-44ca-9f75-ed68e35fa05e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.571894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f636b0d-8adc-46bc-9cc0-2e37ce5630f5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-7e3bf3b8-c5d0-44ca-9f75-ed68e35fa05e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:19.585203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:19.586081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:19.586945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:19.586945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:19.586945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:19.586945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:19.586945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:19.586945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:19.586945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:19.586945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5f636b0d-8adc-46bc-9cc0-2e37ce5630f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:19.587898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:19.589081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:19.590171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:19.590171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:19.590171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:19.590171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:19.590171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:19.590171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:19.590171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:19.590171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:19.590171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 286/590] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:19.590171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f636b0d-8adc-46bc-9cc0-2e37ce5630f5 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.594449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 305/591] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:19.594449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bf3b8-c5d0-44ca-9f75-ed68e35fa05e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.667373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:19.689672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:19.701985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bf3b8-c5d0-44ca-9f75-ed68e35fa05e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.703057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f636b0d-8adc-46bc-9cc0-2e37ce5630f5 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.736699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05733427-2e1f-4068-b59f-fe39d932ac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.737499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05733427-2e1f-4068-b59f-fe39d932ac0f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.737780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05733427-2e1f-4068-b59f-fe39d932ac0f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.738049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc5d4f-8019-46ba-9280-c2854b017dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.738158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05733427-2e1f-4068-b59f-fe39d932ac0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.738845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc5d4f-8019-46ba-9280-c2854b017dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.739161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc5d4f-8019-46ba-9280-c2854b017dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.739460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc5d4f-8019-46ba-9280-c2854b017dd8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.746299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc5d4f-8019-46ba-9280-c2854b017dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.747882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc5d4f-8019-46ba-9280-c2854b017dd8 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.748668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05733427-2e1f-4068-b59f-fe39d932ac0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.750107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05733427-2e1f-4068-b59f-fe39d932ac0f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-c9dc5d4f-8019-46ba-9280-c2854b017dd8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:19.761844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:19.762956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:19.764157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:19.764157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:19.764157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:19.764157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:19.764157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:19.764157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:19.764157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:19.764157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:19.764157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 26 02:52:19.764157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:19.764157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 306/592] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:19.764759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc5d4f-8019-46ba-9280-c2854b017dd8 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-05733427-2e1f-4068-b59f-fe39d932ac0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:19.769387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:19.770418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:19.771306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:19.771306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:19.771306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:19.771306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:19.771306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 287/593] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:19.771591 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05733427-2e1f-4068-b59f-fe39d932ac0f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.863632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc5d4f-8019-46ba-9280-c2854b017dd8 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.868898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05733427-2e1f-4068-b59f-fe39d932ac0f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:19.890024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:19.897885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bbc37-b414-4b9a-b87d-c3d6b3ab778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.898546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bbc37-b414-4b9a-b87d-c3d6b3ab778c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.898836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bbc37-b414-4b9a-b87d-c3d6b3ab778c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.899146 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bbc37-b414-4b9a-b87d-c3d6b3ab778c None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.899941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bbc37-b414-4b9a-b87d-c3d6b3ab778c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:19.900252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bbc37-b414-4b9a-b87d-c3d6b3ab778c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.901614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ccea8-f6d1-48c5-b21a-91683f17aae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:19.901723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bbc37-b414-4b9a-b87d-c3d6b3ab778c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.902270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ccea8-f6d1-48c5-b21a-91683f17aae7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.902550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ccea8-f6d1-48c5-b21a-91683f17aae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.902826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ccea8-f6d1-48c5-b21a-91683f17aae7 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.903848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ccea8-f6d1-48c5-b21a-91683f17aae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:19.904243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ccea8-f6d1-48c5-b21a-91683f17aae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:19.906024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ccea8-f6d1-48c5-b21a-91683f17aae7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:19.919091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 288/595] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:19.919236 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 307/595] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:19.920401 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dafe9-3286-4f3a-929e-2e67b7978803 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:19.920689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dafe9-3286-4f3a-929e-2e67b7978803 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:19.920968 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dafe9-3286-4f3a-929e-2e67b7978803 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:19.921623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ccea8-f6d1-48c5-b21a-91683f17aae7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.924303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 308/596] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:19.924303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dafe9-3286-4f3a-929e-2e67b7978803 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:19.935920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:20.022049 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ccea8-f6d1-48c5-b21a-91683f17aae7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:20.022250 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dafe9-3286-4f3a-929e-2e67b7978803 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:20.054879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300679e8-c07d-474f-8582-cf9e2e6a5305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:20.055629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300679e8-c07d-474f-8582-cf9e2e6a5305 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:20.055918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300679e8-c07d-474f-8582-cf9e2e6a5305 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:20.056191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300679e8-c07d-474f-8582-cf9e2e6a5305 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:20.056524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414223c-43e4-420d-92ee-2007fbf28d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:20.056912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300679e8-c07d-474f-8582-cf9e2e6a5305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:20.057200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414223c-43e4-420d-92ee-2007fbf28d10 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:20.057300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300679e8-c07d-474f-8582-cf9e2e6a5305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:20.057482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414223c-43e4-420d-92ee-2007fbf28d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:20.057761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414223c-43e4-420d-92ee-2007fbf28d10 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:20.058595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300679e8-c07d-474f-8582-cf9e2e6a5305 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:20.058688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414223c-43e4-420d-92ee-2007fbf28d10 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:20.058936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414223c-43e4-420d-92ee-2007fbf28d10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:20.060421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414223c-43e4-420d-92ee-2007fbf28d10 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:20.069453 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 309/597] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:20.070204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300679e8-c07d-474f-8582-cf9e2e6a5305 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:20.082625 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 289/598] 10.222.0.36 () {56 vars in 1139 bytes} [Sun Jun 26 02:52:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:20.083472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414223c-43e4-420d-92ee-2007fbf28d10 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:20.123792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:20.136427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:20.167213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300679e8-c07d-474f-8582-cf9e2e6a5305 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:20.181707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414223c-43e4-420d-92ee-2007fbf28d10 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:20.200105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07552a5-6c25-4e70-826b-7b766cf7a599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:20.201069 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07552a5-6c25-4e70-826b-7b766cf7a599 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:20.201342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07552a5-6c25-4e70-826b-7b766cf7a599 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:20.201614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07552a5-6c25-4e70-826b-7b766cf7a599 None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/24319e5e83ed4caf9dd3ae4b3937b3fb/roles/cd3a257aec1b4b1694563a46b1e71a03` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:20.216921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07552a5-6c25-4e70-826b-7b766cf7a599 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=24319e5e83ed4caf9dd3ae4b3937b3fb, role_id=cd3a257aec1b4b1694563a46b1e71a03)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:20.218386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07552a5-6c25-4e70-826b-7b766cf7a599 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:20.220800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81090bcc-ce87-465f-852c-e7b48bdba9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:20.221699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81090bcc-ce87-465f-852c-e7b48bdba9fc None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:20.221965 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81090bcc-ce87-465f-852c-e7b48bdba9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:20.222296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81090bcc-ce87-465f-852c-e7b48bdba9fc None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/250c47daff26400c96a6b467d7cf5432/roles/cd3a257aec1b4b1694563a46b1e71a03` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:20.231590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 310/599] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:52:20 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/24319e5e83ed4caf9dd3ae4b3937b3fb/roles/cd3a257aec1b4b1694563a46b1e71a03 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:52:20.233127 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41c619-ad4d-449c-b26b-9529880656be None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:20.233411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41c619-ad4d-449c-b26b-9529880656be None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:20.233689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41c619-ad4d-449c-b26b-9529880656be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:20.246502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81090bcc-ce87-465f-852c-e7b48bdba9fc None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=250c47daff26400c96a6b467d7cf5432, role_id=cd3a257aec1b4b1694563a46b1e71a03)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:20.248412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81090bcc-ce87-465f-852c-e7b48bdba9fc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:20.250298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ed41c619-ad4d-449c-b26b-9529880656be None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:20.251571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ed41c619-ad4d-449c-b26b-9529880656be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:20.265170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 290/600] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:52:20 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/250c47daff26400c96a6b467d7cf5432/roles/cd3a257aec1b4b1694563a46b1e71a03 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:52:20.266457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81090bcc-ce87-465f-852c-e7b48bdba9fc None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:20.360828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 311/601] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:20.361758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41c619-ad4d-449c-b26b-9529880656be None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:20.394557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:20.410509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81090bcc-ce87-465f-852c-e7b48bdba9fc None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:20.435321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:20.461401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37acf52-a6e0-44b8-bd92-7f3bbd145bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:20.462208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37acf52-a6e0-44b8-bd92-7f3bbd145bbc None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:20.462487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37acf52-a6e0-44b8-bd92-7f3bbd145bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:20.462763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37acf52-a6e0-44b8-bd92-7f3bbd145bbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:20.470853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37acf52-a6e0-44b8-bd92-7f3bbd145bbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:20.472173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37acf52-a6e0-44b8-bd92-7f3bbd145bbc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b37acf52-a6e0-44b8-bd92-7f3bbd145bbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:20.490391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:20.491584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:20.492551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:20.492551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:20.492551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:20.492551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:20.492551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:20.492551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:20.492551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:20.492551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:20.492551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 291/602] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:20.493116 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37acf52-a6e0-44b8-bd92-7f3bbd145bbc None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:20.505032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41c619-ad4d-449c-b26b-9529880656be None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:20.552037 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e58d9-a28e-49ce-922f-ed1b1838d287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:20.553150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e58d9-a28e-49ce-922f-ed1b1838d287 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:20.553602 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e58d9-a28e-49ce-922f-ed1b1838d287 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:20.554045 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e58d9-a28e-49ce-922f-ed1b1838d287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:20.565470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e58d9-a28e-49ce-922f-ed1b1838d287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:20.567328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e58d9-a28e-49ce-922f-ed1b1838d287 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-d19e58d9-a28e-49ce-922f-ed1b1838d287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:20.587840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:20.588805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:20.589680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:20.589680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:20.589680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:20.589680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:20.592096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 312/603] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:20.593203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e58d9-a28e-49ce-922f-ed1b1838d287 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:20.626245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37acf52-a6e0-44b8-bd92-7f3bbd145bbc None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:20.662036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8360806-20aa-44cc-baff-37b2d3d6a2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:20.663234 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8360806-20aa-44cc-baff-37b2d3d6a2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:20.663813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8360806-20aa-44cc-baff-37b2d3d6a2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:20.664278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8360806-20aa-44cc-baff-37b2d3d6a2f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:20.675550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8360806-20aa-44cc-baff-37b2d3d6a2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b8360806-20aa-44cc-baff-37b2d3d6a2f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:20.683521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:20.684463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:20.685410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:20.688355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 292/604] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:20.689472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8360806-20aa-44cc-baff-37b2d3d6a2f8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:20.706337 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:20.716072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e58d9-a28e-49ce-922f-ed1b1838d287 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:20.718398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:20.754622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75203b7e-8d80-46e1-a381-2c1e24f72bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:20.755816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203b7e-8d80-46e1-a381-2c1e24f72bdd None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:20.756292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203b7e-8d80-46e1-a381-2c1e24f72bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:20.756823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75203b7e-8d80-46e1-a381-2c1e24f72bdd None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:20.757807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75203b7e-8d80-46e1-a381-2c1e24f72bdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:20.758303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75203b7e-8d80-46e1-a381-2c1e24f72bdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:20.760102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75203b7e-8d80-46e1-a381-2c1e24f72bdd None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:20.779138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 313/605] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:20.780311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75203b7e-8d80-46e1-a381-2c1e24f72bdd None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:20.821308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8360806-20aa-44cc-baff-37b2d3d6a2f8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:20.858102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5624be5-6768-4182-bd40-1ae300441a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:20.858778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5624be5-6768-4182-bd40-1ae300441a98 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:20.859094 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5624be5-6768-4182-bd40-1ae300441a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:20.859379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5624be5-6768-4182-bd40-1ae300441a98 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:20.860214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5624be5-6768-4182-bd40-1ae300441a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:20.860684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5624be5-6768-4182-bd40-1ae300441a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:20.862180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5624be5-6768-4182-bd40-1ae300441a98 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:20.875632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 293/606] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:20.876592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5624be5-6768-4182-bd40-1ae300441a98 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:20.887265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75203b7e-8d80-46e1-a381-2c1e24f72bdd None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:20.921974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10832c1d-fc56-475c-9a0e-c7f157765620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:20.922651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10832c1d-fc56-475c-9a0e-c7f157765620 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:20.922934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10832c1d-fc56-475c-9a0e-c7f157765620 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:20.923343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10832c1d-fc56-475c-9a0e-c7f157765620 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:20.924110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10832c1d-fc56-475c-9a0e-c7f157765620 None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:20.924419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10832c1d-fc56-475c-9a0e-c7f157765620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:20.925913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10832c1d-fc56-475c-9a0e-c7f157765620 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:20.934840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 314/607] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:20.935727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10832c1d-fc56-475c-9a0e-c7f157765620 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:20.955240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:20.967117 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:20.990789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5624be5-6768-4182-bd40-1ae300441a98 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:21.027623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a83bd-c1fe-4474-bf93-a4d531f1c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:21.028535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a83bd-c1fe-4474-bf93-a4d531f1c9cd None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:21.028883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a83bd-c1fe-4474-bf93-a4d531f1c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:21.029175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a83bd-c1fe-4474-bf93-a4d531f1c9cd None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/892be7ed998840de8b325316db3fdde4/roles/cd3a257aec1b4b1694563a46b1e71a03` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:21.045624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a83bd-c1fe-4474-bf93-a4d531f1c9cd None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=892be7ed998840de8b325316db3fdde4, role_id=cd3a257aec1b4b1694563a46b1e71a03)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:21.046848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10832c1d-fc56-475c-9a0e-c7f157765620 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:21.047098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a83bd-c1fe-4474-bf93-a4d531f1c9cd None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:21.071315 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 294/608] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:52:20 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/892be7ed998840de8b325316db3fdde4/roles/cd3a257aec1b4b1694563a46b1e71a03 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:52:21.072258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a83bd-c1fe-4474-bf93-a4d531f1c9cd None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:21.094852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3ee42-2d33-46d1-84bc-c12c75a3301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:21.096052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ee42-2d33-46d1-84bc-c12c75a3301a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:21.096484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ee42-2d33-46d1-84bc-c12c75a3301a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:21.096900 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ee42-2d33-46d1-84bc-c12c75a3301a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:21.105414 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3ee42-2d33-46d1-84bc-c12c75a3301a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:21.116709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3ee42-2d33-46d1-84bc-c12c75a3301a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-61e3ee42-2d33-46d1-84bc-c12c75a3301a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:21.144877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:21.146103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:21.147286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:21.147286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:21.147286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:21.147286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:21.147286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:21.147286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:21.147286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:21.147286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:21.149473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 315/609] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:21.155980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3ee42-2d33-46d1-84bc-c12c75a3301a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:21.190901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a83bd-c1fe-4474-bf93-a4d531f1c9cd None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:21.219372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:21.232585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a4aab-99c8-4620-adeb-f6af2fe99621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:21.233523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a4aab-99c8-4620-adeb-f6af2fe99621 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:21.234324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a4aab-99c8-4620-adeb-f6af2fe99621 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:21.234615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a4aab-99c8-4620-adeb-f6af2fe99621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:21.261102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a4aab-99c8-4620-adeb-f6af2fe99621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:21.265432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a4aab-99c8-4620-adeb-f6af2fe99621 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-750a4aab-99c8-4620-adeb-f6af2fe99621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:21.303307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:21.304252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:21.305137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:21.305137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:21.305137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:21.305137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:21.307231 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 295/610] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:21.322455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a4aab-99c8-4620-adeb-f6af2fe99621 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:21.324046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:21.344385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3ee42-2d33-46d1-84bc-c12c75a3301a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:21.387398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dbca0-c67a-4350-9a17-438447e54658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:21.388672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dbca0-c67a-4350-9a17-438447e54658 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:21.389075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dbca0-c67a-4350-9a17-438447e54658 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:21.389707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dbca0-c67a-4350-9a17-438447e54658 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:21.390592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dbca0-c67a-4350-9a17-438447e54658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:21.390996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dbca0-c67a-4350-9a17-438447e54658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:21.392530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dbca0-c67a-4350-9a17-438447e54658 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:21.406698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 316/611] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:21.413069 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dbca0-c67a-4350-9a17-438447e54658 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:21.505040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a4aab-99c8-4620-adeb-f6af2fe99621 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:21.533085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dbca0-c67a-4350-9a17-438447e54658 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:21.579836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dad6fd-3881-4134-b277-6fddc4d2dbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:21.580987 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dad6fd-3881-4134-b277-6fddc4d2dbdd None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:21.581567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dad6fd-3881-4134-b277-6fddc4d2dbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:21.581849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dad6fd-3881-4134-b277-6fddc4d2dbdd None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:21.582576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dad6fd-3881-4134-b277-6fddc4d2dbdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:21.582894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dad6fd-3881-4134-b277-6fddc4d2dbdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:21.584417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dad6fd-3881-4134-b277-6fddc4d2dbdd None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:21.589861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04013-d6c1-4c8a-8907-dc78c25098d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:21.591078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04013-d6c1-4c8a-8907-dc78c25098d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:21.591598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04013-d6c1-4c8a-8907-dc78c25098d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:21.592066 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04013-d6c1-4c8a-8907-dc78c25098d7 None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/4169682bfc5043a3a3d4c638dae2a3bc/roles/cd3a257aec1b4b1694563a46b1e71a03` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:21.605393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 296/612] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:21.607854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d04013-d6c1-4c8a-8907-dc78c25098d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=4169682bfc5043a3a3d4c638dae2a3bc, role_id=cd3a257aec1b4b1694563a46b1e71a03)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:21.609857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d04013-d6c1-4c8a-8907-dc78c25098d7 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:21.610668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dad6fd-3881-4134-b277-6fddc4d2dbdd None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:21.612724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:21.639131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 317/613] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:52:21 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/4169682bfc5043a3a3d4c638dae2a3bc/roles/cd3a257aec1b4b1694563a46b1e71a03 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 02:52:21.647776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:21.720987 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dad6fd-3881-4134-b277-6fddc4d2dbdd None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:21.757605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794903e-b1eb-4357-a40b-a5200c343805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:21.758427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794903e-b1eb-4357-a40b-a5200c343805 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:21.758709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794903e-b1eb-4357-a40b-a5200c343805 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:21.759001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794903e-b1eb-4357-a40b-a5200c343805 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:21.768035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794903e-b1eb-4357-a40b-a5200c343805 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:21.769548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794903e-b1eb-4357-a40b-a5200c343805 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5794903e-b1eb-4357-a40b-a5200c343805 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:21.785075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:21.786069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:21.787475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:21.787475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:21.787475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:21.787475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:21.787475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:21.787475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:21.787475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:21.787475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:21.787475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:21.787475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:21.787475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 297/614] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:21.792873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04013-d6c1-4c8a-8907-dc78c25098d7 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:21.920264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04013-d6c1-4c8a-8907-dc78c25098d7 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:21.965735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1811ced-21b7-4481-9b5b-d2690d52a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:21.967096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1811ced-21b7-4481-9b5b-d2690d52a5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:21.967606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1811ced-21b7-4481-9b5b-d2690d52a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:21.968089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1811ced-21b7-4481-9b5b-d2690d52a5f0 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:21.969143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1811ced-21b7-4481-9b5b-d2690d52a5f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:21.969652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1811ced-21b7-4481-9b5b-d2690d52a5f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:21.971397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1811ced-21b7-4481-9b5b-d2690d52a5f0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:21.998805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 318/615] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Jun 26 02:52:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:22.003965 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794903e-b1eb-4357-a40b-a5200c343805 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:22.174711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:22.187805 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794903e-b1eb-4357-a40b-a5200c343805 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:22.243233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51431d7e-de6b-40ed-9904-c865e2da5b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:22.243959 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431d7e-de6b-40ed-9904-c865e2da5b45 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:22.244247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431d7e-de6b-40ed-9904-c865e2da5b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:22.244579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431d7e-de6b-40ed-9904-c865e2da5b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:22.258662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51431d7e-de6b-40ed-9904-c865e2da5b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:22.260225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51431d7e-de6b-40ed-9904-c865e2da5b45 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-51431d7e-de6b-40ed-9904-c865e2da5b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:22.282712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:22.283662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:22.285215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:22.285215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:22.285215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:22.285215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:22.285215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 298/616] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:22.289562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1811ced-21b7-4481-9b5b-d2690d52a5f0 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:22.382904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:22.444309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1811ced-21b7-4481-9b5b-d2690d52a5f0 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:22.498210 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6434e-21e5-4cfe-a6b5-92a780f63ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:22.498806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6434e-21e5-4cfe-a6b5-92a780f63ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:22.499141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6434e-21e5-4cfe-a6b5-92a780f63ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:22.499421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6434e-21e5-4cfe-a6b5-92a780f63ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:22.500155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6434e-21e5-4cfe-a6b5-92a780f63ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:22.500459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6434e-21e5-4cfe-a6b5-92a780f63ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:22.507016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6434e-21e5-4cfe-a6b5-92a780f63ca1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:22.518098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1b13-acff-4c23-9e77-da0e447a7081 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:22.518384 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1b13-acff-4c23-9e77-da0e447a7081 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:22.518666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1b13-acff-4c23-9e77-da0e447a7081 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:22.520339 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 299/617] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:22.521407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548279-ab28-4781-8bb4-e1fc71177c3c None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:22.521693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548279-ab28-4781-8bb4-e1fc71177c3c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:22.521974 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548279-ab28-4781-8bb4-e1fc71177c3c None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:22.524172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 300/618] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:22.525645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dab28-7759-4074-98a1-eeb7fef21c14 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:22.525935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dab28-7759-4074-98a1-eeb7fef21c14 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:22.526213 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dab28-7759-4074-98a1-eeb7fef21c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:22.526605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 319/619] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:22.528867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eeb40-34bc-421f-84e3-3c7af81e3c13 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:22.529154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eeb40-34bc-421f-84e3-3c7af81e3c13 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:22.529432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eeb40-34bc-421f-84e3-3c7af81e3c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:22.548457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b55dab28-7759-4074-98a1-eeb7fef21c14 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:22.549983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b55dab28-7759-4074-98a1-eeb7fef21c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:22.550893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-bf8eeb40-34bc-421f-84e3-3c7af81e3c13 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:22.552139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-bf8eeb40-34bc-421f-84e3-3c7af81e3c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:22.629843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 320/621] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:52:22.629843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eeb40-34bc-421f-84e3-3c7af81e3c13 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:22.630312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 301/621] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:52:22.667877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dab28-7759-4074-98a1-eeb7fef21c14 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:22.670913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:22.728623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eeb40-34bc-421f-84e3-3c7af81e3c13 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:22.755500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:22.765100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95fb21-038e-4e1b-ad7c-cf730a81ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:22.765966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95fb21-038e-4e1b-ad7c-cf730a81ad92 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:22.766258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95fb21-038e-4e1b-ad7c-cf730a81ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:22.766536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95fb21-038e-4e1b-ad7c-cf730a81ad92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:22.773740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95fb21-038e-4e1b-ad7c-cf730a81ad92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:22.775278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95fb21-038e-4e1b-ad7c-cf730a81ad92 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:22.781247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dab28-7759-4074-98a1-eeb7fef21c14 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-5f95fb21-038e-4e1b-ad7c-cf730a81ad92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:22.789761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:22.790663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:22.791951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:22.791951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:22.791951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:22.791951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:22.791951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:22.791951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:22.791951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:22.791951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:22.796305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 321/622] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:22.797216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95fb21-038e-4e1b-ad7c-cf730a81ad92 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:22.823468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5b64c-3507-473f-b338-e5459ee116d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:22.825272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5b64c-3507-473f-b338-e5459ee116d6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:22.825817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5b64c-3507-473f-b338-e5459ee116d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:22.826547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5b64c-3507-473f-b338-e5459ee116d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:22.840091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5b64c-3507-473f-b338-e5459ee116d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-a5e5b64c-3507-473f-b338-e5459ee116d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:22.850743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:22.851712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:22.852540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:22.860410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 302/623] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:22.860410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5b64c-3507-473f-b338-e5459ee116d6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:22.919049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95fb21-038e-4e1b-ad7c-cf730a81ad92 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:22.921249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:22.962639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a6df5-21b1-493c-b322-5cf4b6af9d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:22.964256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a6df5-21b1-493c-b322-5cf4b6af9d55 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:22.964719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a6df5-21b1-493c-b322-5cf4b6af9d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:22.965138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a6df5-21b1-493c-b322-5cf4b6af9d55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:22.966513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5b64c-3507-473f-b338-e5459ee116d6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:22.979734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a6df5-21b1-493c-b322-5cf4b6af9d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-370a6df5-21b1-493c-b322-5cf4b6af9d55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:22.989784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:22.990931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:22.991819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:22.999427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 322/624] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:23.000026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a6df5-21b1-493c-b322-5cf4b6af9d55 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:23.013715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a6dc-92cd-42c0-9ec2-939b3ec2c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:23.014818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a6dc-92cd-42c0-9ec2-939b3ec2c8ad None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:23.015353 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a6dc-92cd-42c0-9ec2-939b3ec2c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:23.015825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a6dc-92cd-42c0-9ec2-939b3ec2c8ad None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:23.016987 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52a6dc-92cd-42c0-9ec2-939b3ec2c8ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:23.017530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52a6dc-92cd-42c0-9ec2-939b3ec2c8ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:23.019252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52a6dc-92cd-42c0-9ec2-939b3ec2c8ad None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:23.021355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:23.034261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 303/625] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:23.035553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a6dc-92cd-42c0-9ec2-939b3ec2c8ad None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:23.126470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a6df5-21b1-493c-b322-5cf4b6af9d55 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:23.160472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a6dc-92cd-42c0-9ec2-939b3ec2c8ad None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:23.168613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf4f3f-a665-4198-9cc6-80734f8b3462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:23.170195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4f3f-a665-4198-9cc6-80734f8b3462 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:23.170681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4f3f-a665-4198-9cc6-80734f8b3462 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:23.171184 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4f3f-a665-4198-9cc6-80734f8b3462 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:23.172597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf4f3f-a665-4198-9cc6-80734f8b3462 None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:23.173528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf4f3f-a665-4198-9cc6-80734f8b3462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:23.175452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf4f3f-a665-4198-9cc6-80734f8b3462 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:23.191017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 323/626] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:23.191017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf4f3f-a665-4198-9cc6-80734f8b3462 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:23.207241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9922b-b5a4-480b-bde4-193bc3288c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:23.208277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9922b-b5a4-480b-bde4-193bc3288c7c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:23.208792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9922b-b5a4-480b-bde4-193bc3288c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:23.209338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9922b-b5a4-480b-bde4-193bc3288c7c None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:23.210384 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9922b-b5a4-480b-bde4-193bc3288c7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:23.210913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9922b-b5a4-480b-bde4-193bc3288c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:23.212655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9922b-b5a4-480b-bde4-193bc3288c7c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:23.219621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:23.227695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 304/627] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:23.229586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9922b-b5a4-480b-bde4-193bc3288c7c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:23.291094 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:23.299006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf4f3f-a665-4198-9cc6-80734f8b3462 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:23.334530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c7170-3cce-4d09-9d33-c9ba63070f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:23.335511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c7170-3cce-4d09-9d33-c9ba63070f4f None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:23.335886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c7170-3cce-4d09-9d33-c9ba63070f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:23.336169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c7170-3cce-4d09-9d33-c9ba63070f4f None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/d585280109eb4773adf7d56fd722a4b4/roles/cd3a257aec1b4b1694563a46b1e71a03` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:23.340085 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9922b-b5a4-480b-bde4-193bc3288c7c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:23.351914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c7170-3cce-4d09-9d33-c9ba63070f4f None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=d585280109eb4773adf7d56fd722a4b4, role_id=cd3a257aec1b4b1694563a46b1e71a03)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:23.353383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c7170-3cce-4d09-9d33-c9ba63070f4f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:23.373570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 324/628] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:52:23 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/d585280109eb4773adf7d56fd722a4b4/roles/cd3a257aec1b4b1694563a46b1e71a03 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:52:23.374664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c7170-3cce-4d09-9d33-c9ba63070f4f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:23.377499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c5e2c-3915-47e6-985d-e8ca8225a471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:23.378710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5e2c-3915-47e6-985d-e8ca8225a471 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:23.379247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5e2c-3915-47e6-985d-e8ca8225a471 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:23.379790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5e2c-3915-47e6-985d-e8ca8225a471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:23.392183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c5e2c-3915-47e6-985d-e8ca8225a471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:23.394033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c5e2c-3915-47e6-985d-e8ca8225a471 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-ac7c5e2c-3915-47e6-985d-e8ca8225a471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:23.413262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:23.414318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:23.415271 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:23.415271 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:23.415271 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:23.415271 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:23.417616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 305/629] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:23.423740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c5e2c-3915-47e6-985d-e8ca8225a471 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:23.527399 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:23.586357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c7170-3cce-4d09-9d33-c9ba63070f4f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:23.607256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c5e2c-3915-47e6-985d-e8ca8225a471 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:23.621862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:23.647981 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111ea0b-5d3c-406d-8959-8f2094542cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:23.649328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ea0b-5d3c-406d-8959-8f2094542cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:23.649615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ea0b-5d3c-406d-8959-8f2094542cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:23.649887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ea0b-5d3c-406d-8959-8f2094542cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:23.660693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847f745-6d09-401c-91c2-bc398db4135e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:23.661370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f745-6d09-401c-91c2-bc398db4135e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:23.662104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f745-6d09-401c-91c2-bc398db4135e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:23.662406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f745-6d09-401c-91c2-bc398db4135e None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:23.663453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847f745-6d09-401c-91c2-bc398db4135e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:23.663765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847f745-6d09-401c-91c2-bc398db4135e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:23.663944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111ea0b-5d3c-406d-8959-8f2094542cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:23.665295 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847f745-6d09-401c-91c2-bc398db4135e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:23.665407 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111ea0b-5d3c-406d-8959-8f2094542cc1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:23.681988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 306/630] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:23.683398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe7a85-9c59-4aac-99ba-20dddf893810 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:23.683688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe7a85-9c59-4aac-99ba-20dddf893810 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:23.683969 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe7a85-9c59-4aac-99ba-20dddf893810 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:23.685548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 307/631] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-7111ea0b-5d3c-406d-8959-8f2094542cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:23.686908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:23.688097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:23.689598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:23.689598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:23.689598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:23.689598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:23.689950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe7a85-9c59-4aac-99ba-20dddf893810 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:23.690037 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 325/632] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:23.691705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e24e4-53ef-4a21-8bf2-fc548ad5af2f None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:23.691989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e24e4-53ef-4a21-8bf2-fc548ad5af2f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:23.692260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e24e4-53ef-4a21-8bf2-fc548ad5af2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:23.710835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-af8e24e4-53ef-4a21-8bf2-fc548ad5af2f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:23.712028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-af8e24e4-53ef-4a21-8bf2-fc548ad5af2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:23.790632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 326/633] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:23.803643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e24e4-53ef-4a21-8bf2-fc548ad5af2f None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:23.814006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe7a85-9c59-4aac-99ba-20dddf893810 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:23.860747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c00068-f5d2-4ae1-9583-be5b635dda27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:23.862159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00068-f5d2-4ae1-9583-be5b635dda27 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:23.862451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00068-f5d2-4ae1-9583-be5b635dda27 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:23.862733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00068-f5d2-4ae1-9583-be5b635dda27 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:23.871227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:23.874239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c00068-f5d2-4ae1-9583-be5b635dda27 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:23.875997 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c00068-f5d2-4ae1-9583-be5b635dda27 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-45c00068-f5d2-4ae1-9583-be5b635dda27 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:23.898260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:23.899323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:23.900246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:23.900246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:23.900246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:23.900246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:23.900246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:23.900246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:23.900246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:23.900246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:23.900246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:23.900246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:23.901801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 308/634] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Jun 26 02:52:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:23.901937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c00068-f5d2-4ae1-9583-be5b635dda27 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:23.928556 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e24e4-53ef-4a21-8bf2-fc548ad5af2f None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:23.938273 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:23.968139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e236b8-798f-4749-a7cb-eb3d11fd00d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:23.968832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e236b8-798f-4749-a7cb-eb3d11fd00d9 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:23.969118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e236b8-798f-4749-a7cb-eb3d11fd00d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:23.969435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e236b8-798f-4749-a7cb-eb3d11fd00d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:23.970177 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e236b8-798f-4749-a7cb-eb3d11fd00d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:23.970487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e236b8-798f-4749-a7cb-eb3d11fd00d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:23.971936 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e236b8-798f-4749-a7cb-eb3d11fd00d9 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:23.989664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 327/635] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:23.989664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e236b8-798f-4749-a7cb-eb3d11fd00d9 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:24.035184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c00068-f5d2-4ae1-9583-be5b635dda27 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:24.074033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d54c8-d335-46aa-ae3c-fbcb62d0f7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:24.075370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d54c8-d335-46aa-ae3c-fbcb62d0f7cd None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.076296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d54c8-d335-46aa-ae3c-fbcb62d0f7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.076776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d54c8-d335-46aa-ae3c-fbcb62d0f7cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.088471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d54c8-d335-46aa-ae3c-fbcb62d0f7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:24.095264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e236b8-798f-4749-a7cb-eb3d11fd00d9 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-923d54c8-d335-46aa-ae3c-fbcb62d0f7cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:24.096170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:24.097090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:24.097929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 309/636] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:24.098611 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb612711-add2-4efe-996d-13468e1a2acf None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.099035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb612711-add2-4efe-996d-13468e1a2acf None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.099173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb612711-add2-4efe-996d-13468e1a2acf None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.100560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 310/637] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:24.101081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb612711-add2-4efe-996d-13468e1a2acf None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:24.122567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:24.142264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a5dae-371e-4cfb-bb2b-6303abf96740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:24.142949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a5dae-371e-4cfb-bb2b-6303abf96740 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.143258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a5dae-371e-4cfb-bb2b-6303abf96740 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.143533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a5dae-371e-4cfb-bb2b-6303abf96740 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.144620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a5dae-371e-4cfb-bb2b-6303abf96740 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:24.144728 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a5dae-371e-4cfb-bb2b-6303abf96740 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:24.146114 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a5dae-371e-4cfb-bb2b-6303abf96740 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:24.168810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 328/638] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Jun 26 02:52:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:24.168810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a5dae-371e-4cfb-bb2b-6303abf96740 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:24.201856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:24.217197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb612711-add2-4efe-996d-13468e1a2acf None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:24.253087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15858c4-2938-40b6-99c3-61a3cfe6286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:24.253890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15858c4-2938-40b6-99c3-61a3cfe6286e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.254173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15858c4-2938-40b6-99c3-61a3cfe6286e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.254453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15858c4-2938-40b6-99c3-61a3cfe6286e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.262635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15858c4-2938-40b6-99c3-61a3cfe6286e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:24.264151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15858c4-2938-40b6-99c3-61a3cfe6286e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:24.273886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a5dae-371e-4cfb-bb2b-6303abf96740 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-d15858c4-2938-40b6-99c3-61a3cfe6286e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:24.278009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:24.279369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:24.280328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:24.280328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:24.280328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:24.280328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:24.280328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:24.280328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:24.280328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:24.280328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:24.280328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 26 02:52:24.280328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:24.284249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 311/639] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:24.285280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef637-77cd-4a7f-bff9-be7f83270027 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.285570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef637-77cd-4a7f-bff9-be7f83270027 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.285839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef637-77cd-4a7f-bff9-be7f83270027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.302789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-80eef637-77cd-4a7f-bff9-be7f83270027 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:24.304100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-80eef637-77cd-4a7f-bff9-be7f83270027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:24.309105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528808e-6a40-426b-92ad-328c1e19e8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:24.309771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528808e-6a40-426b-92ad-328c1e19e8df None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.310161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528808e-6a40-426b-92ad-328c1e19e8df None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.310438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528808e-6a40-426b-92ad-328c1e19e8df None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.311207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528808e-6a40-426b-92ad-328c1e19e8df None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:24.311511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528808e-6a40-426b-92ad-328c1e19e8df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:24.312895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528808e-6a40-426b-92ad-328c1e19e8df None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:24.321611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 329/640] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:24.322375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528808e-6a40-426b-92ad-328c1e19e8df None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:24.359145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:24.383108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 312/641] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:24.383108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eef637-77cd-4a7f-bff9-be7f83270027 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:24.437621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528808e-6a40-426b-92ad-328c1e19e8df None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:24.469781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:24.475044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a76601-095b-4b88-bf23-e22a701f5e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:24.475708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a76601-095b-4b88-bf23-e22a701f5e75 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.475991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a76601-095b-4b88-bf23-e22a701f5e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.476272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a76601-095b-4b88-bf23-e22a701f5e75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.500846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eef637-77cd-4a7f-bff9-be7f83270027 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:24.536022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4fba9-9a57-49e6-bb62-911528f0ebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:24.536700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4fba9-9a57-49e6-bb62-911528f0ebd2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.536982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4fba9-9a57-49e6-bb62-911528f0ebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.537258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4fba9-9a57-49e6-bb62-911528f0ebd2 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.538305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4fba9-9a57-49e6-bb62-911528f0ebd2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:24.538415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4fba9-9a57-49e6-bb62-911528f0ebd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:24.539882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4fba9-9a57-49e6-bb62-911528f0ebd2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:24.553915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a76601-095b-4b88-bf23-e22a701f5e75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:24.555400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a76601-095b-4b88-bf23-e22a701f5e75 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:24.558855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 313/642] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Jun 26 02:52:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:24.559953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4fba9-9a57-49e6-bb62-911528f0ebd2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:24.595577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:24.667484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4fba9-9a57-49e6-bb62-911528f0ebd2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:24.681316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 330/643] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:24.681316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a76601-095b-4b88-bf23-e22a701f5e75 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:24.710606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ebf71-2cd3-4db9-9535-4cf0ed3f0878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:24.711450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ebf71-2cd3-4db9-9535-4cf0ed3f0878 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.711735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ebf71-2cd3-4db9-9535-4cf0ed3f0878 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.712012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ebf71-2cd3-4db9-9535-4cf0ed3f0878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.715480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:24.724112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ebf71-2cd3-4db9-9535-4cf0ed3f0878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:24.725576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ebf71-2cd3-4db9-9535-4cf0ed3f0878 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-118ebf71-2cd3-4db9-9535-4cf0ed3f0878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:24.743142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:24.744081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:24.744985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:24.744985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:24.744985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:24.744985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:24.749118 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 314/644] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:24.749724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ebf71-2cd3-4db9-9535-4cf0ed3f0878 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:24.781042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a76601-095b-4b88-bf23-e22a701f5e75 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:24.815074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b93ee0-2e5b-46af-8225-123b0a067299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:24.815874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93ee0-2e5b-46af-8225-123b0a067299 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.816154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93ee0-2e5b-46af-8225-123b0a067299 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.816430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b93ee0-2e5b-46af-8225-123b0a067299 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.819320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:24.828167 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b93ee0-2e5b-46af-8225-123b0a067299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-b2b93ee0-2e5b-46af-8225-123b0a067299 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:24.836315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:24.837211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:24.838199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 331/645] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:24.838906 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b93ee0-2e5b-46af-8225-123b0a067299 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:24.855492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ebf71-2cd3-4db9-9535-4cf0ed3f0878 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:24.892261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a488299-244c-43cf-83fa-d64e8546e5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:24.892914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488299-244c-43cf-83fa-d64e8546e5fe None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.893190 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488299-244c-43cf-83fa-d64e8546e5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.893861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488299-244c-43cf-83fa-d64e8546e5fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.940127 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b93ee0-2e5b-46af-8225-123b0a067299 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:24.956170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:24.970545 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a488299-244c-43cf-83fa-d64e8546e5fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:24.972035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a488299-244c-43cf-83fa-d64e8546e5fe None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:24.975309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3395b-c865-48cf-b5a1-4338218911c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:24.976370 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3395b-c865-48cf-b5a1-4338218911c9 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:24.976845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3395b-c865-48cf-b5a1-4338218911c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:24.977324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3395b-c865-48cf-b5a1-4338218911c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:24.988778 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3395b-c865-48cf-b5a1-4338218911c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:24.990625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3395b-c865-48cf-b5a1-4338218911c9 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-cab3395b-c865-48cf-b5a1-4338218911c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:25.011191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:25.012075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:25.012946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:25.012946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:25.012946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:25.012946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:25.015026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 332/646] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:25.015824 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3395b-c865-48cf-b5a1-4338218911c9 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.065935 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:25.081525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 315/647] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:25.081525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a488299-244c-43cf-83fa-d64e8546e5fe None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.124347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3395b-c865-48cf-b5a1-4338218911c9 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.159513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e90f69-75dc-49b0-900a-de50bd7a8023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:25.160284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90f69-75dc-49b0-900a-de50bd7a8023 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.160568 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90f69-75dc-49b0-900a-de50bd7a8023 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.160847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90f69-75dc-49b0-900a-de50bd7a8023 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.161570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e90f69-75dc-49b0-900a-de50bd7a8023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:25.161878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e90f69-75dc-49b0-900a-de50bd7a8023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:25.163528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e90f69-75dc-49b0-900a-de50bd7a8023 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.165863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:25.179084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a488299-244c-43cf-83fa-d64e8546e5fe None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.181166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 333/648] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:25.182050 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e90f69-75dc-49b0-900a-de50bd7a8023 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.214014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4bb06-2d8c-4762-a1f5-35f7a0eb1fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:25.214633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bb06-2d8c-4762-a1f5-35f7a0eb1fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.214883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bb06-2d8c-4762-a1f5-35f7a0eb1fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.215258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4bb06-2d8c-4762-a1f5-35f7a0eb1fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.215949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4bb06-2d8c-4762-a1f5-35f7a0eb1fb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:25.216361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4bb06-2d8c-4762-a1f5-35f7a0eb1fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:25.217741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4bb06-2d8c-4762-a1f5-35f7a0eb1fb7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.225688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 316/649] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:25.226475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4bb06-2d8c-4762-a1f5-35f7a0eb1fb7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.293222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e90f69-75dc-49b0-900a-de50bd7a8023 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.304148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:25.329118 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4bb06-2d8c-4762-a1f5-35f7a0eb1fb7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.331575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4d6fa-41ee-46b0-8296-3e55c648d63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:25.332236 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4d6fa-41ee-46b0-8296-3e55c648d63f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.332516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4d6fa-41ee-46b0-8296-3e55c648d63f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.332791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4d6fa-41ee-46b0-8296-3e55c648d63f None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.333509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4d6fa-41ee-46b0-8296-3e55c648d63f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:25.333812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4d6fa-41ee-46b0-8296-3e55c648d63f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:25.335225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4d6fa-41ee-46b0-8296-3e55c648d63f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.351525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 334/650] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:25.351525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4d6fa-41ee-46b0-8296-3e55c648d63f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.366708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb81e-082c-4f17-a2a6-9a4b4ed79578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:25.367540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb81e-082c-4f17-a2a6-9a4b4ed79578 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.367801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb81e-082c-4f17-a2a6-9a4b4ed79578 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.368066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb81e-082c-4f17-a2a6-9a4b4ed79578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.378626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb81e-082c-4f17-a2a6-9a4b4ed79578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:25.380105 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb81e-082c-4f17-a2a6-9a4b4ed79578 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2bffb81e-082c-4f17-a2a6-9a4b4ed79578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:25.396820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:25.397958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:25.398890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:25.398890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:25.398890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:25.398890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:25.398890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 317/651] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:25.399210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb81e-082c-4f17-a2a6-9a4b4ed79578 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.402745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:25.460396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4d6fa-41ee-46b0-8296-3e55c648d63f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.497203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda10491-5ccc-48a8-9ad8-1ad626b9326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:25.497955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda10491-5ccc-48a8-9ad8-1ad626b9326a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.498232 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda10491-5ccc-48a8-9ad8-1ad626b9326a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.498502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda10491-5ccc-48a8-9ad8-1ad626b9326a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.504450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb81e-082c-4f17-a2a6-9a4b4ed79578 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.506191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda10491-5ccc-48a8-9ad8-1ad626b9326a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:25.507683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda10491-5ccc-48a8-9ad8-1ad626b9326a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-eda10491-5ccc-48a8-9ad8-1ad626b9326a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:25.521655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:25.522639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 335/652] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:25.528790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda10491-5ccc-48a8-9ad8-1ad626b9326a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.546073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4d168-46ae-4ba9-a3c0-d9f26b982c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:25.546873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4d168-46ae-4ba9-a3c0-d9f26b982c43 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.547177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4d168-46ae-4ba9-a3c0-d9f26b982c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.547448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4d168-46ae-4ba9-a3c0-d9f26b982c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.556570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:25.558245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4d168-46ae-4ba9-a3c0-d9f26b982c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:25.559831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4d168-46ae-4ba9-a3c0-d9f26b982c43 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-34b4d168-46ae-4ba9-a3c0-d9f26b982c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:25.576378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:25.577381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:25.578282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:25.578282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:25.578282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:25.578282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:25.578282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 318/653] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:25.578282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4d168-46ae-4ba9-a3c0-d9f26b982c43 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.627905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda10491-5ccc-48a8-9ad8-1ad626b9326a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.633704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:25.659930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78636a5-9f38-4b28-a947-e2bc7a4dc0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:25.660748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78636a5-9f38-4b28-a947-e2bc7a4dc0af None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.661010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78636a5-9f38-4b28-a947-e2bc7a4dc0af None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.661387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78636a5-9f38-4b28-a947-e2bc7a4dc0af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.669612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78636a5-9f38-4b28-a947-e2bc7a4dc0af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:25.671112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78636a5-9f38-4b28-a947-e2bc7a4dc0af None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.683504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4d168-46ae-4ba9-a3c0-d9f26b982c43 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-e78636a5-9f38-4b28-a947-e2bc7a4dc0af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:25.688875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:25.689784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:25.690675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:25.690675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:25.690675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:25.690675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:25.690675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:25.690675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:25.690675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:25.690675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:25.690675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 336/654] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:25.691221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78636a5-9f38-4b28-a947-e2bc7a4dc0af None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.721098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d7bc2-fc35-4b84-a0a1-01f4a6921e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:25.721762 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7bc2-fc35-4b84-a0a1-01f4a6921e96 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.722037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7bc2-fc35-4b84-a0a1-01f4a6921e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.722312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7bc2-fc35-4b84-a0a1-01f4a6921e96 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.723047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d7bc2-fc35-4b84-a0a1-01f4a6921e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:25.723352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d7bc2-fc35-4b84-a0a1-01f4a6921e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:25.724729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d7bc2-fc35-4b84-a0a1-01f4a6921e96 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.741029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 319/655] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:25.741029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f5b9d-ae3e-4c71-a567-cb16e7e818d6 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.741029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f5b9d-ae3e-4c71-a567-cb16e7e818d6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.741029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f5b9d-ae3e-4c71-a567-cb16e7e818d6 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.741029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 320/656] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:25.741029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f5b9d-ae3e-4c71-a567-cb16e7e818d6 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.780430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:25.793482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78636a5-9f38-4b28-a947-e2bc7a4dc0af None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.828063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c710-79c9-4071-9053-46cdcf09748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:25.828672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c710-79c9-4071-9053-46cdcf09748b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.828958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c710-79c9-4071-9053-46cdcf09748b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.829237 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c710-79c9-4071-9053-46cdcf09748b None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.830084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0c710-79c9-4071-9053-46cdcf09748b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:25.830398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0c710-79c9-4071-9053-46cdcf09748b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:25.832724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0c710-79c9-4071-9053-46cdcf09748b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.843682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f5b9d-ae3e-4c71-a567-cb16e7e818d6 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.849859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 337/657] 10.222.0.36 () {56 vars in 1137 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:25.850674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c710-79c9-4071-9053-46cdcf09748b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.858327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:25.880260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca4a2c-017d-49dd-bf58-e63fd958756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:25.880928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca4a2c-017d-49dd-bf58-e63fd958756c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.881206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca4a2c-017d-49dd-bf58-e63fd958756c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.881507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca4a2c-017d-49dd-bf58-e63fd958756c None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.882223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca4a2c-017d-49dd-bf58-e63fd958756c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:25.882527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca4a2c-017d-49dd-bf58-e63fd958756c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:25.883939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca4a2c-017d-49dd-bf58-e63fd958756c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.894770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 321/658] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:25.895577 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca4a2c-017d-49dd-bf58-e63fd958756c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:25.947510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c710-79c9-4071-9053-46cdcf09748b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.980994 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778297a3-687d-4aab-8490-27c1cd26dac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:25.981652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778297a3-687d-4aab-8490-27c1cd26dac1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.981993 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778297a3-687d-4aab-8490-27c1cd26dac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.982358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778297a3-687d-4aab-8490-27c1cd26dac1 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:25.983173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778297a3-687d-4aab-8490-27c1cd26dac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:25.983477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778297a3-687d-4aab-8490-27c1cd26dac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:25.984918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778297a3-687d-4aab-8490-27c1cd26dac1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:25.990690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca4a2c-017d-49dd-bf58-e63fd958756c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:25.996648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 338/659] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:25.997874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938daa0-2152-44ae-9657-980837818cf0 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:25.998165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938daa0-2152-44ae-9657-980837818cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:25.998445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938daa0-2152-44ae-9657-980837818cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:26.010075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:26.015740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-9938daa0-2152-44ae-9657-980837818cf0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:26.016958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9938daa0-2152-44ae-9657-980837818cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:26.031657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653b11f-0ae9-485f-8259-f3510cde3fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:26.032411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653b11f-0ae9-485f-8259-f3510cde3fcc None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:26.032692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653b11f-0ae9-485f-8259-f3510cde3fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:26.032964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653b11f-0ae9-485f-8259-f3510cde3fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:26.039618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653b11f-0ae9-485f-8259-f3510cde3fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:26.041076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653b11f-0ae9-485f-8259-f3510cde3fcc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b653b11f-0ae9-485f-8259-f3510cde3fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:26.055774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:26.056750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:26.057621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:26.057621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:26.057621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:26.057621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:26.057621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:26.057621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:26.057621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:26.057621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:26.057621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 322/660] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:26.058098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653b11f-0ae9-485f-8259-f3510cde3fcc None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:26.092129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 339/661] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:26.093304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938daa0-2152-44ae-9657-980837818cf0 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:26.098885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:26.165780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653b11f-0ae9-485f-8259-f3510cde3fcc None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:26.191723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938daa0-2152-44ae-9657-980837818cf0 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:26.199398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d21876-53f8-43d0-8152-62a0d9bb89da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:26.200041 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d21876-53f8-43d0-8152-62a0d9bb89da None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:26.200319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d21876-53f8-43d0-8152-62a0d9bb89da None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:26.200673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d21876-53f8-43d0-8152-62a0d9bb89da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:26.225100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb96d48-de92-4d4e-a217-e1bae48e6c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:26.225881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96d48-de92-4d4e-a217-e1bae48e6c00 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:26.226157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96d48-de92-4d4e-a217-e1bae48e6c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:26.226430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96d48-de92-4d4e-a217-e1bae48e6c00 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:26.229064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:26.233782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb96d48-de92-4d4e-a217-e1bae48e6c00 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:26.235630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb96d48-de92-4d4e-a217-e1bae48e6c00 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-2bb96d48-de92-4d4e-a217-e1bae48e6c00 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:26.249717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:26.250653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 340/662] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:26.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb96d48-de92-4d4e-a217-e1bae48e6c00 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:26.268556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d21876-53f8-43d0-8152-62a0d9bb89da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:26.270019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d21876-53f8-43d0-8152-62a0d9bb89da None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:26.301933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:26.350743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb96d48-de92-4d4e-a217-e1bae48e6c00 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:26.366097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 323/663] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:26.366931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d21876-53f8-43d0-8152-62a0d9bb89da None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:26.385328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94e11a-0e40-4845-9666-53a3e7f1ecda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:26.385981 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e11a-0e40-4845-9666-53a3e7f1ecda None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:26.386262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e11a-0e40-4845-9666-53a3e7f1ecda None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:26.386538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e11a-0e40-4845-9666-53a3e7f1ecda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:26.387402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e11a-0e40-4845-9666-53a3e7f1ecda None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=24319e5e83ed4caf9dd3ae4b3937b3fb) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:26.387715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e11a-0e40-4845-9666-53a3e7f1ecda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:26.389144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e11a-0e40-4845-9666-53a3e7f1ecda None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:26.394962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 341/664] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:26 2022] GET /identity/v3/role_assignments?user.id=24319e5e83ed4caf9dd3ae4b3937b3fb&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:26.395648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94e11a-0e40-4845-9666-53a3e7f1ecda None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:26.464776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:26.488886 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d21876-53f8-43d0-8152-62a0d9bb89da None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:26.518206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94e11a-0e40-4845-9666-53a3e7f1ecda None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:26.527339 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6c5ff-e459-4117-8cf6-8b757dee9e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:26.528086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c5ff-e459-4117-8cf6-8b757dee9e49 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:26.528362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c5ff-e459-4117-8cf6-8b757dee9e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:26.528988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c5ff-e459-4117-8cf6-8b757dee9e49 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:26.529637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6c5ff-e459-4117-8cf6-8b757dee9e49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:26.529952 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6c5ff-e459-4117-8cf6-8b757dee9e49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:26.531517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6c5ff-e459-4117-8cf6-8b757dee9e49 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:26.533501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:26.551178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 324/665] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:26.551178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6c5ff-e459-4117-8cf6-8b757dee9e49 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:26.561099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779889d-d57c-4408-94d9-da8e2e762885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:26.561846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779889d-d57c-4408-94d9-da8e2e762885 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:26.562128 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779889d-d57c-4408-94d9-da8e2e762885 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:26.562405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779889d-d57c-4408-94d9-da8e2e762885 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:26.573469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779889d-d57c-4408-94d9-da8e2e762885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-b779889d-d57c-4408-94d9-da8e2e762885 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:26.581234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:26.582260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:26.583279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:26.587076 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 342/666] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:26.588101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779889d-d57c-4408-94d9-da8e2e762885 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:26.674428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6c5ff-e459-4117-8cf6-8b757dee9e49 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:26.695237 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779889d-d57c-4408-94d9-da8e2e762885 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:26.706779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a708fd-1ee3-4127-9d8d-e5154b0f4281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:26.707486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a708fd-1ee3-4127-9d8d-e5154b0f4281 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:26.707767 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a708fd-1ee3-4127-9d8d-e5154b0f4281 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:26.708040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a708fd-1ee3-4127-9d8d-e5154b0f4281 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:26.708874 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a708fd-1ee3-4127-9d8d-e5154b0f4281 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:26.709179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a708fd-1ee3-4127-9d8d-e5154b0f4281 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:26.710612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a708fd-1ee3-4127-9d8d-e5154b0f4281 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:26.717748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:26.733603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 325/667] 10.222.0.36 () {56 vars in 1139 bytes} [Sun Jun 26 02:52:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:26.733603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a708fd-1ee3-4127-9d8d-e5154b0f4281 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:26.738074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc99191-ee25-4605-9e36-ffa6ca4904d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:26.738896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc99191-ee25-4605-9e36-ffa6ca4904d3 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:26.739248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc99191-ee25-4605-9e36-ffa6ca4904d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:26.739528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc99191-ee25-4605-9e36-ffa6ca4904d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:26.751681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc99191-ee25-4605-9e36-ffa6ca4904d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:26.753163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc99191-ee25-4605-9e36-ffa6ca4904d3 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-7fc99191-ee25-4605-9e36-ffa6ca4904d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:26.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:26.772029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:26.772910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:26.772910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:26.772910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:26.772910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:26.772910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 343/668] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:26.773659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc99191-ee25-4605-9e36-ffa6ca4904d3 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:26.789864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:26.837864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a708fd-1ee3-4127-9d8d-e5154b0f4281 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:26.873733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651002-14b0-42f8-a5a7-3b7427a1e1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:26.874415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651002-14b0-42f8-a5a7-3b7427a1e1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:26.874699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651002-14b0-42f8-a5a7-3b7427a1e1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:26.874936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651002-14b0-42f8-a5a7-3b7427a1e1d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:26.875783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5651002-14b0-42f8-a5a7-3b7427a1e1d7 None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=250c47daff26400c96a6b467d7cf5432) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:26.876100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5651002-14b0-42f8-a5a7-3b7427a1e1d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:26.877512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5651002-14b0-42f8-a5a7-3b7427a1e1d7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:26.881378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc99191-ee25-4605-9e36-ffa6ca4904d3 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:26.884237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 326/669] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:26 2022] GET /identity/v3/role_assignments?user.id=250c47daff26400c96a6b467d7cf5432&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:26.884741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651002-14b0-42f8-a5a7-3b7427a1e1d7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:26.939497 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a6ac6-fac5-4d13-a7bd-c7a2b21a3cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:26.940215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a6ac6-fac5-4d13-a7bd-c7a2b21a3cde None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:26.940498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a6ac6-fac5-4d13-a7bd-c7a2b21a3cde None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:26.940783 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a6ac6-fac5-4d13-a7bd-c7a2b21a3cde None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:26.941559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a6ac6-fac5-4d13-a7bd-c7a2b21a3cde None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:26.941883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a6ac6-fac5-4d13-a7bd-c7a2b21a3cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:26.944095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a6ac6-fac5-4d13-a7bd-c7a2b21a3cde None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:26.956454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 344/670] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:26.957466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a6ac6-fac5-4d13-a7bd-c7a2b21a3cde None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:27.003124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:27.018228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651002-14b0-42f8-a5a7-3b7427a1e1d7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:27.037941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:27.057792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37c72b-b784-4fff-8616-e5d0c4850cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:27.058704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c72b-b784-4fff-8616-e5d0c4850cbf None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:27.059166 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c72b-b784-4fff-8616-e5d0c4850cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:27.059587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c72b-b784-4fff-8616-e5d0c4850cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:27.103904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a6ac6-fac5-4d13-a7bd-c7a2b21a3cde None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:27.144107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff97bf0-5366-45d5-969b-dadb552e2c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:27.144945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff97bf0-5366-45d5-969b-dadb552e2c2e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:27.145313 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff97bf0-5366-45d5-969b-dadb552e2c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:27.145684 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff97bf0-5366-45d5-969b-dadb552e2c2e None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:27.147507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff97bf0-5366-45d5-969b-dadb552e2c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:27.147507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff97bf0-5366-45d5-969b-dadb552e2c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:27.148255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff97bf0-5366-45d5-969b-dadb552e2c2e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:27.149795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37c72b-b784-4fff-8616-e5d0c4850cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:27.151270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37c72b-b784-4fff-8616-e5d0c4850cbf None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:27.167855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 345/671] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:27.168719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff97bf0-5366-45d5-969b-dadb552e2c2e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:27.263635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:27.267569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff97bf0-5366-45d5-969b-dadb552e2c2e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:27.277256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 327/672] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:27.278110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37c72b-b784-4fff-8616-e5d0c4850cbf None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:27.296914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:27.312793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2023e-9031-42c8-b7a6-56c2c28e3b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:27.313602 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2023e-9031-42c8-b7a6-56c2c28e3b18 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:27.314032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2023e-9031-42c8-b7a6-56c2c28e3b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:27.314307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2023e-9031-42c8-b7a6-56c2c28e3b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:27.327368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2023e-9031-42c8-b7a6-56c2c28e3b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:27.329243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2023e-9031-42c8-b7a6-56c2c28e3b18 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-c4b2023e-9031-42c8-b7a6-56c2c28e3b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:27.351743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:27.352817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:27.354266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:27.354266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:27.354266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:27.354266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:27.354266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 346/673] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:27.354266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2023e-9031-42c8-b7a6-56c2c28e3b18 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:27.394674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37c72b-b784-4fff-8616-e5d0c4850cbf None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:27.453019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716358b0-aca5-4a2c-9993-9afb683cdf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:27.454062 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716358b0-aca5-4a2c-9993-9afb683cdf75 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:27.454343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716358b0-aca5-4a2c-9993-9afb683cdf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:27.454628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716358b0-aca5-4a2c-9993-9afb683cdf75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:27.461167 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2023e-9031-42c8-b7a6-56c2c28e3b18 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:27.464445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716358b0-aca5-4a2c-9993-9afb683cdf75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:27.465908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716358b0-aca5-4a2c-9993-9afb683cdf75 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-716358b0-aca5-4a2c-9993-9afb683cdf75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:27.483902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:27.484845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:27.486331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:27.486331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:27.486331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:27.486331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:27.486331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:27.486331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:27.486331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:27.486331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:27.486331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 328/674] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:27.486331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716358b0-aca5-4a2c-9993-9afb683cdf75 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:27.508358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406126-03ba-4b28-bb6c-42636bc1dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:27.509897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406126-03ba-4b28-bb6c-42636bc1dc52 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:27.510464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406126-03ba-4b28-bb6c-42636bc1dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:27.510890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406126-03ba-4b28-bb6c-42636bc1dc52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:27.525212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef406126-03ba-4b28-bb6c-42636bc1dc52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:27.527584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef406126-03ba-4b28-bb6c-42636bc1dc52 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:27.536584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-ef406126-03ba-4b28-bb6c-42636bc1dc52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:27.552073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:27.553178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:27.554074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:27.554074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:27.554074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:27.554074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:27.556831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 347/675] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:27.558012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406126-03ba-4b28-bb6c-42636bc1dc52 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:27.581784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:27.616722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716358b0-aca5-4a2c-9993-9afb683cdf75 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:27.653076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734a4d5-a6bd-47da-a27f-b03d1053bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:27.653947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a4d5-a6bd-47da-a27f-b03d1053bf23 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:27.654324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a4d5-a6bd-47da-a27f-b03d1053bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:27.654696 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734a4d5-a6bd-47da-a27f-b03d1053bf23 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:27.655619 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734a4d5-a6bd-47da-a27f-b03d1053bf23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:27.656038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734a4d5-a6bd-47da-a27f-b03d1053bf23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:27.657548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734a4d5-a6bd-47da-a27f-b03d1053bf23 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:27.672358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 329/676] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:27.673476 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734a4d5-a6bd-47da-a27f-b03d1053bf23 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:27.687816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406126-03ba-4b28-bb6c-42636bc1dc52 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:27.735551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7865e-b5da-48c9-9cc9-ed4f6fee641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:27.736997 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7865e-b5da-48c9-9cc9-ed4f6fee641a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:27.737674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7865e-b5da-48c9-9cc9-ed4f6fee641a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:27.738103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7865e-b5da-48c9-9cc9-ed4f6fee641a None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:27.739302 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7865e-b5da-48c9-9cc9-ed4f6fee641a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:27.740123 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7865e-b5da-48c9-9cc9-ed4f6fee641a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:27.741996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7865e-b5da-48c9-9cc9-ed4f6fee641a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:27.758126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 348/677] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:27.759203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7865e-b5da-48c9-9cc9-ed4f6fee641a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:27.790461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734a4d5-a6bd-47da-a27f-b03d1053bf23 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:27.822186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:27.833839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838dccd-b676-4ff5-ae5c-5e62f54e509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:27.834712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838dccd-b676-4ff5-ae5c-5e62f54e509f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:27.835179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838dccd-b676-4ff5-ae5c-5e62f54e509f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:27.835735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838dccd-b676-4ff5-ae5c-5e62f54e509f None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:27.837346 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838dccd-b676-4ff5-ae5c-5e62f54e509f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:27.837801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838dccd-b676-4ff5-ae5c-5e62f54e509f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:27.839344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838dccd-b676-4ff5-ae5c-5e62f54e509f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:27.842241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:27.854775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 330/678] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:27.856196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838dccd-b676-4ff5-ae5c-5e62f54e509f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:27.872123 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7865e-b5da-48c9-9cc9-ed4f6fee641a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:27.908281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e511f8-a674-474f-a2f2-b7af87d09ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:27.910183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e511f8-a674-474f-a2f2-b7af87d09ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:27.910615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e511f8-a674-474f-a2f2-b7af87d09ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:27.911096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e511f8-a674-474f-a2f2-b7af87d09ef6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:27.920957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e511f8-a674-474f-a2f2-b7af87d09ef6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:27.923260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e511f8-a674-474f-a2f2-b7af87d09ef6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-62e511f8-a674-474f-a2f2-b7af87d09ef6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:27.941094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:27.942248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:27.943430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:27.943430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:27.943430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:27.943430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:27.943430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:27.943430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:27.943430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:27.943430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:27.943430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:27.943430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:27.945671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 349/679] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:27.946645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e511f8-a674-474f-a2f2-b7af87d09ef6 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:27.974506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838dccd-b676-4ff5-ae5c-5e62f54e509f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:28.010875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816283a-83fa-4962-9fec-94300aaa6a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:28.011998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816283a-83fa-4962-9fec-94300aaa6a95 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:28.012611 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816283a-83fa-4962-9fec-94300aaa6a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:28.013396 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816283a-83fa-4962-9fec-94300aaa6a95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:28.014774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816283a-83fa-4962-9fec-94300aaa6a95 None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=892be7ed998840de8b325316db3fdde4) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:28.015226 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816283a-83fa-4962-9fec-94300aaa6a95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:28.017223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816283a-83fa-4962-9fec-94300aaa6a95 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:28.025671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 331/680] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:27 2022] GET /identity/v3/role_assignments?user.id=892be7ed998840de8b325316db3fdde4&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:28.026467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816283a-83fa-4962-9fec-94300aaa6a95 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:28.074424 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e511f8-a674-474f-a2f2-b7af87d09ef6 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:28.094368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:28.113391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:28.114737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a87fc-91e8-475a-bfbb-b68a31d2cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:28.115772 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a87fc-91e8-475a-bfbb-b68a31d2cf95 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:28.116269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a87fc-91e8-475a-bfbb-b68a31d2cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:28.116636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a87fc-91e8-475a-bfbb-b68a31d2cf95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:28.125867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a87fc-91e8-475a-bfbb-b68a31d2cf95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:28.127732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a87fc-91e8-475a-bfbb-b68a31d2cf95 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-213a87fc-91e8-475a-bfbb-b68a31d2cf95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:28.143634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:28.144607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:28.145580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:28.145580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:28.145580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:28.145580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:28.145580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:28.145580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:28.145580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:28.145580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:28.145580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 350/681] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:28.151192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a87fc-91e8-475a-bfbb-b68a31d2cf95 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:28.163292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816283a-83fa-4962-9fec-94300aaa6a95 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:28.213299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cd4ba-cc6b-4986-bd3a-a9eafce0d7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:28.214224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cd4ba-cc6b-4986-bd3a-a9eafce0d7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:28.214533 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cd4ba-cc6b-4986-bd3a-a9eafce0d7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:28.215202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cd4ba-cc6b-4986-bd3a-a9eafce0d7c2 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:28.216402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cd4ba-cc6b-4986-bd3a-a9eafce0d7c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:28.216719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cd4ba-cc6b-4986-bd3a-a9eafce0d7c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:28.219154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cd4ba-cc6b-4986-bd3a-a9eafce0d7c2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:28.243855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 332/682] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Jun 26 02:52:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:28.250388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cd4ba-cc6b-4986-bd3a-a9eafce0d7c2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:28.261719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a87fc-91e8-475a-bfbb-b68a31d2cf95 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:28.302605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591ce64-5d34-4093-8fc3-61cfc52f7f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:28.303359 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ce64-5d34-4093-8fc3-61cfc52f7f16 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:28.303732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ce64-5d34-4093-8fc3-61cfc52f7f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:28.304011 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ce64-5d34-4093-8fc3-61cfc52f7f16 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:28.304799 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591ce64-5d34-4093-8fc3-61cfc52f7f16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:28.305102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591ce64-5d34-4093-8fc3-61cfc52f7f16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:28.306636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591ce64-5d34-4093-8fc3-61cfc52f7f16 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:28.321344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 351/683] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:28.328380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591ce64-5d34-4093-8fc3-61cfc52f7f16 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:28.374255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:28.375649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cd4ba-cc6b-4986-bd3a-a9eafce0d7c2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:28.407566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:28.420828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6d58d-717d-4425-8563-ce254eea0a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:28.421901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d58d-717d-4425-8563-ce254eea0a43 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:28.422451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d58d-717d-4425-8563-ce254eea0a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:28.422735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d58d-717d-4425-8563-ce254eea0a43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:28.445004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591ce64-5d34-4093-8fc3-61cfc52f7f16 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:28.490553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca056316-46a1-4c77-8a34-c827372bd9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:28.491881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca056316-46a1-4c77-8a34-c827372bd9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:28.492220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca056316-46a1-4c77-8a34-c827372bd9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:28.492761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca056316-46a1-4c77-8a34-c827372bd9d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:28.493920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca056316-46a1-4c77-8a34-c827372bd9d9 None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=4169682bfc5043a3a3d4c638dae2a3bc) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:28.494555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca056316-46a1-4c77-8a34-c827372bd9d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:28.496969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca056316-46a1-4c77-8a34-c827372bd9d9 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:28.505333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 352/684] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:28 2022] GET /identity/v3/role_assignments?user.id=4169682bfc5043a3a3d4c638dae2a3bc&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:28.510612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6d58d-717d-4425-8563-ce254eea0a43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:28.512241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6d58d-717d-4425-8563-ce254eea0a43 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:28.625789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 333/685] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:28.631079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca056316-46a1-4c77-8a34-c827372bd9d9 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:28.733135 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f43c24-df20-4609-a50e-e1bf1ecb6cb7 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:28.733469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f43c24-df20-4609-a50e-e1bf1ecb6cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:28.733692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f43c24-df20-4609-a50e-e1bf1ecb6cb7 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:28.737576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 334/686] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:28.741018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6886-4df0-4f5f-a94d-20c8f937e6e8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:28.741299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6886-4df0-4f5f-a94d-20c8f937e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:28.741574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6886-4df0-4f5f-a94d-20c8f937e6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:28.749558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca056316-46a1-4c77-8a34-c827372bd9d9 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:28.761333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-beda6886-4df0-4f5f-a94d-20c8f937e6e8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:28.762512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-beda6886-4df0-4f5f-a94d-20c8f937e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:28.779492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:28.788579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:28.796387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094dc40-6794-4c9b-9782-36115005cf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:28.797944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094dc40-6794-4c9b-9782-36115005cf7d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:28.799327 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094dc40-6794-4c9b-9782-36115005cf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:28.800084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094dc40-6794-4c9b-9782-36115005cf7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:28.815523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094dc40-6794-4c9b-9782-36115005cf7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:28.817361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094dc40-6794-4c9b-9782-36115005cf7d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-a094dc40-6794-4c9b-9782-36115005cf7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:28.838862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:28.839857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:28.841097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:28.841097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:28.841097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:28.841097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:28.841097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 353/687] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:28.845624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094dc40-6794-4c9b-9782-36115005cf7d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:28.859238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 335/688] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:28.879905 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda6886-4df0-4f5f-a94d-20c8f937e6e8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:28.978179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094dc40-6794-4c9b-9782-36115005cf7d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:29.003551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda6886-4df0-4f5f-a94d-20c8f937e6e8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:29.015009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddee431-15d8-464a-82d6-5ca48b94f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:29.015831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddee431-15d8-464a-82d6-5ca48b94f3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:29.016205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddee431-15d8-464a-82d6-5ca48b94f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:29.016595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddee431-15d8-464a-82d6-5ca48b94f3a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:29.017457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddee431-15d8-464a-82d6-5ca48b94f3a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:29.017852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddee431-15d8-464a-82d6-5ca48b94f3a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:29.019557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddee431-15d8-464a-82d6-5ca48b94f3a3 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:29.032463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 354/689] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:29.043013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddee431-15d8-464a-82d6-5ca48b94f3a3 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:29.060957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e473c6-06fd-494f-8b05-aaa835823068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:29.062185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e473c6-06fd-494f-8b05-aaa835823068 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:29.062674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e473c6-06fd-494f-8b05-aaa835823068 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:29.063184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e473c6-06fd-494f-8b05-aaa835823068 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:29.070977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:29.086914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e473c6-06fd-494f-8b05-aaa835823068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-18e473c6-06fd-494f-8b05-aaa835823068 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:29.094925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:29.095883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:29.096720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:29.108243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 336/690] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:29.115963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e473c6-06fd-494f-8b05-aaa835823068 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:29.132688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:29.218244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddee431-15d8-464a-82d6-5ca48b94f3a3 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:29.252976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddf3a9-6262-4d0a-81d6-3b2ad4a9452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:29.253948 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddf3a9-6262-4d0a-81d6-3b2ad4a9452a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:29.254161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddf3a9-6262-4d0a-81d6-3b2ad4a9452a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:29.254435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddf3a9-6262-4d0a-81d6-3b2ad4a9452a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:29.261628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddf3a9-6262-4d0a-81d6-3b2ad4a9452a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:29.261956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e473c6-06fd-494f-8b05-aaa835823068 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:29.263225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddf3a9-6262-4d0a-81d6-3b2ad4a9452a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-dfddf3a9-6262-4d0a-81d6-3b2ad4a9452a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:29.277710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:29.278895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:29.280185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:29.280185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:29.280185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:29.280185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:29.280185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:29.280185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:29.280185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:29.280185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:29.283470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 355/691] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:29.284629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700ca29-234d-428c-918f-707c7fb16924 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:29.284914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700ca29-234d-428c-918f-707c7fb16924 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:29.285192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700ca29-234d-428c-918f-707c7fb16924 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:29.291077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 356/692] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:29.292264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700ca29-234d-428c-918f-707c7fb16924 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:29.304301 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d677be2-a161-449d-a827-b2154492575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:29.305609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d677be2-a161-449d-a827-b2154492575a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:29.306167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d677be2-a161-449d-a827-b2154492575a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:29.306694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d677be2-a161-449d-a827-b2154492575a None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:29.307889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d677be2-a161-449d-a827-b2154492575a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:29.308369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d677be2-a161-449d-a827-b2154492575a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:29.310673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d677be2-a161-449d-a827-b2154492575a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:29.325963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 337/693] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:29.325963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c2870-c77e-4c4b-a28a-306c8282d0b1 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:29.325963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c2870-c77e-4c4b-a28a-306c8282d0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:29.325963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c2870-c77e-4c4b-a28a-306c8282d0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:29.341472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-4e3c2870-c77e-4c4b-a28a-306c8282d0b1 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:29.342908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4e3c2870-c77e-4c4b-a28a-306c8282d0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:29.378284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:29.405630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:29.410107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700ca29-234d-428c-918f-707c7fb16924 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:29.411345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 338/694] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:29.412351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c2870-c77e-4c4b-a28a-306c8282d0b1 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:29.447847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae2d04-09d1-4319-a684-1233e0837af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:29.449041 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2d04-09d1-4319-a684-1233e0837af4 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:29.449333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2d04-09d1-4319-a684-1233e0837af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:29.449614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2d04-09d1-4319-a684-1233e0837af4 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:29.450442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae2d04-09d1-4319-a684-1233e0837af4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:29.450757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae2d04-09d1-4319-a684-1233e0837af4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:29.452239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae2d04-09d1-4319-a684-1233e0837af4 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:29.470441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 357/695] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:29.470441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae2d04-09d1-4319-a684-1233e0837af4 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:29.553367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c2870-c77e-4c4b-a28a-306c8282d0b1 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:29.581126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae2d04-09d1-4319-a684-1233e0837af4 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:29.594804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be022c-34f9-46a3-8364-fae3aa11d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:29.596518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be022c-34f9-46a3-8364-fae3aa11d5fd None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:29.597015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be022c-34f9-46a3-8364-fae3aa11d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:29.597489 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be022c-34f9-46a3-8364-fae3aa11d5fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:29.610825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be022c-34f9-46a3-8364-fae3aa11d5fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:29.613044 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be022c-34f9-46a3-8364-fae3aa11d5fd None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:29.615481 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70597721-c205-468d-94aa-60494db6cbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:29.616434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70597721-c205-468d-94aa-60494db6cbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:29.616672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70597721-c205-468d-94aa-60494db6cbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:29.617059 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70597721-c205-468d-94aa-60494db6cbb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:29.619049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:29.629552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70597721-c205-468d-94aa-60494db6cbb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:29.631168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70597721-c205-468d-94aa-60494db6cbb5 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-62be022c-34f9-46a3-8364-fae3aa11d5fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:29.635036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:29.635907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:29.636803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:29.636803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:29.636803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:29.636803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:29.639065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 339/696] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:29.640092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be022c-34f9-46a3-8364-fae3aa11d5fd None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-70597721-c205-468d-94aa-60494db6cbb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:29.655221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:29.656134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:29.657029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:29.657029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:29.657029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:29.657029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:29.665115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 358/697] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:29.665115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70597721-c205-468d-94aa-60494db6cbb5 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:29.705120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:29.755724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be022c-34f9-46a3-8364-fae3aa11d5fd None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:29.778362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70597721-c205-468d-94aa-60494db6cbb5 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:29.808454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22416117-0bd6-4cd8-ae6c-f887555ce963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:29.809074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22416117-0bd6-4cd8-ae6c-f887555ce963 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:29.809361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22416117-0bd6-4cd8-ae6c-f887555ce963 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:29.809644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22416117-0bd6-4cd8-ae6c-f887555ce963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:29.811229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22416117-0bd6-4cd8-ae6c-f887555ce963 None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=d585280109eb4773adf7d56fd722a4b4) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:29.811568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22416117-0bd6-4cd8-ae6c-f887555ce963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:29.813542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22416117-0bd6-4cd8-ae6c-f887555ce963 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:29.827011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 340/698] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:29 2022] GET /identity/v3/role_assignments?user.id=d585280109eb4773adf7d56fd722a4b4&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:29.827011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22416117-0bd6-4cd8-ae6c-f887555ce963 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:29.830141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9878b80-6ffc-4d37-a4f6-4ee02e0c3fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:29.830141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9878b80-6ffc-4d37-a4f6-4ee02e0c3fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:29.830371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9878b80-6ffc-4d37-a4f6-4ee02e0c3fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:29.832410 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9878b80-6ffc-4d37-a4f6-4ee02e0c3fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:29.833186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9878b80-6ffc-4d37-a4f6-4ee02e0c3fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:29.833499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9878b80-6ffc-4d37-a4f6-4ee02e0c3fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:29.836907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9878b80-6ffc-4d37-a4f6-4ee02e0c3fc3 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:29.865095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 359/699] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:29.870775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9878b80-6ffc-4d37-a4f6-4ee02e0c3fc3 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:29.971078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:30.025022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22416117-0bd6-4cd8-ae6c-f887555ce963 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:30.036605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9878b80-6ffc-4d37-a4f6-4ee02e0c3fc3 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:30.052121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:30.081010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc522f00-b773-439d-8225-4edabcaff74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:30.081619 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc522f00-b773-439d-8225-4edabcaff74f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:30.081910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc522f00-b773-439d-8225-4edabcaff74f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:30.082193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc522f00-b773-439d-8225-4edabcaff74f None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:30.083117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc522f00-b773-439d-8225-4edabcaff74f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:30.083432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc522f00-b773-439d-8225-4edabcaff74f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:30.085425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc522f00-b773-439d-8225-4edabcaff74f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:30.095212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f78023-bbed-4df3-8911-7ace05aacd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:30.096784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78023-bbed-4df3-8911-7ace05aacd3b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:30.097682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78023-bbed-4df3-8911-7ace05aacd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:30.098169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78023-bbed-4df3-8911-7ace05aacd3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:30.101327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 341/700] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:30.107134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc522f00-b773-439d-8225-4edabcaff74f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:30.113400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f78023-bbed-4df3-8911-7ace05aacd3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:30.115170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f78023-bbed-4df3-8911-7ace05aacd3b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-12f78023-bbed-4df3-8911-7ace05aacd3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:30.133151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:30.134105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:30.135635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:30.135635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:30.135635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:30.135635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:30.135635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:30.135635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:30.135635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:30.135635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:30.135635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:30.135635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:30.136664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 360/701] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Jun 26 02:52:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:30.142814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f78023-bbed-4df3-8911-7ace05aacd3b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:30.236269 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc522f00-b773-439d-8225-4edabcaff74f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:30.278697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f78023-bbed-4df3-8911-7ace05aacd3b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:30.279836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a764-19a5-4ebe-84fe-2344efdc6f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:30.280531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a764-19a5-4ebe-84fe-2344efdc6f86 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:30.280814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a764-19a5-4ebe-84fe-2344efdc6f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:30.281091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a764-19a5-4ebe-84fe-2344efdc6f86 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:30.281823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8a764-19a5-4ebe-84fe-2344efdc6f86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:30.283360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8a764-19a5-4ebe-84fe-2344efdc6f86 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:30.288104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:30.311128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 342/702] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:52:30 2022] POST /identity/v3/users => generated 254 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:30.322096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fbe1f-1567-4ead-8264-511af7ef9980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:30.323246 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbe1f-1567-4ead-8264-511af7ef9980 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:30.323957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbe1f-1567-4ead-8264-511af7ef9980 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:30.324423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fbe1f-1567-4ead-8264-511af7ef9980 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:30.325565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fbe1f-1567-4ead-8264-511af7ef9980 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:30.326083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fbe1f-1567-4ead-8264-511af7ef9980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:30.327928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fbe1f-1567-4ead-8264-511af7ef9980 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:30.351085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 361/703] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Jun 26 02:52:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:30.356179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a764-19a5-4ebe-84fe-2344efdc6f86 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:30.394742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:30.477521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a764-19a5-4ebe-84fe-2344efdc6f86 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:30.522825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a9cb7-9849-4bdc-94b8-60fb50404451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:30.523513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a9cb7-9849-4bdc-94b8-60fb50404451 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:30.523949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a9cb7-9849-4bdc-94b8-60fb50404451 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:30.524231 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a9cb7-9849-4bdc-94b8-60fb50404451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:30.600899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a9cb7-9849-4bdc-94b8-60fb50404451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:30.602439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a9cb7-9849-4bdc-94b8-60fb50404451 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:30.632535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:30.707481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 343/704] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 26 02:52:30.712691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fbe1f-1567-4ead-8264-511af7ef9980 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:30.750638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ec227-bc92-40ea-9040-0e2a0482c940 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:30.750975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ec227-bc92-40ea-9040-0e2a0482c940 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:30.751232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ec227-bc92-40ea-9040-0e2a0482c940 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:30.752895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 344/705] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:30.758194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca66aa9-1997-401c-87ba-de6a34e73401 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:30.758548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca66aa9-1997-401c-87ba-de6a34e73401 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:30.758780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca66aa9-1997-401c-87ba-de6a34e73401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:30.790402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-eca66aa9-1997-401c-87ba-de6a34e73401 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:30.792783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-eca66aa9-1997-401c-87ba-de6a34e73401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:30.842115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fbe1f-1567-4ead-8264-511af7ef9980 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:30.906590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082cbfa-dd5a-44dd-9e64-0890f2f7f33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:30.907374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082cbfa-dd5a-44dd-9e64-0890f2f7f33e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:30.907652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082cbfa-dd5a-44dd-9e64-0890f2f7f33e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:30.907918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082cbfa-dd5a-44dd-9e64-0890f2f7f33e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:30.918495 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 345/706] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 26 02:52:30.922677 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082cbfa-dd5a-44dd-9e64-0890f2f7f33e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:30.924294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082cbfa-dd5a-44dd-9e64-0890f2f7f33e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-d082cbfa-dd5a-44dd-9e64-0890f2f7f33e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:30.948002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:30.948954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:30.949862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:30.949862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:30.949862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:30.949862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:30.949862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 362/707] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:30.955123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca66aa9-1997-401c-87ba-de6a34e73401 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:30.964263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9d0cd-9f3a-4f25-8662-07d350983a6a None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:30.964547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9d0cd-9f3a-4f25-8662-07d350983a6a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:30.964823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9d0cd-9f3a-4f25-8662-07d350983a6a None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:30.966613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 363/708] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:30.968779 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9d0cd-9f3a-4f25-8662-07d350983a6a None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:30.986726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:31.030933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:31.076824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca66aa9-1997-401c-87ba-de6a34e73401 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:31.093563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9d0cd-9f3a-4f25-8662-07d350983a6a None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:31.110732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fdefc-f6dd-4bb6-bb0e-db6bba217e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:31.111441 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fdefc-f6dd-4bb6-bb0e-db6bba217e1c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:31.111720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fdefc-f6dd-4bb6-bb0e-db6bba217e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:31.111993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fdefc-f6dd-4bb6-bb0e-db6bba217e1c None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:31.112715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fdefc-f6dd-4bb6-bb0e-db6bba217e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:31.113021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fdefc-f6dd-4bb6-bb0e-db6bba217e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:31.114404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fdefc-f6dd-4bb6-bb0e-db6bba217e1c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:31.130674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 346/709] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:31.132123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbf5e1-ec42-4ad0-8158-c71faf6361c2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:31.132409 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbf5e1-ec42-4ad0-8158-c71faf6361c2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:31.132688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbf5e1-ec42-4ad0-8158-c71faf6361c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:31.135137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f5141-301f-49a8-8640-ee6a85eae797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:31.135959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f5141-301f-49a8-8640-ee6a85eae797 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:31.136238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f5141-301f-49a8-8640-ee6a85eae797 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:31.136507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f5141-301f-49a8-8640-ee6a85eae797 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:31.137178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f5141-301f-49a8-8640-ee6a85eae797 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:31.139625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f5141-301f-49a8-8640-ee6a85eae797 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:31.149998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5afbf5e1-ec42-4ad0-8158-c71faf6361c2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:31.151208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5afbf5e1-ec42-4ad0-8158-c71faf6361c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-145f5141-301f-49a8-8640-ee6a85eae797 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:31.160624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:31.161629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 26 02:52:31.162493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:31.164345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 364/710] 10.222.0.36 () {56 vars in 1129 bytes} [Sun Jun 26 02:52:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:31.165160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f5141-301f-49a8-8640-ee6a85eae797 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:31.228783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 347/711] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:31.230013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbf5e1-ec42-4ad0-8158-c71faf6361c2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:31.260370 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:31.280270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f5141-301f-49a8-8640-ee6a85eae797 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:31.305721 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:31.317234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd4c9d-7a6f-42bd-b5cc-fc92364c53f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:31.318303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4c9d-7a6f-42bd-b5cc-fc92364c53f5 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:31.318756 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4c9d-7a6f-42bd-b5cc-fc92364c53f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:31.319225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4c9d-7a6f-42bd-b5cc-fc92364c53f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:31.326694 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd4c9d-7a6f-42bd-b5cc-fc92364c53f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:31.328427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd4c9d-7a6f-42bd-b5cc-fc92364c53f5 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-74bd4c9d-7a6f-42bd-b5cc-fc92364c53f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:31.343941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:31.344866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:31.345769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:31.345769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:31.345769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:31.345769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:31.345769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:31.345769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:31.345769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:31.345769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:31.352836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 365/712] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:31.354010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd4c9d-7a6f-42bd-b5cc-fc92364c53f5 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:31.355461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbf5e1-ec42-4ad0-8158-c71faf6361c2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:31.391074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de2a13-d168-4d79-904e-d14de7fdeb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:31.391755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de2a13-d168-4d79-904e-d14de7fdeb45 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:31.392037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de2a13-d168-4d79-904e-d14de7fdeb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:31.392314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de2a13-d168-4d79-904e-d14de7fdeb45 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:31.393125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de2a13-d168-4d79-904e-d14de7fdeb45 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:31.393521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de2a13-d168-4d79-904e-d14de7fdeb45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:31.395050 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de2a13-d168-4d79-904e-d14de7fdeb45 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:31.400148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 348/713] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Jun 26 02:52:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:31.400970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de2a13-d168-4d79-904e-d14de7fdeb45 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:31.469834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd4c9d-7a6f-42bd-b5cc-fc92364c53f5 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:31.510249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de2a13-d168-4d79-904e-d14de7fdeb45 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:31.514456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889c1f8-0f3e-4776-b097-4528d08c5d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:31.515531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c1f8-0f3e-4776-b097-4528d08c5d4d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:31.516008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c1f8-0f3e-4776-b097-4528d08c5d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:31.516489 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c1f8-0f3e-4776-b097-4528d08c5d4d None admin] PATH_INFO: `/v3/services/network` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:31.517344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889c1f8-0f3e-4776-b097-4528d08c5d4d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:31.518949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889c1f8-0f3e-4776-b097-4528d08c5d4d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:31.527920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-b889c1f8-0f3e-4776-b097-4528d08c5d4d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:31.532581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:31.533547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 26 02:52:31.534405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:31.545622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 366/714] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:31 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:31.545622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889c1f8-0f3e-4776-b097-4528d08c5d4d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:31.549502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8a94b-9bc2-414d-80d3-182d01f55903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:31.550240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8a94b-9bc2-414d-80d3-182d01f55903 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:31.550610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8a94b-9bc2-414d-80d3-182d01f55903 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:31.550973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8a94b-9bc2-414d-80d3-182d01f55903 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:31.551876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8a94b-9bc2-414d-80d3-182d01f55903 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:31.552248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8a94b-9bc2-414d-80d3-182d01f55903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:31.552481 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:31.554201 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8a94b-9bc2-414d-80d3-182d01f55903 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:31.572188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 349/715] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:31.573138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8a94b-9bc2-414d-80d3-182d01f55903 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:31.665071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889c1f8-0f3e-4776-b097-4528d08c5d4d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:31.678836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8a94b-9bc2-414d-80d3-182d01f55903 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:31.707742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafe020-be7e-4b2b-8661-b7ea85b8de2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:31.708535 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafe020-be7e-4b2b-8661-b7ea85b8de2a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:31.708878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafe020-be7e-4b2b-8661-b7ea85b8de2a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:31.709442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafe020-be7e-4b2b-8661-b7ea85b8de2a None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:31.710599 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafe020-be7e-4b2b-8661-b7ea85b8de2a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:31.710975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafe020-be7e-4b2b-8661-b7ea85b8de2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:31.712699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafe020-be7e-4b2b-8661-b7ea85b8de2a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:31.715608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edca7f-4bcb-4178-a427-91c5b6d50116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:31.717566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edca7f-4bcb-4178-a427-91c5b6d50116 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:31.718094 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edca7f-4bcb-4178-a427-91c5b6d50116 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:31.718567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edca7f-4bcb-4178-a427-91c5b6d50116 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:31.719182 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 367/716] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Jun 26 02:52:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:31.720014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edca7f-4bcb-4178-a427-91c5b6d50116 None admin] RBAC: Adding query filter params (name=network) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:31.720121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafe020-be7e-4b2b-8661-b7ea85b8de2a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:31.720720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edca7f-4bcb-4178-a427-91c5b6d50116 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:31.722406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edca7f-4bcb-4178-a427-91c5b6d50116 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:31.729080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 350/717] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:52:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:31.739860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edca7f-4bcb-4178-a427-91c5b6d50116 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:31.822223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:31.842289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:31.866201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafe020-be7e-4b2b-8661-b7ea85b8de2a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:31.917800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb32ee-0729-4001-beca-afa550cae5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:31.918469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb32ee-0729-4001-beca-afa550cae5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:31.918751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb32ee-0729-4001-beca-afa550cae5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:31.919093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb32ee-0729-4001-beca-afa550cae5d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:31.919941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb32ee-0729-4001-beca-afa550cae5d5 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=24319e5e83ed4caf9dd3ae4b3937b3fb) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:31.920254 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb32ee-0729-4001-beca-afa550cae5d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:31.922324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb32ee-0729-4001-beca-afa550cae5d5 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:31.931293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 368/718] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:31 2022] GET /identity/v3/role_assignments?user.id=24319e5e83ed4caf9dd3ae4b3937b3fb&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:31.939393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edca7f-4bcb-4178-a427-91c5b6d50116 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:31.987367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fb6ec-57b9-4c0c-a66d-0aa39fd76d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:31.988392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fb6ec-57b9-4c0c-a66d-0aa39fd76d5e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:31.988873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fb6ec-57b9-4c0c-a66d-0aa39fd76d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:31.989386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fb6ec-57b9-4c0c-a66d-0aa39fd76d5e None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:31.990317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fb6ec-57b9-4c0c-a66d-0aa39fd76d5e None admin] RBAC: Adding query filter params (type=network) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:31.990898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fb6ec-57b9-4c0c-a66d-0aa39fd76d5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:31.992563 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fb6ec-57b9-4c0c-a66d-0aa39fd76d5e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:32.000210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 351/719] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:52:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:32.428880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d427e-68ad-40a3-b727-c783d03099d1 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:32.429438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d427e-68ad-40a3-b727-c783d03099d1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:32.429438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d427e-68ad-40a3-b727-c783d03099d1 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:32.431103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 369/720] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:32.436639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8584c29-6ae7-40e1-a4bc-1d47956dacc0 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:32.437460 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8584c29-6ae7-40e1-a4bc-1d47956dacc0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:32.437942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8584c29-6ae7-40e1-a4bc-1d47956dacc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:32.459161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e8584c29-6ae7-40e1-a4bc-1d47956dacc0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:32.460707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e8584c29-6ae7-40e1-a4bc-1d47956dacc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:32.559346 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 352/721] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:32.577448 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d427e-68ad-40a3-b727-c783d03099d1 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:32.756729 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d427e-68ad-40a3-b727-c783d03099d1 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:32.797033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:32.803299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bba0c-d2c6-4288-9482-aa0ce690ffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:32.807889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bba0c-d2c6-4288-9482-aa0ce690ffa5 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:32.808180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bba0c-d2c6-4288-9482-aa0ce690ffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:32.808465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bba0c-d2c6-4288-9482-aa0ce690ffa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:32.821779 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bba0c-d2c6-4288-9482-aa0ce690ffa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-782bba0c-d2c6-4288-9482-aa0ce690ffa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:32.829554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:32.830496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:32.831353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 370/722] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:32.838379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8584c29-6ae7-40e1-a4bc-1d47956dacc0 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:32.908070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:32.980933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fe5fc-5884-492e-951f-61940eef2993 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:32.981361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fe5fc-5884-492e-951f-61940eef2993 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:32.981595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fe5fc-5884-492e-951f-61940eef2993 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:32.983228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 371/723] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:32.988083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80bced-6794-464e-bd07-0318e83c5414 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:32.988372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80bced-6794-464e-bd07-0318e83c5414 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:32.988657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80bced-6794-464e-bd07-0318e83c5414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:32.994296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8584c29-6ae7-40e1-a4bc-1d47956dacc0 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:33.030134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510bf6-d690-4dc8-b0b3-e859dfb4a4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:33.030809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510bf6-d690-4dc8-b0b3-e859dfb4a4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:33.031117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510bf6-d690-4dc8-b0b3-e859dfb4a4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:33.031395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510bf6-d690-4dc8-b0b3-e859dfb4a4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:33.032197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08510bf6-d690-4dc8-b0b3-e859dfb4a4d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:33.032500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08510bf6-d690-4dc8-b0b3-e859dfb4a4d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:33.033930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08510bf6-d690-4dc8-b0b3-e859dfb4a4d0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:33.034849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-9e80bced-6794-464e-bd07-0318e83c5414 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:33.036075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9e80bced-6794-464e-bd07-0318e83c5414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:33.042918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 353/724] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:33.048301 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510bf6-d690-4dc8-b0b3-e859dfb4a4d0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:33.156048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510bf6-d690-4dc8-b0b3-e859dfb4a4d0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:33.159356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:33.192384 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4e2cc-fecc-4b01-b137-36213bc2aa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:33.193241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4e2cc-fecc-4b01-b137-36213bc2aa84 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:33.193522 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4e2cc-fecc-4b01-b137-36213bc2aa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:33.193840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4e2cc-fecc-4b01-b137-36213bc2aa84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:33.205792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4e2cc-fecc-4b01-b137-36213bc2aa84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:33.207282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4e2cc-fecc-4b01-b137-36213bc2aa84 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-05c4e2cc-fecc-4b01-b137-36213bc2aa84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:33.226729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:33.227807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:33.228704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:33.228704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:33.228704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:33.228704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:33.228704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 354/725] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:33.235159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4e2cc-fecc-4b01-b137-36213bc2aa84 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:33.273415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 372/726] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:33.312867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80bced-6794-464e-bd07-0318e83c5414 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:33.402708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4e2cc-fecc-4b01-b137-36213bc2aa84 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:33.439407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9349d7-ea6c-4e52-8c48-10ae0635f8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:33.440853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9349d7-ea6c-4e52-8c48-10ae0635f8bc None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:33.441364 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9349d7-ea6c-4e52-8c48-10ae0635f8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:33.441845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9349d7-ea6c-4e52-8c48-10ae0635f8bc None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:33.442808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9349d7-ea6c-4e52-8c48-10ae0635f8bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:33.443336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9349d7-ea6c-4e52-8c48-10ae0635f8bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:33.444925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9349d7-ea6c-4e52-8c48-10ae0635f8bc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:33.458115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 355/727] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:33.463866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9349d7-ea6c-4e52-8c48-10ae0635f8bc None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:33.495382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:33.547066 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80bced-6794-464e-bd07-0318e83c5414 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:33.565903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9349d7-ea6c-4e52-8c48-10ae0635f8bc None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:33.601029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:33.601929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b664d-44a0-4723-9dba-4d96b3d59be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:33.603144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b664d-44a0-4723-9dba-4d96b3d59be6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:33.603631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b664d-44a0-4723-9dba-4d96b3d59be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:33.604104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b664d-44a0-4723-9dba-4d96b3d59be6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:33.612272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b664d-44a0-4723-9dba-4d96b3d59be6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:33.614002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b664d-44a0-4723-9dba-4d96b3d59be6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:33.615691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c730-3b53-4b4d-92d6-8116ad46b55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:33.616522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c730-3b53-4b4d-92d6-8116ad46b55a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:33.616808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c730-3b53-4b4d-92d6-8116ad46b55a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:33.617088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c730-3b53-4b4d-92d6-8116ad46b55a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-544b664d-44a0-4723-9dba-4d96b3d59be6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:33.629848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:33.630827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:33.631799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:33.631799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:33.631799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:33.631799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:33.631799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:33.631799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:33.631799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:33.631799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:33.631799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:33.631799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:33.632335 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86c730-3b53-4b4d-92d6-8116ad46b55a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:33.634511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 356/728] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:33.640288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b664d-44a0-4723-9dba-4d96b3d59be6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-cc86c730-3b53-4b4d-92d6-8116ad46b55a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:33.648383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:33.649337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:33.650170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 373/729] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:33.655412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c730-3b53-4b4d-92d6-8116ad46b55a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:33.743446 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:33.748796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b664d-44a0-4723-9dba-4d96b3d59be6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:33.790593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d110-ca9b-4e86-b1c8-abce34ff45f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:33.792101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d110-ca9b-4e86-b1c8-abce34ff45f9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:33.792592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d110-ca9b-4e86-b1c8-abce34ff45f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:33.793070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d110-ca9b-4e86-b1c8-abce34ff45f9 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:33.794223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867d110-ca9b-4e86-b1c8-abce34ff45f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:33.794753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867d110-ca9b-4e86-b1c8-abce34ff45f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:33.796741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867d110-ca9b-4e86-b1c8-abce34ff45f9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:33.817936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 357/730] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Jun 26 02:52:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:33.824337 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d110-ca9b-4e86-b1c8-abce34ff45f9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:33.849169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c730-3b53-4b4d-92d6-8116ad46b55a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:33.920580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51b5e7-be63-49b7-ba1e-6eae32e77c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:33.921262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51b5e7-be63-49b7-ba1e-6eae32e77c8e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:33.921541 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51b5e7-be63-49b7-ba1e-6eae32e77c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:33.921813 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51b5e7-be63-49b7-ba1e-6eae32e77c8e None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:33.922790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51b5e7-be63-49b7-ba1e-6eae32e77c8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:33.922910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51b5e7-be63-49b7-ba1e-6eae32e77c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:33.924334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51b5e7-be63-49b7-ba1e-6eae32e77c8e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:33.939185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d110-ca9b-4e86-b1c8-abce34ff45f9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:33.942716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 374/731] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:33.948053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51b5e7-be63-49b7-ba1e-6eae32e77c8e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:33.969223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:33.980376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7ce12-43a3-437e-827b-c79f2ce73e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:33.981448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ce12-43a3-437e-827b-c79f2ce73e37 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:33.981880 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ce12-43a3-437e-827b-c79f2ce73e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:33.982564 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ce12-43a3-437e-827b-c79f2ce73e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.039336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:34.081650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7ce12-43a3-437e-827b-c79f2ce73e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:34.083066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7ce12-43a3-437e-827b-c79f2ce73e37 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:34.147462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51b5e7-be63-49b7-ba1e-6eae32e77c8e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:34.183561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c0be5-f8da-42c5-8d98-04518657b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:34.184551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c0be5-f8da-42c5-8d98-04518657b73f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.184958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c0be5-f8da-42c5-8d98-04518657b73f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.185328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c0be5-f8da-42c5-8d98-04518657b73f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.190928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 358/732] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 26 02:52:34.196701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cfd87-cacb-4b14-b890-f8922685605c None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.196999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cfd87-cacb-4b14-b890-f8922685605c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.197283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cfd87-cacb-4b14-b890-f8922685605c None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.197719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c0be5-f8da-42c5-8d98-04518657b73f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:34.198620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 359/733] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:34.199350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cfd87-cacb-4b14-b890-f8922685605c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:34.203542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c0be5-f8da-42c5-8d98-04518657b73f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-8e5c0be5-f8da-42c5-8d98-04518657b73f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:34.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:34.222704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:34.223620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:34.223620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:34.223620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:34.223620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:34.227596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 375/734] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:34.228911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64674c6-457a-455b-8bf7-d96a142f2da7 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.229204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64674c6-457a-455b-8bf7-d96a142f2da7 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.231200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64674c6-457a-455b-8bf7-d96a142f2da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.235435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:34.247181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-b64674c6-457a-455b-8bf7-d96a142f2da7 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:34.248373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b64674c6-457a-455b-8bf7-d96a142f2da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:34.305985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cfd87-cacb-4b14-b890-f8922685605c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:34.318575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 376/735] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:34.319856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64674c6-457a-455b-8bf7-d96a142f2da7 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:34.348508 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e05937-5d62-4609-8c37-f2f575eb65ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:34.349312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05937-5d62-4609-8c37-f2f575eb65ee None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.349659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05937-5d62-4609-8c37-f2f575eb65ee None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.349995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05937-5d62-4609-8c37-f2f575eb65ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.355290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:34.361584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e05937-5d62-4609-8c37-f2f575eb65ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:34.363092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e05937-5d62-4609-8c37-f2f575eb65ee None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-50e05937-5d62-4609-8c37-f2f575eb65ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:34.381575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:34.382509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:34.384198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:34.384198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:34.384198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:34.384198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:34.384198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 360/736] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:34.384198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05750-7c2d-41c0-b13b-4ba4ed0872b0 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.384547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05750-7c2d-41c0-b13b-4ba4ed0872b0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.384627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05750-7c2d-41c0-b13b-4ba4ed0872b0 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.386024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 361/737] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:34.386726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e05750-7c2d-41c0-b13b-4ba4ed0872b0 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:34.438956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64674c6-457a-455b-8bf7-d96a142f2da7 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:34.469753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:34.475083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8428a-48a7-46a8-96ec-3aad5a2bc32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:34.475768 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8428a-48a7-46a8-96ec-3aad5a2bc32c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.476056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8428a-48a7-46a8-96ec-3aad5a2bc32c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.476336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8428a-48a7-46a8-96ec-3aad5a2bc32c None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.479820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8428a-48a7-46a8-96ec-3aad5a2bc32c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:34.479820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8428a-48a7-46a8-96ec-3aad5a2bc32c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:34.479820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8428a-48a7-46a8-96ec-3aad5a2bc32c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:34.494878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 377/738] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:34.494878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8428a-48a7-46a8-96ec-3aad5a2bc32c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:34.502954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e05750-7c2d-41c0-b13b-4ba4ed0872b0 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:34.545616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb34e6-d6c6-427d-8ac0-2546799b05a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:34.546445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb34e6-d6c6-427d-8ac0-2546799b05a2 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.546725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb34e6-d6c6-427d-8ac0-2546799b05a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.547350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb34e6-d6c6-427d-8ac0-2546799b05a2 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.548358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb34e6-d6c6-427d-8ac0-2546799b05a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:34.550221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb34e6-d6c6-427d-8ac0-2546799b05a2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:34.571161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 362/739] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:52:34 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:34.572537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a013b-2532-490c-904a-cf2785e7eba2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.572829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a013b-2532-490c-904a-cf2785e7eba2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.573107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a013b-2532-490c-904a-cf2785e7eba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.592291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-470a013b-2532-490c-904a-cf2785e7eba2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:34.593591 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-470a013b-2532-490c-904a-cf2785e7eba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:34.595465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:34.620350 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8428a-48a7-46a8-96ec-3aad5a2bc32c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:34.680328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd71fc-71a0-450a-9814-af050831dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:34.681798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd71fc-71a0-450a-9814-af050831dc50 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.682413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd71fc-71a0-450a-9814-af050831dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.683034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd71fc-71a0-450a-9814-af050831dc50 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.683974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd71fc-71a0-450a-9814-af050831dc50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:34.684475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd71fc-71a0-450a-9814-af050831dc50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:34.686215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd71fc-71a0-450a-9814-af050831dc50 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:34.691414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 363/740] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:34.692486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a013b-2532-490c-904a-cf2785e7eba2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:34.704837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 378/741] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:34.711844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd71fc-71a0-450a-9814-af050831dc50 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:34.789030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:34.832028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a013b-2532-490c-904a-cf2785e7eba2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:34.838650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd71fc-71a0-450a-9814-af050831dc50 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:34.866143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0649d6c-e356-4de9-b6f1-e1b66b735f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:34.866973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0649d6c-e356-4de9-b6f1-e1b66b735f09 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.867292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0649d6c-e356-4de9-b6f1-e1b66b735f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.867564 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0649d6c-e356-4de9-b6f1-e1b66b735f09 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.874667 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d63430-0ef8-4f4d-aaf4-94777e3cc1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:34.875437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d63430-0ef8-4f4d-aaf4-94777e3cc1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.875650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0649d6c-e356-4de9-b6f1-e1b66b735f09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:34.875763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d63430-0ef8-4f4d-aaf4-94777e3cc1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.875987 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d63430-0ef8-4f4d-aaf4-94777e3cc1a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.877211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0649d6c-e356-4de9-b6f1-e1b66b735f09 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:34.882974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d63430-0ef8-4f4d-aaf4-94777e3cc1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:34.884454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d63430-0ef8-4f4d-aaf4-94777e3cc1a6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b0649d6c-e356-4de9-b6f1-e1b66b735f09 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:34.891995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:34.892930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 364/742] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Jun 26 02:52:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:34.898614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0649d6c-e356-4de9-b6f1-e1b66b735f09 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-d2d63430-0ef8-4f4d-aaf4-94777e3cc1a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:34.899478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:34.900275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:34.902295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:34.902295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:34.902295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:34.902295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:34.902295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:34.902295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:34.902295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:34.902295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:34.902295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 379/743] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:34.902295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec3648-d9bc-4133-a872-78131b9e4ad1 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:34.902295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec3648-d9bc-4133-a872-78131b9e4ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:34.903837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec3648-d9bc-4133-a872-78131b9e4ad1 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:34.907125 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 380/744] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:34.908149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec3648-d9bc-4133-a872-78131b9e4ad1 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:34.911595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:35.005484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0649d6c-e356-4de9-b6f1-e1b66b735f09 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:35.017998 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec3648-d9bc-4133-a872-78131b9e4ad1 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:35.028794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:35.040146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df44494-53e7-4ca0-8253-581f0ce144c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:35.041722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df44494-53e7-4ca0-8253-581f0ce144c9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:35.042006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df44494-53e7-4ca0-8253-581f0ce144c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:35.042434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df44494-53e7-4ca0-8253-581f0ce144c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:35.054843 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df44494-53e7-4ca0-8253-581f0ce144c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:35.058365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc015a-165f-4294-b420-c3ed38a4a36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:35.059058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc015a-165f-4294-b420-c3ed38a4a36f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:35.059338 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc015a-165f-4294-b420-c3ed38a4a36f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:35.059604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc015a-165f-4294-b420-c3ed38a4a36f None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:35.060445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc015a-165f-4294-b420-c3ed38a4a36f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:35.060744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc015a-165f-4294-b420-c3ed38a4a36f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:35.062452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc015a-165f-4294-b420-c3ed38a4a36f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-4df44494-53e7-4ca0-8253-581f0ce144c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:35.062549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:35.063454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 365/745] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:35.069740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df44494-53e7-4ca0-8253-581f0ce144c9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:35.092038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 381/746] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Jun 26 02:52:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:35.092557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f178d9-fcd5-480a-a268-7394d70d944c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:35.092853 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f178d9-fcd5-480a-a268-7394d70d944c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:35.093133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f178d9-fcd5-480a-a268-7394d70d944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:35.110962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-98f178d9-fcd5-480a-a268-7394d70d944c None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:35.112402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-98f178d9-fcd5-480a-a268-7394d70d944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:35.167891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df44494-53e7-4ca0-8253-581f0ce144c9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:35.171482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:35.191012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 382/747] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 26 02:52:35.191012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f178d9-fcd5-480a-a268-7394d70d944c None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:35.214061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec230ff-4a02-43b0-87fb-97dee3ca82ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:35.214710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec230ff-4a02-43b0-87fb-97dee3ca82ce None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:35.215018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec230ff-4a02-43b0-87fb-97dee3ca82ce None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:35.215328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec230ff-4a02-43b0-87fb-97dee3ca82ce None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:35.216119 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec230ff-4a02-43b0-87fb-97dee3ca82ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:35.216438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec230ff-4a02-43b0-87fb-97dee3ca82ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:35.217896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec230ff-4a02-43b0-87fb-97dee3ca82ce None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:35.231932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 366/748] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:35.232760 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec230ff-4a02-43b0-87fb-97dee3ca82ce None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:35.280404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:35.295802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f178d9-fcd5-480a-a268-7394d70d944c None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:35.329566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816498b-41d6-437b-a99a-96702ca20b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:35.330251 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816498b-41d6-437b-a99a-96702ca20b28 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:35.330539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816498b-41d6-437b-a99a-96702ca20b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:35.330823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816498b-41d6-437b-a99a-96702ca20b28 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:35.331607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816498b-41d6-437b-a99a-96702ca20b28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:35.331923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816498b-41d6-437b-a99a-96702ca20b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:35.333322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816498b-41d6-437b-a99a-96702ca20b28 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:35.338603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec230ff-4a02-43b0-87fb-97dee3ca82ce None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:35.341520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 383/749] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:35.342115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816498b-41d6-437b-a99a-96702ca20b28 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:35.379007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5f34-1cd8-41ee-be4e-25b8370e870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:35.379767 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5f34-1cd8-41ee-be4e-25b8370e870b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:35.380061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5f34-1cd8-41ee-be4e-25b8370e870b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:35.380338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5f34-1cd8-41ee-be4e-25b8370e870b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:35.396149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:35.443296 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816498b-41d6-437b-a99a-96702ca20b28 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:35.448225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d5f34-1cd8-41ee-be4e-25b8370e870b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:35.449688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d5f34-1cd8-41ee-be4e-25b8370e870b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:35.475523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a2ff8-6c9e-4419-87b6-ba377305c0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:35.476195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a2ff8-6c9e-4419-87b6-ba377305c0ac None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:35.476478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a2ff8-6c9e-4419-87b6-ba377305c0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:35.476758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a2ff8-6c9e-4419-87b6-ba377305c0ac None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:35.477495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a2ff8-6c9e-4419-87b6-ba377305c0ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:35.478881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a2ff8-6c9e-4419-87b6-ba377305c0ac None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:35.503012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 384/750] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:52:35 2022] POST /identity/v3/services => generated 240 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:35.503012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a2ff8-6c9e-4419-87b6-ba377305c0ac None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:35.511313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:35.579507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 367/751] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:35 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 26 02:52:35.580471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5f34-1cd8-41ee-be4e-25b8370e870b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:35.622940 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a2ff8-6c9e-4419-87b6-ba377305c0ac None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:35.633271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:35.662775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275f3f1-f12a-43bd-bbb1-3c299aa5f1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:35.663475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275f3f1-f12a-43bd-bbb1-3c299aa5f1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:35.663753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275f3f1-f12a-43bd-bbb1-3c299aa5f1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:35.664113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275f3f1-f12a-43bd-bbb1-3c299aa5f1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:35.664952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275f3f1-f12a-43bd-bbb1-3c299aa5f1f5 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=d585280109eb4773adf7d56fd722a4b4) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:35.665262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275f3f1-f12a-43bd-bbb1-3c299aa5f1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:35.667091 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275f3f1-f12a-43bd-bbb1-3c299aa5f1f5 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:35.673830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 385/752] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:35 2022] GET /identity/v3/role_assignments?user.id=d585280109eb4773adf7d56fd722a4b4&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:35.674635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275f3f1-f12a-43bd-bbb1-3c299aa5f1f5 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:35.697844 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5f34-1cd8-41ee-be4e-25b8370e870b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:35.743235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f32006-909b-4119-9b81-78b1ef1bffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:35.744937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f32006-909b-4119-9b81-78b1ef1bffc4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:35.745561 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f32006-909b-4119-9b81-78b1ef1bffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:35.746102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f32006-909b-4119-9b81-78b1ef1bffc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:35.763649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f32006-909b-4119-9b81-78b1ef1bffc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:35.765180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f32006-909b-4119-9b81-78b1ef1bffc4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:35.782360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-46f32006-909b-4119-9b81-78b1ef1bffc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:35.795340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:35.796491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:35.797615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:35.797615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:35.797615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:35.797615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:35.800690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 368/753] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:35.802179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275f3f1-f12a-43bd-bbb1-3c299aa5f1f5 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:35.805884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f32006-909b-4119-9b81-78b1ef1bffc4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:35.866035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470011-1a48-42db-b401-fa1d22cac71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:35.866854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470011-1a48-42db-b401-fa1d22cac71d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:35.867164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470011-1a48-42db-b401-fa1d22cac71d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:35.867451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470011-1a48-42db-b401-fa1d22cac71d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:35.881698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470011-1a48-42db-b401-fa1d22cac71d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:35.883212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470011-1a48-42db-b401-fa1d22cac71d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-31470011-1a48-42db-b401-fa1d22cac71d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:35.901945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:35.902890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:35.903887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:35.903887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:35.903887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:35.903887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:35.903887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 386/754] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:35.911025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470011-1a48-42db-b401-fa1d22cac71d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:35.934631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f32006-909b-4119-9b81-78b1ef1bffc4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:35.940506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:35.979123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7525868-2b4d-4872-b0be-1de294ae41fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:35.980135 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7525868-2b4d-4872-b0be-1de294ae41fe None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:35.980587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7525868-2b4d-4872-b0be-1de294ae41fe None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:35.981050 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7525868-2b4d-4872-b0be-1de294ae41fe None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:35.981977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7525868-2b4d-4872-b0be-1de294ae41fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:35.982425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7525868-2b4d-4872-b0be-1de294ae41fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:35.984058 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7525868-2b4d-4872-b0be-1de294ae41fe None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:36.005563 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 369/755] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:36.011325 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7525868-2b4d-4872-b0be-1de294ae41fe None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:36.019899 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470011-1a48-42db-b401-fa1d22cac71d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:36.055312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dc69b-17eb-4ea0-87ab-7e130013c8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:36.055908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc69b-17eb-4ea0-87ab-7e130013c8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:36.056462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc69b-17eb-4ea0-87ab-7e130013c8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:36.056814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc69b-17eb-4ea0-87ab-7e130013c8f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:36.057763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dc69b-17eb-4ea0-87ab-7e130013c8f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:36.058141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dc69b-17eb-4ea0-87ab-7e130013c8f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:36.059811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dc69b-17eb-4ea0-87ab-7e130013c8f1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:36.073377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 387/756] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:36.078464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dc69b-17eb-4ea0-87ab-7e130013c8f1 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:36.113244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:36.219334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:36.220361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7525868-2b4d-4872-b0be-1de294ae41fe None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:36.250916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dc69b-17eb-4ea0-87ab-7e130013c8f1 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:36.288314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37539c-f7e0-4fd7-901f-e1d3daff6244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:36.289162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37539c-f7e0-4fd7-901f-e1d3daff6244 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:36.289451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37539c-f7e0-4fd7-901f-e1d3daff6244 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:36.289729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37539c-f7e0-4fd7-901f-e1d3daff6244 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:36.303032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7db13-aa97-4a70-9236-ce094815e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:36.303870 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7db13-aa97-4a70-9236-ce094815e71f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:36.304202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7db13-aa97-4a70-9236-ce094815e71f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:36.304489 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7db13-aa97-4a70-9236-ce094815e71f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:36.308583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37539c-f7e0-4fd7-901f-e1d3daff6244 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:36.311252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37539c-f7e0-4fd7-901f-e1d3daff6244 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:36.319682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7db13-aa97-4a70-9236-ce094815e71f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:36.325800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7db13-aa97-4a70-9236-ce094815e71f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-6a37539c-f7e0-4fd7-901f-e1d3daff6244 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:36.338454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:36.339448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:36.340362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:36.340362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:36.340362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:36.340362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:36.340362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:36.340362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:36.340362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:36.340362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:36.340362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:36.340362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:36.340362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 370/757] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Jun 26 02:52:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:36.345673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37539c-f7e0-4fd7-901f-e1d3daff6244 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-6df7db13-aa97-4a70-9236-ce094815e71f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:36.352771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:36.354708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:36.356102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:36.356102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:36.356102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:36.356102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:36.356102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:36.356102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:36.356102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:36.356102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:36.356102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 388/758] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:36.368109 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7db13-aa97-4a70-9236-ce094815e71f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:36.560235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37539c-f7e0-4fd7-901f-e1d3daff6244 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:36.591357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:36.599595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7db13-aa97-4a70-9236-ce094815e71f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:36.638924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891915-9aa3-4ff6-8a9a-895168fed682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:36.639738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891915-9aa3-4ff6-8a9a-895168fed682 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:36.640013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891915-9aa3-4ff6-8a9a-895168fed682 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:36.640164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891915-9aa3-4ff6-8a9a-895168fed682 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:36.640925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c891915-9aa3-4ff6-8a9a-895168fed682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:36.641231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c891915-9aa3-4ff6-8a9a-895168fed682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:36.642675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c891915-9aa3-4ff6-8a9a-895168fed682 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:36.646193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ebf2c-99f1-4a9a-9939-cb00f48aa663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:36.646868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ebf2c-99f1-4a9a-9939-cb00f48aa663 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:36.647169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ebf2c-99f1-4a9a-9939-cb00f48aa663 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:36.647445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ebf2c-99f1-4a9a-9939-cb00f48aa663 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:36.648290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ebf2c-99f1-4a9a-9939-cb00f48aa663 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:36.648596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ebf2c-99f1-4a9a-9939-cb00f48aa663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:36.650002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ebf2c-99f1-4a9a-9939-cb00f48aa663 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:36.675001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 389/759] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:36.678453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 371/760] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Jun 26 02:52:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:36.685631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891915-9aa3-4ff6-8a9a-895168fed682 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:36.690300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ebf2c-99f1-4a9a-9939-cb00f48aa663 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:36.695319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:36.809122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ebf2c-99f1-4a9a-9939-cb00f48aa663 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:36.832628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891915-9aa3-4ff6-8a9a-895168fed682 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:36.858477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31488ac-83da-4732-b62b-4035e2965f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:36.859450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31488ac-83da-4732-b62b-4035e2965f65 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:36.860160 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31488ac-83da-4732-b62b-4035e2965f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:36.860622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31488ac-83da-4732-b62b-4035e2965f65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:36.861990 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31488ac-83da-4732-b62b-4035e2965f65 None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=d78da06180d0420f82074fa5e3cbc71e) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:36.862474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31488ac-83da-4732-b62b-4035e2965f65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:36.864625 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31488ac-83da-4732-b62b-4035e2965f65 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:36.872735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 372/761] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:36 2022] GET /identity/v3/role_assignments?user.id=d78da06180d0420f82074fa5e3cbc71e&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:36.874303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1391f1-9cf7-467b-bd36-aa68708ebb6b None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:36.874749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1391f1-9cf7-467b-bd36-aa68708ebb6b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:36.875216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1391f1-9cf7-467b-bd36-aa68708ebb6b None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:36.876896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 373/762] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:36.883757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecaa9f-d25d-43a6-9ea2-887ccea848d5 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:36.884382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecaa9f-d25d-43a6-9ea2-887ccea848d5 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:36.884882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecaa9f-d25d-43a6-9ea2-887ccea848d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:36.896102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932b122-40c4-4da8-99fb-351cf7e005cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:36.897320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932b122-40c4-4da8-99fb-351cf7e005cc None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:36.897798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932b122-40c4-4da8-99fb-351cf7e005cc None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:36.898570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932b122-40c4-4da8-99fb-351cf7e005cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:36.921944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932b122-40c4-4da8-99fb-351cf7e005cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:36.923399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-32ecaa9f-d25d-43a6-9ea2-887ccea848d5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:36.925093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932b122-40c4-4da8-99fb-351cf7e005cc None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:36.926568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-32ecaa9f-d25d-43a6-9ea2-887ccea848d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-f932b122-40c4-4da8-99fb-351cf7e005cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:36.963470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:36.964428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:36.965298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:36.965298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:36.965298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:36.965298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:36.968199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 390/763] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:36.973973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:36.975626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932b122-40c4-4da8-99fb-351cf7e005cc None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:37.044641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 374/764] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:37.070570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:37.079300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecaa9f-d25d-43a6-9ea2-887ccea848d5 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:37.164912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932b122-40c4-4da8-99fb-351cf7e005cc None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:37.228214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecaa9f-d25d-43a6-9ea2-887ccea848d5 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:37.238456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f5cdb-4989-4a0c-8007-b031f1621ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:37.239216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5cdb-4989-4a0c-8007-b031f1621ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:37.239502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5cdb-4989-4a0c-8007-b031f1621ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:37.239847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5cdb-4989-4a0c-8007-b031f1621ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:37.240584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f5cdb-4989-4a0c-8007-b031f1621ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:37.240993 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f5cdb-4989-4a0c-8007-b031f1621ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:37.242374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f5cdb-4989-4a0c-8007-b031f1621ea3 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:37.262328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 391/765] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:37.270011 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f5cdb-4989-4a0c-8007-b031f1621ea3 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:37.286134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b4e21-3b95-4bff-9b28-ac85f379d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:37.287530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b4e21-3b95-4bff-9b28-ac85f379d030 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:37.287930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b4e21-3b95-4bff-9b28-ac85f379d030 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:37.288322 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b4e21-3b95-4bff-9b28-ac85f379d030 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:37.289420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b4e21-3b95-4bff-9b28-ac85f379d030 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:37.292310 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b4e21-3b95-4bff-9b28-ac85f379d030 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-522b4e21-3b95-4bff-9b28-ac85f379d030 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:37.313399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:37.314380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 26 02:52:37.315270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:37.316057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 375/766] 10.222.0.36 () {56 vars in 1129 bytes} [Sun Jun 26 02:52:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:37.324288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b4e21-3b95-4bff-9b28-ac85f379d030 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:37.379316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:37.470232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b4e21-3b95-4bff-9b28-ac85f379d030 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:37.518268 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97951761-a537-488a-ac4c-2129151fd5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:37.519240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951761-a537-488a-ac4c-2129151fd5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:37.519670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951761-a537-488a-ac4c-2129151fd5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:37.520092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951761-a537-488a-ac4c-2129151fd5a7 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:37.521395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97951761-a537-488a-ac4c-2129151fd5a7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:37.521873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97951761-a537-488a-ac4c-2129151fd5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:37.523451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97951761-a537-488a-ac4c-2129151fd5a7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:37.529087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 376/767] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Jun 26 02:52:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:37.535155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97951761-a537-488a-ac4c-2129151fd5a7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:37.552021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f5cdb-4989-4a0c-8007-b031f1621ea3 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:37.589214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:37.627124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a06505-c78f-4a03-8a4d-c159efafef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:37.628233 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a06505-c78f-4a03-8a4d-c159efafef24 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:37.628814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a06505-c78f-4a03-8a4d-c159efafef24 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:37.630391 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a06505-c78f-4a03-8a4d-c159efafef24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:37.643040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a06505-c78f-4a03-8a4d-c159efafef24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:37.644523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a06505-c78f-4a03-8a4d-c159efafef24 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-d0a06505-c78f-4a03-8a4d-c159efafef24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:37.660928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:37.661871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:37.663223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:37.663223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:37.663223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:37.663223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:37.663223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:37.663223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:37.663223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:37.663223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:37.663223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 392/768] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:37.668441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a06505-c78f-4a03-8a4d-c159efafef24 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:37.692660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:37.705470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97951761-a537-488a-ac4c-2129151fd5a7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:37.765942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231a207-6eb2-4e91-afe1-3137b42cafa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:37.766578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231a207-6eb2-4e91-afe1-3137b42cafa6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:37.766857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231a207-6eb2-4e91-afe1-3137b42cafa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:37.767151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231a207-6eb2-4e91-afe1-3137b42cafa6 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:37.767860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231a207-6eb2-4e91-afe1-3137b42cafa6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:37.768160 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231a207-6eb2-4e91-afe1-3137b42cafa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:37.769741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231a207-6eb2-4e91-afe1-3137b42cafa6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:37.782748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 377/769] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Jun 26 02:52:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:37.790036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231a207-6eb2-4e91-afe1-3137b42cafa6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:37.836818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a06505-c78f-4a03-8a4d-c159efafef24 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:37.904855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f44ef-16d8-4bf1-9dd0-530ec8c9ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:37.905577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f44ef-16d8-4bf1-9dd0-530ec8c9ba59 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:37.905859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f44ef-16d8-4bf1-9dd0-530ec8c9ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:37.906134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f44ef-16d8-4bf1-9dd0-530ec8c9ba59 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:37.906973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f44ef-16d8-4bf1-9dd0-530ec8c9ba59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:37.907304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f44ef-16d8-4bf1-9dd0-530ec8c9ba59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:37.908765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f44ef-16d8-4bf1-9dd0-530ec8c9ba59 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:37.921801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 393/770] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:37.927863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471bb0-6e97-4e1b-960d-bec8e25b1db5 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:37.928177 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471bb0-6e97-4e1b-960d-bec8e25b1db5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:37.928452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471bb0-6e97-4e1b-960d-bec8e25b1db5 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:37.930159 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 394/771] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:37.930880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3471bb0-6e97-4e1b-960d-bec8e25b1db5 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:37.955120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231a207-6eb2-4e91-afe1-3137b42cafa6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:37.972320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:38.007567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f24d-d3eb-49a6-98ce-029d0cc90a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:38.008232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f24d-d3eb-49a6-98ce-029d0cc90a6a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:38.008510 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f24d-d3eb-49a6-98ce-029d0cc90a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:38.008784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f24d-d3eb-49a6-98ce-029d0cc90a6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:38.009576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999f24d-d3eb-49a6-98ce-029d0cc90a6a None admin] RBAC: Adding query filter params (interface=public, service_id=5f217324c15b4376b03938ce208512a5, region_id=RegionOne) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:38.009881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999f24d-d3eb-49a6-98ce-029d0cc90a6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:38.011282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999f24d-d3eb-49a6-98ce-029d0cc90a6a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:38.019318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 378/772] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Jun 26 02:52:37 2022] GET /identity/v3/endpoints?service_id=5f217324c15b4376b03938ce208512a5&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:38.020589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc71af-7b19-418c-917a-2b8bb405d121 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:38.020873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc71af-7b19-418c-917a-2b8bb405d121 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:38.021150 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc71af-7b19-418c-917a-2b8bb405d121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:38.037958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-aabc71af-7b19-418c-917a-2b8bb405d121 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:38.039221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-aabc71af-7b19-418c-917a-2b8bb405d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:38.050223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3471bb0-6e97-4e1b-960d-bec8e25b1db5 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:38.057865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:38.097967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9a02d-6607-4918-85e3-ea1ed3af4a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:38.099169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9a02d-6607-4918-85e3-ea1ed3af4a16 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:38.099446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9a02d-6607-4918-85e3-ea1ed3af4a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:38.100112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9a02d-6607-4918-85e3-ea1ed3af4a16 None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/24319e5e83ed4caf9dd3ae4b3937b3fb/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:38.103068 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9a02d-6607-4918-85e3-ea1ed3af4a16 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=24319e5e83ed4caf9dd3ae4b3937b3fb, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:38.105065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9a02d-6607-4918-85e3-ea1ed3af4a16 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:38.110225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 379/773] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:38.111196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc71af-7b19-418c-917a-2b8bb405d121 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:38.128688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 395/774] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:52:37 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/24319e5e83ed4caf9dd3ae4b3937b3fb/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:52:38.143940 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9a02d-6607-4918-85e3-ea1ed3af4a16 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:38.288434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:38.298397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9a02d-6607-4918-85e3-ea1ed3af4a16 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:38.339218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc71af-7b19-418c-917a-2b8bb405d121 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:38.357913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc63fc-b7f4-4bcc-b34b-b96b3e49641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:38.358756 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc63fc-b7f4-4bcc-b34b-b96b3e49641a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:38.359121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc63fc-b7f4-4bcc-b34b-b96b3e49641a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:38.359400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc63fc-b7f4-4bcc-b34b-b96b3e49641a None admin] PATH_INFO: `/v3/services/network` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:38.360059 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc63fc-b7f4-4bcc-b34b-b96b3e49641a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:38.361442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc63fc-b7f4-4bcc-b34b-b96b3e49641a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-e4fc63fc-b7f4-4bcc-b34b-b96b3e49641a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:38.375761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:38.378134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 26 02:52:38.380321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:38.384067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e8d89-70c9-4d41-b388-273d02f4a890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:38.384067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e8d89-70c9-4d41-b388-273d02f4a890 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:38.384067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e8d89-70c9-4d41-b388-273d02f4a890 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:38.384067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e8d89-70c9-4d41-b388-273d02f4a890 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:38.384726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 396/775] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:38 2022] GET /identity/v3/services/network => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:38.384866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e8d89-70c9-4d41-b388-273d02f4a890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:38.385007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc63fc-b7f4-4bcc-b34b-b96b3e49641a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:38.385159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e8d89-70c9-4d41-b388-273d02f4a890 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:38.391141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 380/776] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Jun 26 02:52:38 2022] GET /identity/v3/services => generated 772 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:38.422261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7108-be67-4db0-8858-ce7c9f7f4ed1 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:38.422606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7108-be67-4db0-8858-ce7c9f7f4ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:38.422819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7108-be67-4db0-8858-ce7c9f7f4ed1 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:38.424259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 381/777] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:38.430773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad8455-ef9c-4419-b031-8487df7711a2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:38.431121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad8455-ef9c-4419-b031-8487df7711a2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:38.431351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad8455-ef9c-4419-b031-8487df7711a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:38.449430 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-17ad8455-ef9c-4419-b031-8487df7711a2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:38.450798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-17ad8455-ef9c-4419-b031-8487df7711a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:38.468447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:38.504649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc63fc-b7f4-4bcc-b34b-b96b3e49641a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:38.542111 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8d381-4c1d-4d86-af10-ecc73ea620a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:38.543193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8d381-4c1d-4d86-af10-ecc73ea620a9 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:38.543647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8d381-4c1d-4d86-af10-ecc73ea620a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:38.544116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8d381-4c1d-4d86-af10-ecc73ea620a9 None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:38.545098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8d381-4c1d-4d86-af10-ecc73ea620a9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:38.545592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8d381-4c1d-4d86-af10-ecc73ea620a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:38.547188 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8d381-4c1d-4d86-af10-ecc73ea620a9 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:38.553034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 397/778] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:52:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:38.559064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8d381-4c1d-4d86-af10-ecc73ea620a9 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:38.587630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:38.595932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 382/779] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:38.630351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad8455-ef9c-4419-b031-8487df7711a2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:38.669885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8d381-4c1d-4d86-af10-ecc73ea620a9 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:38.711064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96446f8d-beec-4ed7-b3e0-2b2647fe213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:38.712047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446f8d-beec-4ed7-b3e0-2b2647fe213d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:38.712652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446f8d-beec-4ed7-b3e0-2b2647fe213d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:38.713130 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96446f8d-beec-4ed7-b3e0-2b2647fe213d None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:38.714045 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96446f8d-beec-4ed7-b3e0-2b2647fe213d None admin] RBAC: Adding query filter params (type=network) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:38.714516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96446f8d-beec-4ed7-b3e0-2b2647fe213d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:38.716250 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96446f8d-beec-4ed7-b3e0-2b2647fe213d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:38.722124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 398/780] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:52:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:38.728214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96446f8d-beec-4ed7-b3e0-2b2647fe213d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:38.786449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad8455-ef9c-4419-b031-8487df7711a2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:38.842924 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e446e-333f-4f4d-9d3f-5e5e0df5cc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:38.844382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e446e-333f-4f4d-9d3f-5e5e0df5cc2b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:38.845014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e446e-333f-4f4d-9d3f-5e5e0df5cc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:38.845392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e446e-333f-4f4d-9d3f-5e5e0df5cc2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:38.859123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e446e-333f-4f4d-9d3f-5e5e0df5cc2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-ad1e446e-333f-4f4d-9d3f-5e5e0df5cc2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:38.867849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:38.868777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:38.869595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:38.870233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 383/781] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:38.879209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e446e-333f-4f4d-9d3f-5e5e0df5cc2b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:38.919382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:38.947336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:38.998237 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96446f8d-beec-4ed7-b3e0-2b2647fe213d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:39.002357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e446e-333f-4f4d-9d3f-5e5e0df5cc2b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:39.038641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f214b-f67c-4506-bb85-58fd36754282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:39.039562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f214b-f67c-4506-bb85-58fd36754282 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:39.040089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f214b-f67c-4506-bb85-58fd36754282 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:39.040451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f214b-f67c-4506-bb85-58fd36754282 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:39.041665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f214b-f67c-4506-bb85-58fd36754282 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:39.042045 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f214b-f67c-4506-bb85-58fd36754282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:39.043584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f214b-f67c-4506-bb85-58fd36754282 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:39.053570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 384/782] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:39.059342 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f214b-f67c-4506-bb85-58fd36754282 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:39.123658 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc70a19-e327-4c97-ba14-b3b71a32a599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:39.124394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc70a19-e327-4c97-ba14-b3b71a32a599 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:39.125281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc70a19-e327-4c97-ba14-b3b71a32a599 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:39.125660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc70a19-e327-4c97-ba14-b3b71a32a599 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:39.126497 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc70a19-e327-4c97-ba14-b3b71a32a599 None admin] RBAC: Adding query filter params (interface=public, service_id=af23145277f540819665657b9bd5c8d3, region_id=RegionOne) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:39.126874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc70a19-e327-4c97-ba14-b3b71a32a599 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:39.128375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc70a19-e327-4c97-ba14-b3b71a32a599 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:39.140711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:39.143703 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 399/783] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Jun 26 02:52:38 2022] GET /identity/v3/endpoints?service_id=af23145277f540819665657b9bd5c8d3&interface=public®ion_id=RegionOne => generated 194 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:39.150040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc70a19-e327-4c97-ba14-b3b71a32a599 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:39.205118 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f214b-f67c-4506-bb85-58fd36754282 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:39.298543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92183de6-7255-4b28-8bdd-d9b3f9eeb9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:39.299384 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92183de6-7255-4b28-8bdd-d9b3f9eeb9ad None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:39.299664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92183de6-7255-4b28-8bdd-d9b3f9eeb9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:39.302107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92183de6-7255-4b28-8bdd-d9b3f9eeb9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:39.324589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92183de6-7255-4b28-8bdd-d9b3f9eeb9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:39.326117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92183de6-7255-4b28-8bdd-d9b3f9eeb9ad None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-92183de6-7255-4b28-8bdd-d9b3f9eeb9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:39.361946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:39.363111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:39.364193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:39.364193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:39.364193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:39.364193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:39.364193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 385/784] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:39.369334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92183de6-7255-4b28-8bdd-d9b3f9eeb9ad None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:39.393263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc70a19-e327-4c97-ba14-b3b71a32a599 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:39.473207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d12fb2-5a7d-4d75-a291-8032f0e6c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:39.474093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d12fb2-5a7d-4d75-a291-8032f0e6c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:39.474468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d12fb2-5a7d-4d75-a291-8032f0e6c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:39.474744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d12fb2-5a7d-4d75-a291-8032f0e6c1e5 None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:39.475500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d12fb2-5a7d-4d75-a291-8032f0e6c1e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:39.478401 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d12fb2-5a7d-4d75-a291-8032f0e6c1e5 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:39.486897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 400/785] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Jun 26 02:52:39 2022] GET /identity/v3/services => generated 772 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:39.488277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd829d8-42fa-4027-86eb-9d8e4304d360 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:39.488560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd829d8-42fa-4027-86eb-9d8e4304d360 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:39.488834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd829d8-42fa-4027-86eb-9d8e4304d360 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:39.490324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 401/786] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:39.497840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045af8e-305e-488f-915a-1e5e7bce07bc None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:39.498273 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045af8e-305e-488f-915a-1e5e7bce07bc None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:39.498559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045af8e-305e-488f-915a-1e5e7bce07bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:39.522484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-e045af8e-305e-488f-915a-1e5e7bce07bc None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:39.523726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e045af8e-305e-488f-915a-1e5e7bce07bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:39.536885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:39.601001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 402/787] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:39.604517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92183de6-7255-4b28-8bdd-d9b3f9eeb9ad None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:39.642595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045af8e-305e-488f-915a-1e5e7bce07bc None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:39.651664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:39.667406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb245f4-eb2a-482f-8102-7f9c29fe6671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:39.668098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb245f4-eb2a-482f-8102-7f9c29fe6671 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:39.668382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb245f4-eb2a-482f-8102-7f9c29fe6671 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:39.668687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb245f4-eb2a-482f-8102-7f9c29fe6671 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:39.669450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb245f4-eb2a-482f-8102-7f9c29fe6671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:39.669756 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb245f4-eb2a-482f-8102-7f9c29fe6671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:39.671300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb245f4-eb2a-482f-8102-7f9c29fe6671 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:39.703083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 386/788] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:39.713261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb245f4-eb2a-482f-8102-7f9c29fe6671 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:39.782669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045af8e-305e-488f-915a-1e5e7bce07bc None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:39.823503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630e3a-662a-44d2-b351-78092bde8e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:39.824310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630e3a-662a-44d2-b351-78092bde8e49 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:39.824599 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630e3a-662a-44d2-b351-78092bde8e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:39.824878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630e3a-662a-44d2-b351-78092bde8e49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:39.838308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb245f4-eb2a-482f-8102-7f9c29fe6671 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:39.838859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93630e3a-662a-44d2-b351-78092bde8e49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-93630e3a-662a-44d2-b351-78092bde8e49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:39.846882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:39.847832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:39.848650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 403/789] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:39.854306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630e3a-662a-44d2-b351-78092bde8e49 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:39.866662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:39.878028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c5fe0-2b45-4ebc-bf57-fe6f10bad638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:39.878850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c5fe0-2b45-4ebc-bf57-fe6f10bad638 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:39.879180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c5fe0-2b45-4ebc-bf57-fe6f10bad638 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:39.879460 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c5fe0-2b45-4ebc-bf57-fe6f10bad638 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:39.888864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c5fe0-2b45-4ebc-bf57-fe6f10bad638 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:39.890442 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c5fe0-2b45-4ebc-bf57-fe6f10bad638 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-880c5fe0-2b45-4ebc-bf57-fe6f10bad638 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:39.906323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:39.907370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:39.908335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:39.908335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:39.908335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:39.908335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:39.908335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:39.908335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:39.908335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:39.908335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:39.908335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:39.908335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:39.908335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 387/790] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:39.915480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c5fe0-2b45-4ebc-bf57-fe6f10bad638 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:39.984529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:40.007000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630e3a-662a-44d2-b351-78092bde8e49 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:40.071551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230940-e2f1-414e-8ceb-afdea686f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:40.072230 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230940-e2f1-414e-8ceb-afdea686f874 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:40.072510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230940-e2f1-414e-8ceb-afdea686f874 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:40.072785 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230940-e2f1-414e-8ceb-afdea686f874 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:40.073544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e230940-e2f1-414e-8ceb-afdea686f874 None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:40.073849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e230940-e2f1-414e-8ceb-afdea686f874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:40.075845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e230940-e2f1-414e-8ceb-afdea686f874 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:40.092715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 404/791] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:40.102383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c5fe0-2b45-4ebc-bf57-fe6f10bad638 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:40.104126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230940-e2f1-414e-8ceb-afdea686f874 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:40.174472 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:40.191697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcc2bb-d6f5-419f-8703-3cad97f5f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:40.192395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcc2bb-d6f5-419f-8703-3cad97f5f546 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:40.192674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcc2bb-d6f5-419f-8703-3cad97f5f546 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:40.192948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcc2bb-d6f5-419f-8703-3cad97f5f546 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:40.193794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcc2bb-d6f5-419f-8703-3cad97f5f546 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:40.194099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcc2bb-d6f5-419f-8703-3cad97f5f546 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:40.195576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcc2bb-d6f5-419f-8703-3cad97f5f546 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:40.209152 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230940-e2f1-414e-8ceb-afdea686f874 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:40.233643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 388/792] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Jun 26 02:52:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:40.239195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcc2bb-d6f5-419f-8703-3cad97f5f546 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:40.244164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3debf86-5c60-4540-ae6c-9abed36b028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:40.245025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3debf86-5c60-4540-ae6c-9abed36b028b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:40.245451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3debf86-5c60-4540-ae6c-9abed36b028b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:40.245777 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3debf86-5c60-4540-ae6c-9abed36b028b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:40.257413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3debf86-5c60-4540-ae6c-9abed36b028b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:40.258942 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3debf86-5c60-4540-ae6c-9abed36b028b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-b3debf86-5c60-4540-ae6c-9abed36b028b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:40.276751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:40.277697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:40.278612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:40.278612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:40.278612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:40.278612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:40.278612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 405/793] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:40.285666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3debf86-5c60-4540-ae6c-9abed36b028b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:40.376821 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:40.380441 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcc2bb-d6f5-419f-8703-3cad97f5f546 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:40.419653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7c116-939e-4e19-bd88-e2363f58d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:40.420466 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7c116-939e-4e19-bd88-e2363f58d838 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:40.420900 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7c116-939e-4e19-bd88-e2363f58d838 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:40.421182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7c116-939e-4e19-bd88-e2363f58d838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:40.433194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7c116-939e-4e19-bd88-e2363f58d838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:40.434624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7c116-939e-4e19-bd88-e2363f58d838 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-09f7c116-939e-4e19-bd88-e2363f58d838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:40.453502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:40.455685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:40.457663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:40.457663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:40.457663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:40.457663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:40.457663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 389/794] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:40.461479 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7c116-939e-4e19-bd88-e2363f58d838 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:40.565195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3debf86-5c60-4540-ae6c-9abed36b028b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:40.570297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7c116-939e-4e19-bd88-e2363f58d838 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:40.607358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:40.629368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eefc17-644f-4223-990d-4fe95da9951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:40.630048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eefc17-644f-4223-990d-4fe95da9951e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:40.630328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eefc17-644f-4223-990d-4fe95da9951e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:40.630606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eefc17-644f-4223-990d-4fe95da9951e None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:40.631358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eefc17-644f-4223-990d-4fe95da9951e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:40.631673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eefc17-644f-4223-990d-4fe95da9951e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:40.633047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eefc17-644f-4223-990d-4fe95da9951e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:40.637135 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36f6d1-05d0-4495-909b-20bff94b8c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:40.637855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f6d1-05d0-4495-909b-20bff94b8c86 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:40.638137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f6d1-05d0-4495-909b-20bff94b8c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:40.638411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f6d1-05d0-4495-909b-20bff94b8c86 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:40.639166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36f6d1-05d0-4495-909b-20bff94b8c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:40.639470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36f6d1-05d0-4495-909b-20bff94b8c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:40.640847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36f6d1-05d0-4495-909b-20bff94b8c86 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:40.662822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 390/795] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:40.665024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eefc17-644f-4223-990d-4fe95da9951e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:40.667128 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 406/796] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:40.672454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36f6d1-05d0-4495-909b-20bff94b8c86 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:40.698157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:40.793858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36f6d1-05d0-4495-909b-20bff94b8c86 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:40.829610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eefc17-644f-4223-990d-4fe95da9951e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:40.836949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea4887-d68e-429d-b82f-48b1f578fccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:40.838278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4887-d68e-429d-b82f-48b1f578fccf None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:40.838560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4887-d68e-429d-b82f-48b1f578fccf None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:40.838832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4887-d68e-429d-b82f-48b1f578fccf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:40.848707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea4887-d68e-429d-b82f-48b1f578fccf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:40.850555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea4887-d68e-429d-b82f-48b1f578fccf None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:40.868377 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc96ac-af50-4546-8963-9eccfae85193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-a4ea4887-d68e-429d-b82f-48b1f578fccf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:40.869626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:40.870529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:40.871522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:40.871522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:40.871522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:40.871522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:40.871522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:40.871522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:40.871522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:40.871522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:40.871522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:52:40.871522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:40.871522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 407/797] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Jun 26 02:52:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:40.872670 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa0f5-d465-4c6a-8957-cfc9ef939f33 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:40.872932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa0f5-d465-4c6a-8957-cfc9ef939f33 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:40.873213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa0f5-d465-4c6a-8957-cfc9ef939f33 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:40.873475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc96ac-af50-4546-8963-9eccfae85193 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:40.873982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc96ac-af50-4546-8963-9eccfae85193 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:40.874451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc96ac-af50-4546-8963-9eccfae85193 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:40.874569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 408/798] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:40.880052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daa0f5-d465-4c6a-8957-cfc9ef939f33 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:40.889227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc96ac-af50-4546-8963-9eccfae85193 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:40.891152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc96ac-af50-4546-8963-9eccfae85193 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-21fc96ac-af50-4546-8963-9eccfae85193 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:40.907685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:40.908675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:40.909541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:40.909541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:40.909541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:40.909541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:40.909541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:40.909541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:40.909541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:40.909541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:40.912246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 391/799] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:40.913670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64c04c-365e-4616-b450-525059d9730b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:40.914168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64c04c-365e-4616-b450-525059d9730b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:40.914662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64c04c-365e-4616-b450-525059d9730b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:40.929795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:40.935541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ae64c04c-365e-4616-b450-525059d9730b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:40.937102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ae64c04c-365e-4616-b450-525059d9730b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:41.002442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daa0f5-d465-4c6a-8957-cfc9ef939f33 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:41.027026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 392/800] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:41.027026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64c04c-365e-4616-b450-525059d9730b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:41.029572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:41.050582 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e315e2-5c36-469f-bb98-ee6e02ce646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:41.051284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e315e2-5c36-469f-bb98-ee6e02ce646b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.051563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e315e2-5c36-469f-bb98-ee6e02ce646b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.051908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e315e2-5c36-469f-bb98-ee6e02ce646b None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.052674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e315e2-5c36-469f-bb98-ee6e02ce646b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:41.052979 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e315e2-5c36-469f-bb98-ee6e02ce646b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:41.054418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e315e2-5c36-469f-bb98-ee6e02ce646b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:41.072840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 409/801] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Jun 26 02:52:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:41.074028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300729f-820b-41b9-8755-5e09ad1539cc None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.074314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300729f-820b-41b9-8755-5e09ad1539cc None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.074593 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300729f-820b-41b9-8755-5e09ad1539cc None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.076141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 410/802] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:41.076631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300729f-820b-41b9-8755-5e09ad1539cc None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:41.136763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64c04c-365e-4616-b450-525059d9730b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:41.171343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620de23-8981-45c5-9405-4331c00143b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:41.172011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620de23-8981-45c5-9405-4331c00143b8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.172295 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620de23-8981-45c5-9405-4331c00143b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.172573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620de23-8981-45c5-9405-4331c00143b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.173366 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620de23-8981-45c5-9405-4331c00143b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:41.173672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620de23-8981-45c5-9405-4331c00143b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:41.175138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620de23-8981-45c5-9405-4331c00143b8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:41.180141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:41.185443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300729f-820b-41b9-8755-5e09ad1539cc None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:41.187039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 393/803] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:41.188015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620de23-8981-45c5-9405-4331c00143b8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:41.222053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de908f-a06c-4250-9947-434a4dd42dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:41.223001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de908f-a06c-4250-9947-434a4dd42dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.223381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de908f-a06c-4250-9947-434a4dd42dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.223661 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de908f-a06c-4250-9947-434a4dd42dc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.234433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de908f-a06c-4250-9947-434a4dd42dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-11de908f-a06c-4250-9947-434a4dd42dc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:41.242601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:41.243770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:41.244687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 411/804] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:41.245501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138f710-d7d1-4eab-88f7-5a7b42cfbf97 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.245594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138f710-d7d1-4eab-88f7-5a7b42cfbf97 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.245864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138f710-d7d1-4eab-88f7-5a7b42cfbf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.256398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:41.264081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-3138f710-d7d1-4eab-88f7-5a7b42cfbf97 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:41.265247 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3138f710-d7d1-4eab-88f7-5a7b42cfbf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:41.301902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620de23-8981-45c5-9405-4331c00143b8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:41.339419 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec74db-4083-4f10-b754-90ce7c14d792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:41.340550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec74db-4083-4f10-b754-90ce7c14d792 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.340835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec74db-4083-4f10-b754-90ce7c14d792 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.341112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec74db-4083-4f10-b754-90ce7c14d792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.355051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 412/805] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:41.355051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138f710-d7d1-4eab-88f7-5a7b42cfbf97 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:41.355307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec74db-4083-4f10-b754-90ce7c14d792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:41.355307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec74db-4083-4f10-b754-90ce7c14d792 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-74ec74db-4083-4f10-b754-90ce7c14d792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:41.371236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:41.372235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:41.373108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:41.373108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:41.373108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:41.373108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:41.377030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 394/806] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:41.377792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec74db-4083-4f10-b754-90ce7c14d792 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:41.456518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:41.469605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138f710-d7d1-4eab-88f7-5a7b42cfbf97 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:41.480152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec74db-4083-4f10-b754-90ce7c14d792 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:41.500296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:41.513280 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809334df-f839-4901-8ff9-6436141a1e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:41.514112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809334df-f839-4901-8ff9-6436141a1e05 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.514392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809334df-f839-4901-8ff9-6436141a1e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.514657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809334df-f839-4901-8ff9-6436141a1e05 None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/d585280109eb4773adf7d56fd722a4b4/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.516641 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809334df-f839-4901-8ff9-6436141a1e05 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=d585280109eb4773adf7d56fd722a4b4, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:41.518186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809334df-f839-4901-8ff9-6436141a1e05 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:41.523172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a5ff5-c6dc-4975-8c71-15f344105cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:41.523960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a5ff5-c6dc-4975-8c71-15f344105cca None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.524371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a5ff5-c6dc-4975-8c71-15f344105cca None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.524735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a5ff5-c6dc-4975-8c71-15f344105cca None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.525497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a5ff5-c6dc-4975-8c71-15f344105cca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:41.525803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a5ff5-c6dc-4975-8c71-15f344105cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:41.527392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a5ff5-c6dc-4975-8c71-15f344105cca None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:41.532922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 413/807] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:52:41 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/d585280109eb4773adf7d56fd722a4b4/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:52:41.533971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809334df-f839-4901-8ff9-6436141a1e05 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:41.546745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 395/808] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:41.547861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a5ff5-c6dc-4975-8c71-15f344105cca None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:41.662281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809334df-f839-4901-8ff9-6436141a1e05 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:41.680465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a5ff5-c6dc-4975-8c71-15f344105cca None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:41.711557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb854a-bc7f-43f2-9675-5de528169808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:41.712696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb854a-bc7f-43f2-9675-5de528169808 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.713227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb854a-bc7f-43f2-9675-5de528169808 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.713643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb854a-bc7f-43f2-9675-5de528169808 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.714529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb854a-bc7f-43f2-9675-5de528169808 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:41.716218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb854a-bc7f-43f2-9675-5de528169808 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:41.728780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb55cc-b1a9-4545-800e-c7bead7ebea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-01bb854a-bc7f-43f2-9675-5de528169808 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:41.728962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:41.730038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 26 02:52:41.731295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:41.733080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb55cc-b1a9-4545-800e-c7bead7ebea7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.733495 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb55cc-b1a9-4545-800e-c7bead7ebea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.733902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb55cc-b1a9-4545-800e-c7bead7ebea7 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.734773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb55cc-b1a9-4545-800e-c7bead7ebea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:41.735061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 414/809] 10.222.0.36 () {56 vars in 1129 bytes} [Sun Jun 26 02:52:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:41.735183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb55cc-b1a9-4545-800e-c7bead7ebea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:41.736246 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb854a-bc7f-43f2-9675-5de528169808 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:41.736796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb55cc-b1a9-4545-800e-c7bead7ebea7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:41.749403 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 396/810] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:41.750216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb55cc-b1a9-4545-800e-c7bead7ebea7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:41.761198 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:41.789127 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:41.866655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb854a-bc7f-43f2-9675-5de528169808 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:41.872227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb55cc-b1a9-4545-800e-c7bead7ebea7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:41.906917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da39494-fe6e-4348-b4d7-084d87b5751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:41.908115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39494-fe6e-4348-b4d7-084d87b5751e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.908594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39494-fe6e-4348-b4d7-084d87b5751e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.908933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da39494-fe6e-4348-b4d7-084d87b5751e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.914683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15b17f-62c0-4016-a73f-93d4e2d91f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:41.915499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15b17f-62c0-4016-a73f-93d4e2d91f61 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:41.916225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15b17f-62c0-4016-a73f-93d4e2d91f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:41.916604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15b17f-62c0-4016-a73f-93d4e2d91f61 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:41.917858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15b17f-62c0-4016-a73f-93d4e2d91f61 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:41.918266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15b17f-62c0-4016-a73f-93d4e2d91f61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:41.920515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15b17f-62c0-4016-a73f-93d4e2d91f61 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:41.921170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da39494-fe6e-4348-b4d7-084d87b5751e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:41.923083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da39494-fe6e-4348-b4d7-084d87b5751e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:41.930548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 397/811] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Jun 26 02:52:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:41.931578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15b17f-62c0-4016-a73f-93d4e2d91f61 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-3da39494-fe6e-4348-b4d7-084d87b5751e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:41.944492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:41.945619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:41.946740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:41.946740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:41.946740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:41.946740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:41.946740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 415/812] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:41.951031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da39494-fe6e-4348-b4d7-084d87b5751e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:42.017070 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:42.064552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da39494-fe6e-4348-b4d7-084d87b5751e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:42.102938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6b73b-6a18-4c97-9cd9-efb4c3e92085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:42.103649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6b73b-6a18-4c97-9cd9-efb4c3e92085 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:42.103926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6b73b-6a18-4c97-9cd9-efb4c3e92085 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:42.104199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6b73b-6a18-4c97-9cd9-efb4c3e92085 None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:42.104904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6b73b-6a18-4c97-9cd9-efb4c3e92085 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:42.105206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6b73b-6a18-4c97-9cd9-efb4c3e92085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:42.106668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6b73b-6a18-4c97-9cd9-efb4c3e92085 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:42.116920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 416/813] 10.222.0.36 () {56 vars in 1124 bytes} [Sun Jun 26 02:52:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:42.116920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e115a-0621-4c13-a6b6-a7ef502126c4 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:42.116920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e115a-0621-4c13-a6b6-a7ef502126c4 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:42.116920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e115a-0621-4c13-a6b6-a7ef502126c4 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:42.116920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 417/814] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:42.116920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e115a-0621-4c13-a6b6-a7ef502126c4 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:42.178650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:42.181553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15b17f-62c0-4016-a73f-93d4e2d91f61 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:42.216825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760da7a-6433-47dd-b297-0c4eecbb825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:42.217630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760da7a-6433-47dd-b297-0c4eecbb825b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:42.217904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760da7a-6433-47dd-b297-0c4eecbb825b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:42.218180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760da7a-6433-47dd-b297-0c4eecbb825b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:42.219471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e115a-0621-4c13-a6b6-a7ef502126c4 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:42.225191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760da7a-6433-47dd-b297-0c4eecbb825b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:42.226654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760da7a-6433-47dd-b297-0c4eecbb825b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5760da7a-6433-47dd-b297-0c4eecbb825b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:42.241546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:42.242458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:42.243397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:42.243397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:42.243397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:42.243397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:42.243397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:42.243397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:42.243397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:42.243397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:42.243397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 398/815] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:42.243869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760da7a-6433-47dd-b297-0c4eecbb825b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:42.252888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:42.261920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b10d2-da24-4e61-8890-4a4559b335d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:42.263164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b10d2-da24-4e61-8890-4a4559b335d2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:42.263975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b10d2-da24-4e61-8890-4a4559b335d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:42.264396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b10d2-da24-4e61-8890-4a4559b335d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:42.265262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b10d2-da24-4e61-8890-4a4559b335d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:42.265702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b10d2-da24-4e61-8890-4a4559b335d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:42.267238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b10d2-da24-4e61-8890-4a4559b335d2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:42.280291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 418/816] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:42.281947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239bcb3-451d-4286-8e32-4faead84ff08 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:42.282361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239bcb3-451d-4286-8e32-4faead84ff08 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:42.282940 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239bcb3-451d-4286-8e32-4faead84ff08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:42.301174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-c239bcb3-451d-4286-8e32-4faead84ff08 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:42.302794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c239bcb3-451d-4286-8e32-4faead84ff08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:42.359020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760da7a-6433-47dd-b297-0c4eecbb825b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:42.375861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 419/817] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:42.376919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239bcb3-451d-4286-8e32-4faead84ff08 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:42.401337 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c266b2-d218-4584-98ff-f83466d77b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:42.402010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c266b2-d218-4584-98ff-f83466d77b16 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:42.402292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c266b2-d218-4584-98ff-f83466d77b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:42.402625 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c266b2-d218-4584-98ff-f83466d77b16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:42.403581 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c266b2-d218-4584-98ff-f83466d77b16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:42.404971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c266b2-d218-4584-98ff-f83466d77b16 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:42.427777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 399/818] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Jun 26 02:52:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:42.431919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c266b2-d218-4584-98ff-f83466d77b16 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:42.462087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:42.515328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239bcb3-451d-4286-8e32-4faead84ff08 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:42.541454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:42.573909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36a2d0-4944-40fe-af09-b2523a7c381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:42.575152 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36a2d0-4944-40fe-af09-b2523a7c381e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:42.575636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36a2d0-4944-40fe-af09-b2523a7c381e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:42.575832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c266b2-d218-4584-98ff-f83466d77b16 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:42.576299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36a2d0-4944-40fe-af09-b2523a7c381e None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:42.577590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36a2d0-4944-40fe-af09-b2523a7c381e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:42.582888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36a2d0-4944-40fe-af09-b2523a7c381e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:42.584520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36a2d0-4944-40fe-af09-b2523a7c381e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:42.599996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 420/819] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:42.600648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36a2d0-4944-40fe-af09-b2523a7c381e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:42.622533 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eef90f-8acd-4bdc-8d56-cf71042d63fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:42.623442 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef90f-8acd-4bdc-8d56-cf71042d63fa None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:42.623819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef90f-8acd-4bdc-8d56-cf71042d63fa None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:42.624189 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef90f-8acd-4bdc-8d56-cf71042d63fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:42.633896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eef90f-8acd-4bdc-8d56-cf71042d63fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:42.636249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eef90f-8acd-4bdc-8d56-cf71042d63fa None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-e7eef90f-8acd-4bdc-8d56-cf71042d63fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:42.654549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:42.655783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:42.657007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:42.657007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:42.657007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:42.657007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:42.657007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:42.657007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:42.657007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:42.657007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:42.657007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:52:42.657007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:42.657007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 400/820] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Jun 26 02:52:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:42.657716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eef90f-8acd-4bdc-8d56-cf71042d63fa None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:42.717525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36a2d0-4944-40fe-af09-b2523a7c381e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:42.753468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203edd58-a023-42d2-9527-340845ac1c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:42.753710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:42.754280 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203edd58-a023-42d2-9527-340845ac1c03 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:42.754564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203edd58-a023-42d2-9527-340845ac1c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:42.754845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203edd58-a023-42d2-9527-340845ac1c03 None admin] PATH_INFO: `/v3/services/network` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:42.755720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203edd58-a023-42d2-9527-340845ac1c03 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:42.757418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203edd58-a023-42d2-9527-340845ac1c03 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-203edd58-a023-42d2-9527-340845ac1c03 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:42.769922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:42.770947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:42.771810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 421/821] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:42 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:42.773027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203edd58-a023-42d2-9527-340845ac1c03 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:42.779206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eef90f-8acd-4bdc-8d56-cf71042d63fa None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:42.814637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f7db-9af7-4355-8c81-be7061eacf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:42.815585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f7db-9af7-4355-8c81-be7061eacf46 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:42.815867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f7db-9af7-4355-8c81-be7061eacf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:42.816143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f7db-9af7-4355-8c81-be7061eacf46 None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/d78da06180d0420f82074fa5e3cbc71e/roles/cd3a257aec1b4b1694563a46b1e71a03` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:42.818507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:42.831483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82f7db-9af7-4355-8c81-be7061eacf46 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=d78da06180d0420f82074fa5e3cbc71e, role_id=cd3a257aec1b4b1694563a46b1e71a03)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:42.832937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82f7db-9af7-4355-8c81-be7061eacf46 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:42.850373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 401/822] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:52:42 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/d78da06180d0420f82074fa5e3cbc71e/roles/cd3a257aec1b4b1694563a46b1e71a03 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:52:42.851324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f7db-9af7-4355-8c81-be7061eacf46 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:42.886713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203edd58-a023-42d2-9527-340845ac1c03 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:42.923631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf48ed0-fb21-4208-bafc-0693d3d57731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:42.924349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48ed0-fb21-4208-bafc-0693d3d57731 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:42.924705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48ed0-fb21-4208-bafc-0693d3d57731 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:42.924987 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48ed0-fb21-4208-bafc-0693d3d57731 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:42.925952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf48ed0-fb21-4208-bafc-0693d3d57731 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:42.926266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf48ed0-fb21-4208-bafc-0693d3d57731 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:42.927817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf48ed0-fb21-4208-bafc-0693d3d57731 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:42.948439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 422/823] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Jun 26 02:52:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:42.954093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf48ed0-fb21-4208-bafc-0693d3d57731 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:42.961176 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f7db-9af7-4355-8c81-be7061eacf46 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:43.029303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:43.061245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8041ec-37ba-4d7d-89a5-e97ddf1cfc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:43.061245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8041ec-37ba-4d7d-89a5-e97ddf1cfc69 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:43.061732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8041ec-37ba-4d7d-89a5-e97ddf1cfc69 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:43.061732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8041ec-37ba-4d7d-89a5-e97ddf1cfc69 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:43.062389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8041ec-37ba-4d7d-89a5-e97ddf1cfc69 None admin] RBAC: Adding query filter params (name=network) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:43.062696 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8041ec-37ba-4d7d-89a5-e97ddf1cfc69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:43.064125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8041ec-37ba-4d7d-89a5-e97ddf1cfc69 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:43.076498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:43.077185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 402/824] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:52:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:43.083099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf48ed0-fb21-4208-bafc-0693d3d57731 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:43.083380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8041ec-37ba-4d7d-89a5-e97ddf1cfc69 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:43.129041 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146741-548e-4f2b-894f-f4df8e7625fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:43.130282 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146741-548e-4f2b-894f-f4df8e7625fd None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:43.130575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146741-548e-4f2b-894f-f4df8e7625fd None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:43.130859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146741-548e-4f2b-894f-f4df8e7625fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:43.206372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8041ec-37ba-4d7d-89a5-e97ddf1cfc69 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:43.246352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078994bc-f181-4dd2-8435-d3e4599726ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:43.247623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078994bc-f181-4dd2-8435-d3e4599726ee None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:43.247914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078994bc-f181-4dd2-8435-d3e4599726ee None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:43.248195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078994bc-f181-4dd2-8435-d3e4599726ee None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:43.248923 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078994bc-f181-4dd2-8435-d3e4599726ee None admin] RBAC: Adding query filter params (type=network) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:43.249229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078994bc-f181-4dd2-8435-d3e4599726ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:43.250736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078994bc-f181-4dd2-8435-d3e4599726ee None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:43.257819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 403/825] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:52:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:43.263682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078994bc-f181-4dd2-8435-d3e4599726ee None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:43.280106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8146741-548e-4f2b-894f-f4df8e7625fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:43.281606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8146741-548e-4f2b-894f-f4df8e7625fd None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:43.328637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:43.379747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078994bc-f181-4dd2-8435-d3e4599726ee None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:43.418136 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457af592-a95b-4c4a-b051-5766829087a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:43.418908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af592-a95b-4c4a-b051-5766829087a0 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:43.419221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af592-a95b-4c4a-b051-5766829087a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:43.419494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af592-a95b-4c4a-b051-5766829087a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:43.420356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457af592-a95b-4c4a-b051-5766829087a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:43.421738 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457af592-a95b-4c4a-b051-5766829087a0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:43.443237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 404/826] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Jun 26 02:52:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:52:43.489463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:43.497713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 423/827] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:52:43.504334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457af592-a95b-4c4a-b051-5766829087a0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:43.676254 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6a0ea-58ee-4aec-8d7d-f1bf82d2bd0f None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:43.676605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6a0ea-58ee-4aec-8d7d-f1bf82d2bd0f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:43.676799 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6a0ea-58ee-4aec-8d7d-f1bf82d2bd0f None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:43.678305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 424/828] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:43.678408 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457af592-a95b-4c4a-b051-5766829087a0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:43.683392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e84b9-4f3e-47ea-94f8-2ef1d70907f9 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:43.683950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e84b9-4f3e-47ea-94f8-2ef1d70907f9 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:43.684556 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e84b9-4f3e-47ea-94f8-2ef1d70907f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:43.686402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:43.705630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ed8e84b9-4f3e-47ea-94f8-2ef1d70907f9 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:43.707288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ed8e84b9-4f3e-47ea-94f8-2ef1d70907f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:43.724930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2bc5-f3ac-4a58-b92d-13a7a4ef15a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:43.725730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2bc5-f3ac-4a58-b92d-13a7a4ef15a2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:43.726259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2bc5-f3ac-4a58-b92d-13a7a4ef15a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:43.726549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2bc5-f3ac-4a58-b92d-13a7a4ef15a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:43.741590 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb2bc5-f3ac-4a58-b92d-13a7a4ef15a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:43.743141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb2bc5-f3ac-4a58-b92d-13a7a4ef15a2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b2bb2bc5-f3ac-4a58-b92d-13a7a4ef15a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:43.764944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:43.765868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:43.766740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:43.766740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:43.766740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:43.766740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:43.766740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 405/829] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:43.771728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2bc5-f3ac-4a58-b92d-13a7a4ef15a2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:43.791215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 425/830] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:43.811603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e84b9-4f3e-47ea-94f8-2ef1d70907f9 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:43.917405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2bc5-f3ac-4a58-b92d-13a7a4ef15a2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:43.943398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e84b9-4f3e-47ea-94f8-2ef1d70907f9 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:43.956241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ea6d-7261-4611-9bc1-a5f0b37b475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:43.957229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ea6d-7261-4611-9bc1-a5f0b37b475c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:43.957632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ea6d-7261-4611-9bc1-a5f0b37b475c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:43.957916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ea6d-7261-4611-9bc1-a5f0b37b475c None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:43.959182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ea6d-7261-4611-9bc1-a5f0b37b475c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:43.959689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ea6d-7261-4611-9bc1-a5f0b37b475c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:43.961195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ea6d-7261-4611-9bc1-a5f0b37b475c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:43.974523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:43.977076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 406/831] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:43.982935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ea6d-7261-4611-9bc1-a5f0b37b475c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:43.989696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be87f78-6509-4c66-b58f-7886c435f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:43.990833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87f78-6509-4c66-b58f-7886c435f008 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:43.991438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87f78-6509-4c66-b58f-7886c435f008 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:43.991982 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87f78-6509-4c66-b58f-7886c435f008 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:44.002106 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:44.010814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be87f78-6509-4c66-b58f-7886c435f008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-7be87f78-6509-4c66-b58f-7886c435f008 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:44.020129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:44.021073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:52:44.021901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:44.024821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 426/832] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:44.031027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be87f78-6509-4c66-b58f-7886c435f008 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:44.091565 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ea6d-7261-4611-9bc1-a5f0b37b475c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:44.127502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd2601-621d-4e30-a1bb-bd91bbf24786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:44.128600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2601-621d-4e30-a1bb-bd91bbf24786 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:44.129052 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2601-621d-4e30-a1bb-bd91bbf24786 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:44.129544 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd2601-621d-4e30-a1bb-bd91bbf24786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:44.136910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd2601-621d-4e30-a1bb-bd91bbf24786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:44.138657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd2601-621d-4e30-a1bb-bd91bbf24786 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:44.138770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be87f78-6509-4c66-b58f-7886c435f008 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-f8fd2601-621d-4e30-a1bb-bd91bbf24786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:44.153395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:44.154284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:44.155177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:44.155177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:44.155177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:44.155177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:44.155177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:44.155177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:44.155177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:44.155177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:44.157193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 407/833] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:44.162902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd2601-621d-4e30-a1bb-bd91bbf24786 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:44.172754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edef3-62b8-4732-8301-2726ad2eedb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:44.173426 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edef3-62b8-4732-8301-2726ad2eedb7 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:44.173710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edef3-62b8-4732-8301-2726ad2eedb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:44.173992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edef3-62b8-4732-8301-2726ad2eedb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:44.175030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330edef3-62b8-4732-8301-2726ad2eedb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:44.175356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330edef3-62b8-4732-8301-2726ad2eedb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:44.177074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330edef3-62b8-4732-8301-2726ad2eedb7 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:44.190839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 427/834] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:44.192027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edef3-62b8-4732-8301-2726ad2eedb7 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:44.258495 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:44.267439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:44.285178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd2601-621d-4e30-a1bb-bd91bbf24786 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:44.300040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edef3-62b8-4732-8301-2726ad2eedb7 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:44.331152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e5571-f157-483b-a041-3970c94d7e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:44.332110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e5571-f157-483b-a041-3970c94d7e5b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:44.332397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e5571-f157-483b-a041-3970c94d7e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:44.332682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e5571-f157-483b-a041-3970c94d7e5b None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:44.333597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e5571-f157-483b-a041-3970c94d7e5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:44.333908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e5571-f157-483b-a041-3970c94d7e5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:44.335504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e5571-f157-483b-a041-3970c94d7e5b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:44.337238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4595d-53f4-4396-bf0e-cf458d3c6afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:44.338399 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4595d-53f4-4396-bf0e-cf458d3c6afe None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:44.339092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4595d-53f4-4396-bf0e-cf458d3c6afe None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:44.339558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4595d-53f4-4396-bf0e-cf458d3c6afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:44.350882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 408/835] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:44.351968 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4595d-53f4-4396-bf0e-cf458d3c6afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:44.353550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4595d-53f4-4396-bf0e-cf458d3c6afe None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:44.356628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e5571-f157-483b-a041-3970c94d7e5b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-9cb4595d-53f4-4396-bf0e-cf458d3c6afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:44.371476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:44.372537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:44.373456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:44.373456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:44.373456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:44.373456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:44.377595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 428/836] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:44.378522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4595d-53f4-4396-bf0e-cf458d3c6afe None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:44.481936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e5571-f157-483b-a041-3970c94d7e5b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:44.486494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:44.489638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4595d-53f4-4396-bf0e-cf458d3c6afe None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:44.522824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4580f0-590b-4891-aef4-c008cfbbe899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:44.523546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4580f0-590b-4891-aef4-c008cfbbe899 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:44.523797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4580f0-590b-4891-aef4-c008cfbbe899 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:44.524140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4580f0-590b-4891-aef4-c008cfbbe899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:44.524888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4580f0-590b-4891-aef4-c008cfbbe899 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=24319e5e83ed4caf9dd3ae4b3937b3fb) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:44.525196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4580f0-590b-4891-aef4-c008cfbbe899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:44.526801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4580f0-590b-4891-aef4-c008cfbbe899 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:44.533804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 409/837] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:44 2022] GET /identity/v3/role_assignments?user.id=24319e5e83ed4caf9dd3ae4b3937b3fb&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:44.538423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd068a59-87ef-4fa1-90e2-5694a64eddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:44.539347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068a59-87ef-4fa1-90e2-5694a64eddfc None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:44.539774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068a59-87ef-4fa1-90e2-5694a64eddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:44.540184 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068a59-87ef-4fa1-90e2-5694a64eddfc None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:44.541408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd068a59-87ef-4fa1-90e2-5694a64eddfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:44.541852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd068a59-87ef-4fa1-90e2-5694a64eddfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:44.543435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd068a59-87ef-4fa1-90e2-5694a64eddfc None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:44.557836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 429/838] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:44.567038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4580f0-590b-4891-aef4-c008cfbbe899 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:44.570113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:44.679751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4580f0-590b-4891-aef4-c008cfbbe899 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:44.715107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe6398-c6d0-4ca7-9357-31f4d39031e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:44.716049 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe6398-c6d0-4ca7-9357-31f4d39031e5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:44.716331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe6398-c6d0-4ca7-9357-31f4d39031e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:44.716612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe6398-c6d0-4ca7-9357-31f4d39031e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:44.724421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe6398-c6d0-4ca7-9357-31f4d39031e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:44.725877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe6398-c6d0-4ca7-9357-31f4d39031e5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-fefe6398-c6d0-4ca7-9357-31f4d39031e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:44.740233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:44.741212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:44.742140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:44.742140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:44.742140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:44.742140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:44.742140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:44.742140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:44.742140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:44.742140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:44.742140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 26 02:52:44.742140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:44.742140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 410/839] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:52:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:44.748918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd068a59-87ef-4fa1-90e2-5694a64eddfc None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:44.798036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cddcd-eae3-470f-91c3-a733af60bcea None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:44.798352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cddcd-eae3-470f-91c3-a733af60bcea None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:44.798661 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cddcd-eae3-470f-91c3-a733af60bcea None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:44.800148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 411/840] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:44.805014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67111538-2b04-4f0f-ad78-8803eb3f0461 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:44.805296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67111538-2b04-4f0f-ad78-8803eb3f0461 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:44.805939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67111538-2b04-4f0f-ad78-8803eb3f0461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:44.826098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-67111538-2b04-4f0f-ad78-8803eb3f0461 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:44.827577 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-67111538-2b04-4f0f-ad78-8803eb3f0461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:44.864612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd068a59-87ef-4fa1-90e2-5694a64eddfc None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:44.895326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:44.902283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6387f-5fda-4ced-844b-e640147df26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:44.903016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6387f-5fda-4ced-844b-e640147df26e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:44.903494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6387f-5fda-4ced-844b-e640147df26e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:44.903781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6387f-5fda-4ced-844b-e640147df26e None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:44.905266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6387f-5fda-4ced-844b-e640147df26e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:44.905577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6387f-5fda-4ced-844b-e640147df26e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:44.907052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6387f-5fda-4ced-844b-e640147df26e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:44.909041 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 412/841] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:44.928560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 430/842] 10.222.0.36 () {56 vars in 1135 bytes} [Sun Jun 26 02:52:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:44.932259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67111538-2b04-4f0f-ad78-8803eb3f0461 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:44.933858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6387f-5fda-4ced-844b-e640147df26e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:44.953964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:45.034348 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67111538-2b04-4f0f-ad78-8803eb3f0461 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:45.040693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6387f-5fda-4ced-844b-e640147df26e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:45.070970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf4697-20ad-4a31-b58a-30e9999cf681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:45.071964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf4697-20ad-4a31-b58a-30e9999cf681 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:45.072343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf4697-20ad-4a31-b58a-30e9999cf681 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:45.072787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf4697-20ad-4a31-b58a-30e9999cf681 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:45.073603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf4697-20ad-4a31-b58a-30e9999cf681 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:45.075256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf4697-20ad-4a31-b58a-30e9999cf681 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:45.080156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d743c83-ae8e-43b3-a359-74d8130b18e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:45.080815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d743c83-ae8e-43b3-a359-74d8130b18e9 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:45.081093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d743c83-ae8e-43b3-a359-74d8130b18e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:45.081363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d743c83-ae8e-43b3-a359-74d8130b18e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-decf4697-20ad-4a31-b58a-30e9999cf681 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:45.090695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:45.091702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 26 02:52:45.092512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:45.096919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 413/843] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:45.097761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf4697-20ad-4a31-b58a-30e9999cf681 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:45.157333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:45.176188 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d743c83-ae8e-43b3-a359-74d8130b18e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:45.179164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d743c83-ae8e-43b3-a359-74d8130b18e9 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:45.198212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:45.217647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf4697-20ad-4a31-b58a-30e9999cf681 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:45.261251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff02ed-9f8e-478f-be9b-671e38d65ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:45.261926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff02ed-9f8e-478f-be9b-671e38d65ccb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:45.262245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff02ed-9f8e-478f-be9b-671e38d65ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:45.262527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff02ed-9f8e-478f-be9b-671e38d65ccb None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:45.263264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff02ed-9f8e-478f-be9b-671e38d65ccb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:45.263570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff02ed-9f8e-478f-be9b-671e38d65ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:45.264940 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff02ed-9f8e-478f-be9b-671e38d65ccb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:45.270008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 414/844] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:45.273709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee743-4b7c-4116-a8f5-36ee8481b788 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:45.273709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee743-4b7c-4116-a8f5-36ee8481b788 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:45.273709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee743-4b7c-4116-a8f5-36ee8481b788 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:45.274089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 415/845] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:45.276977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ee743-4b7c-4116-a8f5-36ee8481b788 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:45.287131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 431/846] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 26 02:52:45.288838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119603e-1387-429a-9961-49e0ae878a80 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:45.289310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119603e-1387-429a-9961-49e0ae878a80 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:45.289591 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119603e-1387-429a-9961-49e0ae878a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:45.307300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8119603e-1387-429a-9961-49e0ae878a80 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:45.308469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8119603e-1387-429a-9961-49e0ae878a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:45.373859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 432/847] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:45.374616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119603e-1387-429a-9961-49e0ae878a80 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:45.391053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ee743-4b7c-4116-a8f5-36ee8481b788 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:45.412612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:45.427269 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dc6e5-7e3f-4756-8cba-0bcd53db31c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:45.428187 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc6e5-7e3f-4756-8cba-0bcd53db31c6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:45.428677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc6e5-7e3f-4756-8cba-0bcd53db31c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:45.429122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc6e5-7e3f-4756-8cba-0bcd53db31c6 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:45.429999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9dc6e5-7e3f-4756-8cba-0bcd53db31c6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:45.430576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9dc6e5-7e3f-4756-8cba-0bcd53db31c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:45.432280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9dc6e5-7e3f-4756-8cba-0bcd53db31c6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:45.437863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 416/848] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:45.439005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dc6e5-7e3f-4756-8cba-0bcd53db31c6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:45.566708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dc6e5-7e3f-4756-8cba-0bcd53db31c6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:45.574484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:45.610009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68504203-aca8-40a6-8954-d30ae9aea99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:45.611122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68504203-aca8-40a6-8954-d30ae9aea99c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:45.611556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68504203-aca8-40a6-8954-d30ae9aea99c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:45.611965 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68504203-aca8-40a6-8954-d30ae9aea99c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:45.625402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68504203-aca8-40a6-8954-d30ae9aea99c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-68504203-aca8-40a6-8954-d30ae9aea99c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:45.635037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:45.635956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:45.636790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 417/849] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:52:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:45.643435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119603e-1387-429a-9961-49e0ae878a80 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:45.643584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68504203-aca8-40a6-8954-d30ae9aea99c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:45.685140 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e209143-d0b9-4c50-a21f-65f6e1b5b203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:45.685961 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209143-d0b9-4c50-a21f-65f6e1b5b203 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:45.686240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209143-d0b9-4c50-a21f-65f6e1b5b203 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:45.686566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209143-d0b9-4c50-a21f-65f6e1b5b203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:45.699597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e209143-d0b9-4c50-a21f-65f6e1b5b203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:45.700328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:45.701754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e209143-d0b9-4c50-a21f-65f6e1b5b203 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-5e209143-d0b9-4c50-a21f-65f6e1b5b203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:45.720789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:45.721750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:45.722635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:45.722635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:45.722635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:45.722635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:45.722635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 433/850] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:45.728759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e209143-d0b9-4c50-a21f-65f6e1b5b203 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:45.770035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68504203-aca8-40a6-8954-d30ae9aea99c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:45.815453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1bbfb-58c6-46f3-a53f-0c035ed41278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:45.816407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bbfb-58c6-46f3-a53f-0c035ed41278 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:45.816692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bbfb-58c6-46f3-a53f-0c035ed41278 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:45.816976 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bbfb-58c6-46f3-a53f-0c035ed41278 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:45.818331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1bbfb-58c6-46f3-a53f-0c035ed41278 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:45.818644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1bbfb-58c6-46f3-a53f-0c035ed41278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:45.820598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1bbfb-58c6-46f3-a53f-0c035ed41278 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:45.833547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 418/851] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:52:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:45.838942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1bbfb-58c6-46f3-a53f-0c035ed41278 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:45.854610 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:45.858271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e209143-d0b9-4c50-a21f-65f6e1b5b203 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:45.894389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec22788-74d0-4cdc-b376-5f0c3a9a1048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:45.895491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec22788-74d0-4cdc-b376-5f0c3a9a1048 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:45.895952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec22788-74d0-4cdc-b376-5f0c3a9a1048 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:45.896402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec22788-74d0-4cdc-b376-5f0c3a9a1048 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:45.897752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec22788-74d0-4cdc-b376-5f0c3a9a1048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:45.898517 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec22788-74d0-4cdc-b376-5f0c3a9a1048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:45.900349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec22788-74d0-4cdc-b376-5f0c3a9a1048 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:45.916676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 434/852] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:45.923528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec22788-74d0-4cdc-b376-5f0c3a9a1048 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:45.957807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1bbfb-58c6-46f3-a53f-0c035ed41278 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:45.967216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:45.998230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e654e-7b54-407c-b11e-9d95867c304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:45.999553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e654e-7b54-407c-b11e-9d95867c304e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:46.000030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e654e-7b54-407c-b11e-9d95867c304e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:46.000498 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e654e-7b54-407c-b11e-9d95867c304e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:46.011830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e654e-7b54-407c-b11e-9d95867c304e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:46.013929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e654e-7b54-407c-b11e-9d95867c304e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:46.029950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec22788-74d0-4cdc-b376-5f0c3a9a1048 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-340e654e-7b54-407c-b11e-9d95867c304e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:46.032728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:46.033617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:46.034864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:46.034864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:46.034864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:46.034864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:46.037206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 419/853] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:46.043185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e654e-7b54-407c-b11e-9d95867c304e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:46.072448 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44413bc6-9045-4c5f-b167-9f327ade4003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:46.074029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44413bc6-9045-4c5f-b167-9f327ade4003 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:46.074535 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44413bc6-9045-4c5f-b167-9f327ade4003 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:46.075309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44413bc6-9045-4c5f-b167-9f327ade4003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:46.084500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44413bc6-9045-4c5f-b167-9f327ade4003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:46.086318 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44413bc6-9045-4c5f-b167-9f327ade4003 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-44413bc6-9045-4c5f-b167-9f327ade4003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:46.106978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:46.107958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:46.108839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:46.108839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:46.108839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:46.108839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:46.108839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:46.108839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:46.108839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:46.108839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:46.116689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 435/854] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:46.117388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44413bc6-9045-4c5f-b167-9f327ade4003 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:46.145140 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:46.173225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e654e-7b54-407c-b11e-9d95867c304e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:46.215964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bbabd-83fb-4ad1-a3a3-26accb3a97c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:46.217066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bbabd-83fb-4ad1-a3a3-26accb3a97c1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:46.217560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bbabd-83fb-4ad1-a3a3-26accb3a97c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:46.218025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bbabd-83fb-4ad1-a3a3-26accb3a97c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:46.219044 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bbabd-83fb-4ad1-a3a3-26accb3a97c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:46.219543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bbabd-83fb-4ad1-a3a3-26accb3a97c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:46.221147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bbabd-83fb-4ad1-a3a3-26accb3a97c1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:46.236067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 420/855] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:46.242240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bbabd-83fb-4ad1-a3a3-26accb3a97c1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:46.247419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44413bc6-9045-4c5f-b167-9f327ade4003 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:46.266100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:46.294319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ff6d5-b4b4-41d9-b0ce-cc4773411203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:46.295360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ff6d5-b4b4-41d9-b0ce-cc4773411203 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:46.296266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ff6d5-b4b4-41d9-b0ce-cc4773411203 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:46.296771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ff6d5-b4b4-41d9-b0ce-cc4773411203 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:46.298388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ff6d5-b4b4-41d9-b0ce-cc4773411203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:46.298898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ff6d5-b4b4-41d9-b0ce-cc4773411203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:46.301263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ff6d5-b4b4-41d9-b0ce-cc4773411203 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:46.321130 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 436/856] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:46.322633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ff6d5-b4b4-41d9-b0ce-cc4773411203 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:46.370417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bbabd-83fb-4ad1-a3a3-26accb3a97c1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:46.417521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa25932-349a-4b5c-9dc0-8516804cc0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:46.418742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25932-349a-4b5c-9dc0-8516804cc0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:46.419654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25932-349a-4b5c-9dc0-8516804cc0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:46.420147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25932-349a-4b5c-9dc0-8516804cc0d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:46.423440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:46.429850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa25932-349a-4b5c-9dc0-8516804cc0d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:46.431849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa25932-349a-4b5c-9dc0-8516804cc0d0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:46.442969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ff6d5-b4b4-41d9-b0ce-cc4773411203 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-6fa25932-349a-4b5c-9dc0-8516804cc0d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:46.449478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:46.450490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:46.451469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:46.451469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:46.451469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:46.451469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:46.451469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:46.451469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:46.451469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:46.451469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:46.451469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:52:46.451469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:46.454147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 421/857] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Jun 26 02:52:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:46.459916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa25932-349a-4b5c-9dc0-8516804cc0d0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:46.486719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25666e5f-9a9d-4c22-b412-f9b25084c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:46.488023 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25666e5f-9a9d-4c22-b412-f9b25084c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:46.488497 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25666e5f-9a9d-4c22-b412-f9b25084c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:46.489164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25666e5f-9a9d-4c22-b412-f9b25084c7a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:46.490861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25666e5f-9a9d-4c22-b412-f9b25084c7a1 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=d585280109eb4773adf7d56fd722a4b4) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:46.491405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25666e5f-9a9d-4c22-b412-f9b25084c7a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:46.493933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25666e5f-9a9d-4c22-b412-f9b25084c7a1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:46.507782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 437/858] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:46 2022] GET /identity/v3/role_assignments?user.id=d585280109eb4773adf7d56fd722a4b4&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:46.555637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:46.573655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa25932-349a-4b5c-9dc0-8516804cc0d0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:46.612570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1b686-d2fd-47d6-8708-3f3c900615b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:46.613277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1b686-d2fd-47d6-8708-3f3c900615b7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:46.613561 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1b686-d2fd-47d6-8708-3f3c900615b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:46.613841 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1b686-d2fd-47d6-8708-3f3c900615b7 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:46.614733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1b686-d2fd-47d6-8708-3f3c900615b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:46.615079 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1b686-d2fd-47d6-8708-3f3c900615b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:46.616637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1b686-d2fd-47d6-8708-3f3c900615b7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:46.640712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 422/859] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Jun 26 02:52:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:46.642978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25666e5f-9a9d-4c22-b412-f9b25084c7a1 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:46.680543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86fd09-b40c-4df6-95e9-c8f1078c466b None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:46.680728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86fd09-b40c-4df6-95e9-c8f1078c466b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:46.681002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86fd09-b40c-4df6-95e9-c8f1078c466b None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:46.683027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 423/860] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:46.689911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c634e-10f5-4545-9321-9f34d91aeb9b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:46.690487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c634e-10f5-4545-9321-9f34d91aeb9b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:46.690968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c634e-10f5-4545-9321-9f34d91aeb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:46.709897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9a3c634e-10f5-4545-9321-9f34d91aeb9b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:46.711219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9a3c634e-10f5-4545-9321-9f34d91aeb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:46.767164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25666e5f-9a9d-4c22-b412-f9b25084c7a1 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:46.788583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 424/861] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:46.804296 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9f3a8-afea-4b95-a901-bdea92978f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:46.805012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9f3a8-afea-4b95-a901-bdea92978f1d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:46.805280 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9f3a8-afea-4b95-a901-bdea92978f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:46.805545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9f3a8-afea-4b95-a901-bdea92978f1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:46.811187 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c634e-10f5-4545-9321-9f34d91aeb9b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:46.840732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:46.884040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:46.893899 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9f3a8-afea-4b95-a901-bdea92978f1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:46.896104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9f3a8-afea-4b95-a901-bdea92978f1d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:46.920376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c634e-10f5-4545-9321-9f34d91aeb9b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:46.966743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ac40-ae1c-437f-999a-8abe709fac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:46.967856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ac40-ae1c-437f-999a-8abe709fac68 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:46.968372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ac40-ae1c-437f-999a-8abe709fac68 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:46.969030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ac40-ae1c-437f-999a-8abe709fac68 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:46.970395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14ac40-ae1c-437f-999a-8abe709fac68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:46.972205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14ac40-ae1c-437f-999a-8abe709fac68 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-1c14ac40-ae1c-437f-999a-8abe709fac68 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:46.988848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:46.990054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 26 02:52:46.991110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:46.993986 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 425/862] 10.222.0.36 () {56 vars in 1132 bytes} [Sun Jun 26 02:52:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:47.000449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ac40-ae1c-437f-999a-8abe709fac68 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:47.015629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 438/863] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:52:47.024272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9f3a8-afea-4b95-a901-bdea92978f1d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:47.077947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:47.122371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ac40-ae1c-437f-999a-8abe709fac68 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:47.146835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9f3a8-afea-4b95-a901-bdea92978f1d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:47.157388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:47.165254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403988f-f783-409b-8960-7eef13e3ffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:47.166378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403988f-f783-409b-8960-7eef13e3ffe9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:47.166846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403988f-f783-409b-8960-7eef13e3ffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:47.167233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403988f-f783-409b-8960-7eef13e3ffe9 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:47.168469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403988f-f783-409b-8960-7eef13e3ffe9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:47.168845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403988f-f783-409b-8960-7eef13e3ffe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:47.170534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403988f-f783-409b-8960-7eef13e3ffe9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:47.180938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 426/864] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Jun 26 02:52:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:47.182693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403988f-f783-409b-8960-7eef13e3ffe9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:47.195486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17870653-1791-4178-934d-c92e333df793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:47.197052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17870653-1791-4178-934d-c92e333df793 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:47.197863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17870653-1791-4178-934d-c92e333df793 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:47.198466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17870653-1791-4178-934d-c92e333df793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:47.212423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17870653-1791-4178-934d-c92e333df793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:47.214684 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17870653-1791-4178-934d-c92e333df793 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-17870653-1791-4178-934d-c92e333df793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:47.237769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:47.238701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:47.239633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:47.239633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:47.239633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:47.239633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:47.241523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 439/865] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:47.245894 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17870653-1791-4178-934d-c92e333df793 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:47.295185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403988f-f783-409b-8960-7eef13e3ffe9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:47.330793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f403b-769f-40f0-8839-aeebfce0292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:47.331910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f403b-769f-40f0-8839-aeebfce0292a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:47.332390 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f403b-769f-40f0-8839-aeebfce0292a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:47.332864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f403b-769f-40f0-8839-aeebfce0292a None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:47.333791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f403b-769f-40f0-8839-aeebfce0292a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:47.334302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f403b-769f-40f0-8839-aeebfce0292a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:47.335896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f403b-769f-40f0-8839-aeebfce0292a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:47.341239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 427/866] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Jun 26 02:52:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:47.351032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17870653-1791-4178-934d-c92e333df793 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:47.351032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:47.384525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b15b6-e2aa-4dfe-b66c-e31cc60ad264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:47.385212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b15b6-e2aa-4dfe-b66c-e31cc60ad264 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:47.385523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b15b6-e2aa-4dfe-b66c-e31cc60ad264 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:47.385806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b15b6-e2aa-4dfe-b66c-e31cc60ad264 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:47.386563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b15b6-e2aa-4dfe-b66c-e31cc60ad264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:47.386877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b15b6-e2aa-4dfe-b66c-e31cc60ad264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:47.388393 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b15b6-e2aa-4dfe-b66c-e31cc60ad264 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:47.402154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 440/867] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:47.408397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f403b-769f-40f0-8839-aeebfce0292a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:47.475947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:47.526475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f403b-769f-40f0-8839-aeebfce0292a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:47.562291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a1feb-6639-4f37-ae05-6e87e98842e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:47.563121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a1feb-6639-4f37-ae05-6e87e98842e9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:47.563396 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a1feb-6639-4f37-ae05-6e87e98842e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:47.563666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a1feb-6639-4f37-ae05-6e87e98842e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:47.571050 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34079537-3b59-4ce3-9015-bdabc2fa0f7a None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:47.571336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34079537-3b59-4ce3-9015-bdabc2fa0f7a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:47.571614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34079537-3b59-4ce3-9015-bdabc2fa0f7a None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:47.572432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a1feb-6639-4f37-ae05-6e87e98842e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:47.573233 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 441/868] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:47.573908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a1feb-6639-4f37-ae05-6e87e98842e9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:47.578303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123427e-faf0-4ac4-9a26-ad35ed4bc5d9 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:47.578598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123427e-faf0-4ac4-9a26-ad35ed4bc5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:47.578881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123427e-faf0-4ac4-9a26-ad35ed4bc5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-fb8a1feb-6639-4f37-ae05-6e87e98842e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:47.588417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:47.589287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:47.590163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:47.590163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:47.590163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:47.590163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:47.590163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:47.590163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:47.590163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:47.590163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:47.590163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 428/869] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:47.595945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a1feb-6639-4f37-ae05-6e87e98842e9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:47.606212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-2123427e-faf0-4ac4-9a26-ad35ed4bc5d9 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:47.607495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2123427e-faf0-4ac4-9a26-ad35ed4bc5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:47.679850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 442/870] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:47.702328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123427e-faf0-4ac4-9a26-ad35ed4bc5d9 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:47.710367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a1feb-6639-4f37-ae05-6e87e98842e9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:47.735470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:47.758975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7361ac-500d-48ad-affa-d860004243aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:47.759884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7361ac-500d-48ad-affa-d860004243aa None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:47.760172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7361ac-500d-48ad-affa-d860004243aa None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:47.760450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7361ac-500d-48ad-affa-d860004243aa None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:47.761256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7361ac-500d-48ad-affa-d860004243aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:47.761863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7361ac-500d-48ad-affa-d860004243aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:47.764324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7361ac-500d-48ad-affa-d860004243aa None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:47.783123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 429/871] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:47.788609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7361ac-500d-48ad-affa-d860004243aa None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:47.813422 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:47.829857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123427e-faf0-4ac4-9a26-ad35ed4bc5d9 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:47.866548 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffe6b9-705b-4eee-a36d-05fb13711c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:47.867468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe6b9-705b-4eee-a36d-05fb13711c70 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:47.867845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe6b9-705b-4eee-a36d-05fb13711c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:47.868258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe6b9-705b-4eee-a36d-05fb13711c70 None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:47.869088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffe6b9-705b-4eee-a36d-05fb13711c70 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:47.870584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffe6b9-705b-4eee-a36d-05fb13711c70 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:47.887556 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 443/872] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:52:47 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:47.919134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7361ac-500d-48ad-affa-d860004243aa None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:47.965286 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e168f-ee88-41e8-ac3d-21de67cf410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:47.966224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e168f-ee88-41e8-ac3d-21de67cf410a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:47.966650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e168f-ee88-41e8-ac3d-21de67cf410a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:47.967098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e168f-ee88-41e8-ac3d-21de67cf410a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:47.968106 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e168f-ee88-41e8-ac3d-21de67cf410a None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=d78da06180d0420f82074fa5e3cbc71e) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:47.968563 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e168f-ee88-41e8-ac3d-21de67cf410a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:47.970173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e168f-ee88-41e8-ac3d-21de67cf410a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:47.983199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 430/873] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:47 2022] GET /identity/v3/role_assignments?user.id=d78da06180d0420f82074fa5e3cbc71e&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:48.689621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731dc2-e8fe-48bc-8a7c-880881bc1a70 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:48.690186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731dc2-e8fe-48bc-8a7c-880881bc1a70 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:48.690186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731dc2-e8fe-48bc-8a7c-880881bc1a70 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:48.691845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 444/874] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:48.696931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e213c-5015-4c97-b3dd-c5c773a526fd None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:48.697344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e213c-5015-4c97-b3dd-c5c773a526fd None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:48.697511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e213c-5015-4c97-b3dd-c5c773a526fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:48.715175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2a9e213c-5015-4c97-b3dd-c5c773a526fd None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:48.716349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2a9e213c-5015-4c97-b3dd-c5c773a526fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:48.750055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:48.789158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 431/875] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:48.811082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55731dc2-e8fe-48bc-8a7c-880881bc1a70 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:48.919611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55731dc2-e8fe-48bc-8a7c-880881bc1a70 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:48.954340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e255132-fe49-4540-84ff-8a59c7542d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:48.955185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e255132-fe49-4540-84ff-8a59c7542d64 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:48.955467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e255132-fe49-4540-84ff-8a59c7542d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:48.955741 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e255132-fe49-4540-84ff-8a59c7542d64 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:48.956398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e255132-fe49-4540-84ff-8a59c7542d64 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:48.957779 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e255132-fe49-4540-84ff-8a59c7542d64 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-1e255132-fe49-4540-84ff-8a59c7542d64 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:48.969989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:48.971008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:48.972010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 445/876] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Jun 26 02:52:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:48.977202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e213c-5015-4c97-b3dd-c5c773a526fd None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:49.079341 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e213c-5015-4c97-b3dd-c5c773a526fd None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:49.114673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9de2e7-5e7c-45c7-82bd-ad7099276dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:49.115690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de2e7-5e7c-45c7-82bd-ad7099276dab None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:49.116151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de2e7-5e7c-45c7-82bd-ad7099276dab None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:49.116602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9de2e7-5e7c-45c7-82bd-ad7099276dab None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:49.117521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9de2e7-5e7c-45c7-82bd-ad7099276dab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:49.118017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9de2e7-5e7c-45c7-82bd-ad7099276dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:49.119600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9de2e7-5e7c-45c7-82bd-ad7099276dab None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:49.125318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 432/877] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Jun 26 02:52:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:49.130672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e255132-fe49-4540-84ff-8a59c7542d64 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:49.145988 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:49.241996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e255132-fe49-4540-84ff-8a59c7542d64 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:49.275303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4abc05-08b7-4f01-923f-8077781e4039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:49.275971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4abc05-08b7-4f01-923f-8077781e4039 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:49.276253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4abc05-08b7-4f01-923f-8077781e4039 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:49.276527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4abc05-08b7-4f01-923f-8077781e4039 None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:49.277230 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4abc05-08b7-4f01-923f-8077781e4039 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:49.277531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4abc05-08b7-4f01-923f-8077781e4039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:49.279059 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4abc05-08b7-4f01-923f-8077781e4039 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:49.284150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 446/878] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Jun 26 02:52:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:49.432582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993bb00-5ada-4405-b7fc-51b9434fc691 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:49.432927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993bb00-5ada-4405-b7fc-51b9434fc691 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:49.433047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993bb00-5ada-4405-b7fc-51b9434fc691 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:49.434749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 433/879] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:49.440287 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4bb5-af74-4ff9-af64-31322d91c6ef None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:49.440581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4bb5-af74-4ff9-af64-31322d91c6ef None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:49.440862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4bb5-af74-4ff9-af64-31322d91c6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:49.457978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-840e4bb5-af74-4ff9-af64-31322d91c6ef None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:49.459204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-840e4bb5-af74-4ff9-af64-31322d91c6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:49.532366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 447/880] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:49.555069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993bb00-5ada-4405-b7fc-51b9434fc691 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:49.588003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:49.663786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993bb00-5ada-4405-b7fc-51b9434fc691 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:49.699284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214039d1-1349-4c7b-9c58-d561dcac38a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:49.700058 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214039d1-1349-4c7b-9c58-d561dcac38a5 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:49.700363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214039d1-1349-4c7b-9c58-d561dcac38a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:49.700512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214039d1-1349-4c7b-9c58-d561dcac38a5 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:49.701221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214039d1-1349-4c7b-9c58-d561dcac38a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:49.702657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214039d1-1349-4c7b-9c58-d561dcac38a5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:49.720769 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 434/881] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:52:49 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:50.038655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47dc6d6-fc87-4305-bdf1-a24755d1217a None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:50.039660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47dc6d6-fc87-4305-bdf1-a24755d1217a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:50.040166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47dc6d6-fc87-4305-bdf1-a24755d1217a None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:50.042341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 448/882] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:50.048046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512162-c11a-4eab-9842-129a1ab1c31d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:50.048591 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512162-c11a-4eab-9842-129a1ab1c31d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:50.049068 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512162-c11a-4eab-9842-129a1ab1c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:50.066405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-de512162-c11a-4eab-9842-129a1ab1c31d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:50.067933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-de512162-c11a-4eab-9842-129a1ab1c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:50.141033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 435/883] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:50.164191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47dc6d6-fc87-4305-bdf1-a24755d1217a None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:50.168906 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:50.176158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2259afd-2f72-4a9c-87ef-f63d133ace25 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:50.176449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2259afd-2f72-4a9c-87ef-f63d133ace25 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:50.176729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2259afd-2f72-4a9c-87ef-f63d133ace25 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:50.178753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 436/884] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:50.184799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe514538-14b8-4c0d-8fb1-7b3601b0c13d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:50.185086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe514538-14b8-4c0d-8fb1-7b3601b0c13d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:50.185366 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe514538-14b8-4c0d-8fb1-7b3601b0c13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:50.202202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fe514538-14b8-4c0d-8fb1-7b3601b0c13d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:50.203438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fe514538-14b8-4c0d-8fb1-7b3601b0c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:50.217553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:50.277873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 437/885] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:50.288328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47dc6d6-fc87-4305-bdf1-a24755d1217a None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:50.304096 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe514538-14b8-4c0d-8fb1-7b3601b0c13d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:50.332151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde267e-5425-410c-ad75-5889178b037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:50.332966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde267e-5425-410c-ad75-5889178b037f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:50.333244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde267e-5425-410c-ad75-5889178b037f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:50.333519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde267e-5425-410c-ad75-5889178b037f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:50.334175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde267e-5425-410c-ad75-5889178b037f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:50.335638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde267e-5425-410c-ad75-5889178b037f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-fcde267e-5425-410c-ad75-5889178b037f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:50.348040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:50.349025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:50.350274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 449/886] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:50.355289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde267e-5425-410c-ad75-5889178b037f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:50.431783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe514538-14b8-4c0d-8fb1-7b3601b0c13d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:50.445821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:50.468736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8972f0-6147-4507-9b60-2306866dc502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:50.469557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8972f0-6147-4507-9b60-2306866dc502 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:50.469895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8972f0-6147-4507-9b60-2306866dc502 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:50.470106 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8972f0-6147-4507-9b60-2306866dc502 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:50.488913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde267e-5425-410c-ad75-5889178b037f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:50.490814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8972f0-6147-4507-9b60-2306866dc502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-ea8972f0-6147-4507-9b60-2306866dc502 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:50.503069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:50.503981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:52:50.504889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:50.512894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 438/887] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Jun 26 02:52:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:50.514355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8972f0-6147-4507-9b60-2306866dc502 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:50.531319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:50.537449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ee5de-2296-4fbf-a55a-c75079733fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:50.538606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ee5de-2296-4fbf-a55a-c75079733fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:50.538955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ee5de-2296-4fbf-a55a-c75079733fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:50.539379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ee5de-2296-4fbf-a55a-c75079733fc2 None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:50.540216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ee5de-2296-4fbf-a55a-c75079733fc2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:50.540604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ee5de-2296-4fbf-a55a-c75079733fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:50.542657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ee5de-2296-4fbf-a55a-c75079733fc2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:50.552662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 450/888] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:50.553719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ee5de-2296-4fbf-a55a-c75079733fc2 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:50.648278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8972f0-6147-4507-9b60-2306866dc502 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:50.655499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ee5de-2296-4fbf-a55a-c75079733fc2 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:50.687890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:50.692342 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fefbf-de79-47c1-9505-8ed9c33da406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:50.693099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fefbf-de79-47c1-9505-8ed9c33da406 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:50.693489 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fefbf-de79-47c1-9505-8ed9c33da406 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:50.693856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fefbf-de79-47c1-9505-8ed9c33da406 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:50.694676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fefbf-de79-47c1-9505-8ed9c33da406 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:50.694908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff7edf-0c37-4e32-9f51-91b55392108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:50.695063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fefbf-de79-47c1-9505-8ed9c33da406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:50.695885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff7edf-0c37-4e32-9f51-91b55392108c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:50.696349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff7edf-0c37-4e32-9f51-91b55392108c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:50.696638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fefbf-de79-47c1-9505-8ed9c33da406 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:50.696970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff7edf-0c37-4e32-9f51-91b55392108c None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:50.697855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff7edf-0c37-4e32-9f51-91b55392108c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:50.698602 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff7edf-0c37-4e32-9f51-91b55392108c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:50.700610 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff7edf-0c37-4e32-9f51-91b55392108c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:50.710254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 439/889] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Jun 26 02:52:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:50.713218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fefbf-de79-47c1-9505-8ed9c33da406 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:50.713823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 451/890] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:50.714505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff7edf-0c37-4e32-9f51-91b55392108c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:50.801008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:50.834524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fefbf-de79-47c1-9505-8ed9c33da406 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:50.835106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff7edf-0c37-4e32-9f51-91b55392108c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:50.870091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1edf0e-f887-42f6-9f4a-c0e6753c99d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:50.870889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1edf0e-f887-42f6-9f4a-c0e6753c99d6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:50.871202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1edf0e-f887-42f6-9f4a-c0e6753c99d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:50.871526 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1edf0e-f887-42f6-9f4a-c0e6753c99d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:50.871907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00230e68-1c28-47e9-ae87-e10ef6dd9d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:50.872906 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00230e68-1c28-47e9-ae87-e10ef6dd9d4a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:50.873386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00230e68-1c28-47e9-ae87-e10ef6dd9d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:50.873840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00230e68-1c28-47e9-ae87-e10ef6dd9d4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:50.874841 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00230e68-1c28-47e9-ae87-e10ef6dd9d4a None admin] RBAC: Adding query filter params (interface=public, service_id=b4c72945d5d346cda7fdf97d4271577e, region_id=RegionOne) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:50.875393 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00230e68-1c28-47e9-ae87-e10ef6dd9d4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:50.877031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00230e68-1c28-47e9-ae87-e10ef6dd9d4a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:50.883706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 452/891] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Jun 26 02:52:50 2022] GET /identity/v3/endpoints?service_id=b4c72945d5d346cda7fdf97d4271577e&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:50.891141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1edf0e-f887-42f6-9f4a-c0e6753c99d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:50.891141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1edf0e-f887-42f6-9f4a-c0e6753c99d6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:50.891434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00230e68-1c28-47e9-ae87-e10ef6dd9d4a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-7f1edf0e-f887-42f6-9f4a-c0e6753c99d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:50.910317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:50.911314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:50.912197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:50.912197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:50.912197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:50.912197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:50.912197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 440/892] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:50.917484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1edf0e-f887-42f6-9f4a-c0e6753c99d6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:50.958085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:51.003486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00230e68-1c28-47e9-ae87-e10ef6dd9d4a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:51.020250 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1edf0e-f887-42f6-9f4a-c0e6753c99d6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:51.038321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f08259-8786-4c6d-91cd-5dc45dadd78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:51.039332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f08259-8786-4c6d-91cd-5dc45dadd78f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:51.040245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f08259-8786-4c6d-91cd-5dc45dadd78f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:51.041104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f08259-8786-4c6d-91cd-5dc45dadd78f None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:51.041974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f08259-8786-4c6d-91cd-5dc45dadd78f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:51.043692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f08259-8786-4c6d-91cd-5dc45dadd78f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:51.043977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:51.059344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 453/893] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Jun 26 02:52:50 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 02:52:51.062686 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fbf53-b5ba-4152-a0cc-ac05e887b1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:51.063420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fbf53-b5ba-4152-a0cc-ac05e887b1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:51.063704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fbf53-b5ba-4152-a0cc-ac05e887b1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:51.063987 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fbf53-b5ba-4152-a0cc-ac05e887b1d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:51.064729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fbf53-b5ba-4152-a0cc-ac05e887b1d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:51.065036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fbf53-b5ba-4152-a0cc-ac05e887b1d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:51.066454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fbf53-b5ba-4152-a0cc-ac05e887b1d6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:51.081282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 441/894] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:51.087100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f08259-8786-4c6d-91cd-5dc45dadd78f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:51.201504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f08259-8786-4c6d-91cd-5dc45dadd78f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:51.227597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:51.240089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e317c4c-5058-4596-ae1b-a1e37b5aac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:51.241389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317c4c-5058-4596-ae1b-a1e37b5aac95 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:51.241670 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317c4c-5058-4596-ae1b-a1e37b5aac95 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:51.241940 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e317c4c-5058-4596-ae1b-a1e37b5aac95 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:51.250099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e317c4c-5058-4596-ae1b-a1e37b5aac95 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:51.251662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e317c4c-5058-4596-ae1b-a1e37b5aac95 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-8e317c4c-5058-4596-ae1b-a1e37b5aac95 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:51.266132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:51.267106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:51.268286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:51.268286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:51.268286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:51.268286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:51.268286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:51.268286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:51.268286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:51.268286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:51.268286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:52:51.268286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:51.268286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 454/895] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Jun 26 02:52:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:51.276428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fbf53-b5ba-4152-a0cc-ac05e887b1d6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:51.317986 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca798979-0e36-4482-89ca-db8df2e92380 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:51.318298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca798979-0e36-4482-89ca-db8df2e92380 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:51.318549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca798979-0e36-4482-89ca-db8df2e92380 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:51.320231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 455/896] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:51.325134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3afb8f-28e0-4467-9ac9-099f9a9a512b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:51.325387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3afb8f-28e0-4467-9ac9-099f9a9a512b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:51.325671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3afb8f-28e0-4467-9ac9-099f9a9a512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:51.342655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5c3afb8f-28e0-4467-9ac9-099f9a9a512b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:51.343893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5c3afb8f-28e0-4467-9ac9-099f9a9a512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:51.398697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fbf53-b5ba-4152-a0cc-ac05e887b1d6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:51.419133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 456/897] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:51.438405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3afb8f-28e0-4467-9ac9-099f9a9a512b None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:51.439419 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7dc96-9673-4de3-89c4-02470c0eaa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:51.440305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7dc96-9673-4de3-89c4-02470c0eaa9c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:51.441061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7dc96-9673-4de3-89c4-02470c0eaa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:51.441513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7dc96-9673-4de3-89c4-02470c0eaa9c None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:51.443489 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7dc96-9673-4de3-89c4-02470c0eaa9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:51.443986 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7dc96-9673-4de3-89c4-02470c0eaa9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:51.445600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7dc96-9673-4de3-89c4-02470c0eaa9c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:51.465287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 442/898] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Jun 26 02:52:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:51.470463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7dc96-9673-4de3-89c4-02470c0eaa9c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:51.531413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:51.549545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3afb8f-28e0-4467-9ac9-099f9a9a512b None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:51.564971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:51.597915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a857bf0-6e68-4c63-9f41-f918fdaff81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:51.598590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a857bf0-6e68-4c63-9f41-f918fdaff81a None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:51.598874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a857bf0-6e68-4c63-9f41-f918fdaff81a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:51.599184 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a857bf0-6e68-4c63-9f41-f918fdaff81a None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:51.599494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7dc96-9673-4de3-89c4-02470c0eaa9c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:51.599914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a857bf0-6e68-4c63-9f41-f918fdaff81a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:51.601570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a857bf0-6e68-4c63-9f41-f918fdaff81a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:51.627188 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 457/899] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:52:51 2022] POST /identity/v3/services => generated 241 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:52:51.650046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361937-d73b-47f2-994b-51712c69e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:51.651175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361937-d73b-47f2-994b-51712c69e4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:51.651683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361937-d73b-47f2-994b-51712c69e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:51.652163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361937-d73b-47f2-994b-51712c69e4f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:51.732612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25361937-d73b-47f2-994b-51712c69e4f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:51.735084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25361937-d73b-47f2-994b-51712c69e4f0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:51.778208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:51.833408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9828f06-b8fb-4f53-bc38-23151facff89 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:51.833716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9828f06-b8fb-4f53-bc38-23151facff89 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:51.833978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9828f06-b8fb-4f53-bc38-23151facff89 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:51.836641 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 458/900] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:51.840913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b50ee-06ad-445c-acda-0721c142f6ba None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:51.841176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b50ee-06ad-445c-acda-0721c142f6ba None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:51.841458 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b50ee-06ad-445c-acda-0721c142f6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:51.858652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-849b50ee-06ad-445c-acda-0721c142f6ba None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:51.859875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-849b50ee-06ad-445c-acda-0721c142f6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:51.866495 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 443/901] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:52:51 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:52:51.874140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361937-d73b-47f2-994b-51712c69e4f0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:51.947007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 459/902] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:51.967050 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b50ee-06ad-445c-acda-0721c142f6ba None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:51.984463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361937-d73b-47f2-994b-51712c69e4f0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:52.020808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e7b86-5310-4ec0-ab6b-7c53d93a7504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:52.021978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e7b86-5310-4ec0-ab6b-7c53d93a7504 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:52.022458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e7b86-5310-4ec0-ab6b-7c53d93a7504 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:52.023011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e7b86-5310-4ec0-ab6b-7c53d93a7504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:52.026344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:52.035622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e7b86-5310-4ec0-ab6b-7c53d93a7504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:52.037171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e7b86-5310-4ec0-ab6b-7c53d93a7504 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-bf7e7b86-5310-4ec0-ab6b-7c53d93a7504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:52.058224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:52.059284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:52.060180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:52.060180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:52.060180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:52.060180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:52.065302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 444/903] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:52.066441 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e7b86-5310-4ec0-ab6b-7c53d93a7504 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:52.083881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b50ee-06ad-445c-acda-0721c142f6ba None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:52.086347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:52.125319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15433541-c496-4f1d-8c62-80a7075b0df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:52.126307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433541-c496-4f1d-8c62-80a7075b0df6 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:52.126594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433541-c496-4f1d-8c62-80a7075b0df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:52.126874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433541-c496-4f1d-8c62-80a7075b0df6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:52.127873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15433541-c496-4f1d-8c62-80a7075b0df6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:52.129268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15433541-c496-4f1d-8c62-80a7075b0df6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-15433541-c496-4f1d-8c62-80a7075b0df6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:52.145253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:52.146201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:52.152227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 460/904] 10.222.0.36 () {56 vars in 1132 bytes} [Sun Jun 26 02:52:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:52.154737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15433541-c496-4f1d-8c62-80a7075b0df6 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:52.192534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e7b86-5310-4ec0-ab6b-7c53d93a7504 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:52.233495 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac6670-8d84-48d6-970e-508455e13cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:52.235610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6670-8d84-48d6-970e-508455e13cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:52.236113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6670-8d84-48d6-970e-508455e13cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:52.236620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6670-8d84-48d6-970e-508455e13cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:52.237626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac6670-8d84-48d6-970e-508455e13cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:52.238146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac6670-8d84-48d6-970e-508455e13cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:52.240398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac6670-8d84-48d6-970e-508455e13cd5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:52.256694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 445/905] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:52.263065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac6670-8d84-48d6-970e-508455e13cd5 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:52.272040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15433541-c496-4f1d-8c62-80a7075b0df6 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:52.317379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bf9c2-5858-4ea5-ba95-f8b2b264778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:52.318195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bf9c2-5858-4ea5-ba95-f8b2b264778c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:52.318555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bf9c2-5858-4ea5-ba95-f8b2b264778c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:52.318901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bf9c2-5858-4ea5-ba95-f8b2b264778c None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:52.319718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bf9c2-5858-4ea5-ba95-f8b2b264778c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:52.320093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bf9c2-5858-4ea5-ba95-f8b2b264778c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:52.321828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bf9c2-5858-4ea5-ba95-f8b2b264778c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:52.325220 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:52.328183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 461/906] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Jun 26 02:52:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:52.333454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bf9c2-5858-4ea5-ba95-f8b2b264778c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:52.368899 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:52.391847 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac6670-8d84-48d6-970e-508455e13cd5 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:52.428719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712331-6ad1-4d1a-b123-0c6593fa26e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:52.429728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712331-6ad1-4d1a-b123-0c6593fa26e7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:52.430114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712331-6ad1-4d1a-b123-0c6593fa26e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:52.430489 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712331-6ad1-4d1a-b123-0c6593fa26e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:52.438033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68712331-6ad1-4d1a-b123-0c6593fa26e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:52.439731 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68712331-6ad1-4d1a-b123-0c6593fa26e7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:52.451829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bf9c2-5858-4ea5-ba95-f8b2b264778c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-68712331-6ad1-4d1a-b123-0c6593fa26e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:52.455352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:52.456411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:52.457506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:52.457506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:52.457506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:52.457506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:52.457506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:52.457506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:52.457506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:52.457506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:52.463850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 446/907] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:52.464909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712331-6ad1-4d1a-b123-0c6593fa26e7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:52.497576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a9192-fd0d-4b80-a474-3c8c166eeaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:52.497576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a9192-fd0d-4b80-a474-3c8c166eeaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:52.497576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a9192-fd0d-4b80-a474-3c8c166eeaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:52.497576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a9192-fd0d-4b80-a474-3c8c166eeaa7 None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:52.497976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a9192-fd0d-4b80-a474-3c8c166eeaa7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:52.498308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a9192-fd0d-4b80-a474-3c8c166eeaa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:52.499835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a9192-fd0d-4b80-a474-3c8c166eeaa7 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:52.510321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 462/908] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Jun 26 02:52:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:52.511928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a9192-fd0d-4b80-a474-3c8c166eeaa7 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:52.589320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712331-6ad1-4d1a-b123-0c6593fa26e7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:52.599493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:52.625759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:52.632596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a0b73-8201-4c7f-8d1d-e08321b91d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:52.633270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a0b73-8201-4c7f-8d1d-e08321b91d5f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:52.633553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a0b73-8201-4c7f-8d1d-e08321b91d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:52.633829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a0b73-8201-4c7f-8d1d-e08321b91d5f None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:52.634283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a9192-fd0d-4b80-a474-3c8c166eeaa7 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:52.634614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a0b73-8201-4c7f-8d1d-e08321b91d5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:52.634918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a0b73-8201-4c7f-8d1d-e08321b91d5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:52.636398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a0b73-8201-4c7f-8d1d-e08321b91d5f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:52.656404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 447/909] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:52.657469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a0b73-8201-4c7f-8d1d-e08321b91d5f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:52.676619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59055a1d-ad56-4dbd-8184-eb49e0a591fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:52.677043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055a1d-ad56-4dbd-8184-eb49e0a591fc None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:52.677328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055a1d-ad56-4dbd-8184-eb49e0a591fc None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:52.677599 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055a1d-ad56-4dbd-8184-eb49e0a591fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:52.678546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59055a1d-ad56-4dbd-8184-eb49e0a591fc None admin] RBAC: Adding query filter params (interface=public, service_id=ce7b0919b5c44d3da4e38be1c5c2ee53, region_id=RegionOne) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:52.678963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59055a1d-ad56-4dbd-8184-eb49e0a591fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:52.680537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59055a1d-ad56-4dbd-8184-eb49e0a591fc None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:52.691056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 463/910] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Jun 26 02:52:52 2022] GET /identity/v3/endpoints?service_id=ce7b0919b5c44d3da4e38be1c5c2ee53&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:52.693030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59055a1d-ad56-4dbd-8184-eb49e0a591fc None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:52.780635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a0b73-8201-4c7f-8d1d-e08321b91d5f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:52.816743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0d2e-1b6a-4529-beca-0c44c6fa65d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:52.816985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59055a1d-ad56-4dbd-8184-eb49e0a591fc None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:52.817905 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0d2e-1b6a-4529-beca-0c44c6fa65d0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:52.818393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0d2e-1b6a-4529-beca-0c44c6fa65d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:52.818887 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0d2e-1b6a-4529-beca-0c44c6fa65d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:52.820055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a0d2e-1b6a-4529-beca-0c44c6fa65d0 None admin] RBAC: Adding query filter params (role.id=e8e8025982464049a613a57d9e11f8be, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=d78da06180d0420f82074fa5e3cbc71e) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:52.820598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a0d2e-1b6a-4529-beca-0c44c6fa65d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:52.822297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a0d2e-1b6a-4529-beca-0c44c6fa65d0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:52.835303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 448/911] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:52:52 2022] GET /identity/v3/role_assignments?user.id=d78da06180d0420f82074fa5e3cbc71e&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=e8e8025982464049a613a57d9e11f8be => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:52.859720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6c4ce-69ce-4110-ac27-fe570c4a6a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:52.860411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6c4ce-69ce-4110-ac27-fe570c4a6a2b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:52.860691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6c4ce-69ce-4110-ac27-fe570c4a6a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:52.860975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6c4ce-69ce-4110-ac27-fe570c4a6a2b None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:52.861679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6c4ce-69ce-4110-ac27-fe570c4a6a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:52.863118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6c4ce-69ce-4110-ac27-fe570c4a6a2b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:52.875163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 464/912] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Jun 26 02:52:52 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 02:52:53.153863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b3560-f8dc-4e58-9544-8fb498d3bc30 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:53.154041 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b3560-f8dc-4e58-9544-8fb498d3bc30 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:53.154334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b3560-f8dc-4e58-9544-8fb498d3bc30 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:53.156003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 449/913] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:53.161346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bddeb-01db-4cba-8a44-0e2583e7b2f2 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:53.161788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bddeb-01db-4cba-8a44-0e2583e7b2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:53.161973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bddeb-01db-4cba-8a44-0e2583e7b2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:53.178935 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8e3bddeb-01db-4cba-8a44-0e2583e7b2f2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:53.180138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8e3bddeb-01db-4cba-8a44-0e2583e7b2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:53.198524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:53.252898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 465/914] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:53.275405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b3560-f8dc-4e58-9544-8fb498d3bc30 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:53.307850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:53.381988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b3560-f8dc-4e58-9544-8fb498d3bc30 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:53.417370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c58743-824b-4949-9d77-19f7845c7db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:53.418138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c58743-824b-4949-9d77-19f7845c7db2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:53.418427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c58743-824b-4949-9d77-19f7845c7db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:53.418709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c58743-824b-4949-9d77-19f7845c7db2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:53.419404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c58743-824b-4949-9d77-19f7845c7db2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:53.420850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c58743-824b-4949-9d77-19f7845c7db2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-79c58743-824b-4949-9d77-19f7845c7db2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:53.432973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:53.434001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:53.434834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 450/915] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:53.440222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bddeb-01db-4cba-8a44-0e2583e7b2f2 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:53.556191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bddeb-01db-4cba-8a44-0e2583e7b2f2 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:53.590479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b83db-f582-40bf-87c5-4c64dcdec01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:53.591182 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b83db-f582-40bf-87c5-4c64dcdec01a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:53.591465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b83db-f582-40bf-87c5-4c64dcdec01a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:53.591750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b83db-f582-40bf-87c5-4c64dcdec01a None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:53.592459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b83db-f582-40bf-87c5-4c64dcdec01a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:53.592763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b83db-f582-40bf-87c5-4c64dcdec01a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:53.594162 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b83db-f582-40bf-87c5-4c64dcdec01a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:53.599551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 466/916] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:53.604850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c58743-824b-4949-9d77-19f7845c7db2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:53.696966 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:53.703080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c58743-824b-4949-9d77-19f7845c7db2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:53.736281 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8295a-973a-4c8b-a43c-e6567cf7342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:53.736947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8295a-973a-4c8b-a43c-e6567cf7342a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:53.737223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8295a-973a-4c8b-a43c-e6567cf7342a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:53.737499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8295a-973a-4c8b-a43c-e6567cf7342a None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:53.738258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8295a-973a-4c8b-a43c-e6567cf7342a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:53.738563 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8295a-973a-4c8b-a43c-e6567cf7342a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:53.739961 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8295a-973a-4c8b-a43c-e6567cf7342a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:53.745148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 451/917] 10.222.0.36 () {56 vars in 1114 bytes} [Sun Jun 26 02:52:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:53.750839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b83db-f582-40bf-87c5-4c64dcdec01a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:53.773712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:53.852752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b83db-f582-40bf-87c5-4c64dcdec01a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:53.860522 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac6b2-8193-42ec-b4c4-cc6547caae11 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:53.861028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac6b2-8193-42ec-b4c4-cc6547caae11 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:53.861143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac6b2-8193-42ec-b4c4-cc6547caae11 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:53.862564 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 452/918] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:53.868831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32090-d413-484c-9859-8b181565ff10 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:53.869119 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32090-d413-484c-9859-8b181565ff10 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:53.869402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32090-d413-484c-9859-8b181565ff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:53.890108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-aed32090-d413-484c-9859-8b181565ff10 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:53.893173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-aed32090-d413-484c-9859-8b181565ff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:53.893755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca51f2-901a-4f26-ad22-04731b98311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:53.894626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca51f2-901a-4f26-ad22-04731b98311d None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:53.895200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca51f2-901a-4f26-ad22-04731b98311d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:53.895672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca51f2-901a-4f26-ad22-04731b98311d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:53.896656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca51f2-901a-4f26-ad22-04731b98311d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:53.898208 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca51f2-901a-4f26-ad22-04731b98311d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:53.924310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 467/919] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Jun 26 02:52:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:53.982238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 453/920] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:54.001531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca51f2-901a-4f26-ad22-04731b98311d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:54.087170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:54.121004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca51f2-901a-4f26-ad22-04731b98311d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:54.155257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b8ccc-2feb-47a3-910c-f3588aa45f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:54.156074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b8ccc-2feb-47a3-910c-f3588aa45f74 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:54.156354 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b8ccc-2feb-47a3-910c-f3588aa45f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:54.156630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b8ccc-2feb-47a3-910c-f3588aa45f74 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:54.157287 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b8ccc-2feb-47a3-910c-f3588aa45f74 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:54.158676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b8ccc-2feb-47a3-910c-f3588aa45f74 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-429b8ccc-2feb-47a3-910c-f3588aa45f74 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:54.171521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:54.172962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:52:54.173838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:54.174577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 468/921] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Jun 26 02:52:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:54.179188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed32090-d413-484c-9859-8b181565ff10 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:54.267735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:54.284716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed32090-d413-484c-9859-8b181565ff10 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:54.323721 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa94c8-f49c-4389-8158-96415cc99cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:54.324430 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa94c8-f49c-4389-8158-96415cc99cdb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:54.324714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa94c8-f49c-4389-8158-96415cc99cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:54.324990 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa94c8-f49c-4389-8158-96415cc99cdb None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:54.325705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa94c8-f49c-4389-8158-96415cc99cdb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:54.326020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa94c8-f49c-4389-8158-96415cc99cdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:54.327416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa94c8-f49c-4389-8158-96415cc99cdb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:54.337021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 454/922] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Jun 26 02:52:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:54.338392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b8ccc-2feb-47a3-910c-f3588aa45f74 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:54.439336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b8ccc-2feb-47a3-910c-f3588aa45f74 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:54.472866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f0daa-415e-4ada-89f6-3ffeefe56efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:54.473540 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f0daa-415e-4ada-89f6-3ffeefe56efa None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:54.473818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f0daa-415e-4ada-89f6-3ffeefe56efa None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:54.474088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f0daa-415e-4ada-89f6-3ffeefe56efa None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:54.474789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f0daa-415e-4ada-89f6-3ffeefe56efa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:54.475126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f0daa-415e-4ada-89f6-3ffeefe56efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:54.476492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f0daa-415e-4ada-89f6-3ffeefe56efa None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:54.481980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 469/923] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Jun 26 02:52:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:54.487822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa94c8-f49c-4389-8158-96415cc99cdb None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:54.590702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa94c8-f49c-4389-8158-96415cc99cdb None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:54.624970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477a886-a7c2-4892-a358-2706964d9ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:54.625643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a886-a7c2-4892-a358-2706964d9ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:54.625926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a886-a7c2-4892-a358-2706964d9ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:54.626201 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a886-a7c2-4892-a358-2706964d9ad0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:54.627012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477a886-a7c2-4892-a358-2706964d9ad0 None admin] RBAC: Adding query filter params (interface=public, service_id=744ef548cbe6464abef37a70f59709af, region_id=RegionOne) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:54.627329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477a886-a7c2-4892-a358-2706964d9ad0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:54.628702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477a886-a7c2-4892-a358-2706964d9ad0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:54.638894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 455/924] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Jun 26 02:52:54 2022] GET /identity/v3/endpoints?service_id=744ef548cbe6464abef37a70f59709af&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:54.640346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f0daa-415e-4ada-89f6-3ffeefe56efa None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:54.645629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:54.748619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f0daa-415e-4ada-89f6-3ffeefe56efa None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:54.781893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc3c1b-7e7b-4e44-b438-ba8d1a4b96cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:54.782559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc3c1b-7e7b-4e44-b438-ba8d1a4b96cc None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:54.782836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc3c1b-7e7b-4e44-b438-ba8d1a4b96cc None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:54.783135 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc3c1b-7e7b-4e44-b438-ba8d1a4b96cc None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:54.783810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc3c1b-7e7b-4e44-b438-ba8d1a4b96cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:54.785185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc3c1b-7e7b-4e44-b438-ba8d1a4b96cc None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:54.792012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 470/925] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Jun 26 02:52:54 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 02:52:54.943961 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda0c4c-9971-4b1e-a3f7-ee6375c4dfcb None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:54.944483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda0c4c-9971-4b1e-a3f7-ee6375c4dfcb None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:54.944483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda0c4c-9971-4b1e-a3f7-ee6375c4dfcb None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:54.946085 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 456/926] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:54.951505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be5f6b-3072-4152-99fa-2d670db6392f None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:54.951789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be5f6b-3072-4152-99fa-2d670db6392f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:54.952061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be5f6b-3072-4152-99fa-2d670db6392f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:54.969146 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f7be5f6b-3072-4152-99fa-2d670db6392f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:54.970325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f7be5f6b-3072-4152-99fa-2d670db6392f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:54.970435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665d5c1-8404-442c-8dc6-c75788ab81c3 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:54.970615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665d5c1-8404-442c-8dc6-c75788ab81c3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:54.970895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665d5c1-8404-442c-8dc6-c75788ab81c3 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:54.972711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 457/927] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:54.977797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920f9b7-88d5-4b3d-b980-ee1d11b4c254 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:54.978084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920f9b7-88d5-4b3d-b980-ee1d11b4c254 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:54.978368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920f9b7-88d5-4b3d-b980-ee1d11b4c254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:54.995437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-d920f9b7-88d5-4b3d-b980-ee1d11b4c254 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:54.996694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d920f9b7-88d5-4b3d-b980-ee1d11b4c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:55.006442 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:55.037932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:55.047316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 471/928] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:55.069549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 458/929] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:55.070580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be5f6b-3072-4152-99fa-2d670db6392f None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:55.093048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920f9b7-88d5-4b3d-b980-ee1d11b4c254 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:55.198030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be5f6b-3072-4152-99fa-2d670db6392f None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:55.201058 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920f9b7-88d5-4b3d-b980-ee1d11b4c254 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:55.239008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b44caf-6592-465e-a195-3a775721daf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:55.239851 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44caf-6592-465e-a195-3a775721daf9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:55.240131 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44caf-6592-465e-a195-3a775721daf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:55.240410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44caf-6592-465e-a195-3a775721daf9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:55.243476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c643ef-5c50-43c5-bbe0-620e0f50aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:55.244740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c643ef-5c50-43c5-bbe0-620e0f50aa9e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:55.245030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c643ef-5c50-43c5-bbe0-620e0f50aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:55.245311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c643ef-5c50-43c5-bbe0-620e0f50aa9e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:55.245980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c643ef-5c50-43c5-bbe0-620e0f50aa9e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:55.248535 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c643ef-5c50-43c5-bbe0-620e0f50aa9e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:55.253222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b44caf-6592-465e-a195-3a775721daf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-f6b44caf-6592-465e-a195-3a775721daf9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:55.261509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:55.262515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:52:55.263398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-06c643ef-5c50-43c5-bbe0-620e0f50aa9e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:55.264028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:55.264864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:55.265696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 472/931] 10.222.0.36 () {56 vars in 1132 bytes} [Sun Jun 26 02:52:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:55.271357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 459/931] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Jun 26 02:52:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:55.271581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c643ef-5c50-43c5-bbe0-620e0f50aa9e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:55.272693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b44caf-6592-465e-a195-3a775721daf9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:55.277487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:55.349912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:55.381605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b44caf-6592-465e-a195-3a775721daf9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:55.403750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c643ef-5c50-43c5-bbe0-620e0f50aa9e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:55.419314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd046a-425c-405e-a381-eddf38493b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:55.420351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd046a-425c-405e-a381-eddf38493b2c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:55.420973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd046a-425c-405e-a381-eddf38493b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:55.421453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd046a-425c-405e-a381-eddf38493b2c None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:55.422411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd046a-425c-405e-a381-eddf38493b2c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:55.422934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd046a-425c-405e-a381-eddf38493b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:55.424746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd046a-425c-405e-a381-eddf38493b2c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:55.434743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 460/932] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Jun 26 02:52:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:55.435928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd046a-425c-405e-a381-eddf38493b2c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:55.443085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc717317-2c87-4884-bdf8-3bcdcf3d35b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:55.443762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717317-2c87-4884-bdf8-3bcdcf3d35b2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:55.444051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717317-2c87-4884-bdf8-3bcdcf3d35b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:55.444330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717317-2c87-4884-bdf8-3bcdcf3d35b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:55.445082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc717317-2c87-4884-bdf8-3bcdcf3d35b2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:55.445388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc717317-2c87-4884-bdf8-3bcdcf3d35b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:55.446773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc717317-2c87-4884-bdf8-3bcdcf3d35b2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:55.458137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 473/933] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Jun 26 02:52:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:55.463834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc717317-2c87-4884-bdf8-3bcdcf3d35b2 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:55.518734 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:55.559012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd046a-425c-405e-a381-eddf38493b2c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:55.596247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339ea32-ccff-47f3-8b76-d155a176af9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:55.597012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339ea32-ccff-47f3-8b76-d155a176af9a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:55.597307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339ea32-ccff-47f3-8b76-d155a176af9a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:55.597589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339ea32-ccff-47f3-8b76-d155a176af9a None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:55.598523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339ea32-ccff-47f3-8b76-d155a176af9a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:55.598711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339ea32-ccff-47f3-8b76-d155a176af9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:55.600137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339ea32-ccff-47f3-8b76-d155a176af9a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:55.605615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc717317-2c87-4884-bdf8-3bcdcf3d35b2 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:55.610416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 461/934] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Jun 26 02:52:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:55.611383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339ea32-ccff-47f3-8b76-d155a176af9a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:55.633509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:55.647491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dcc7b-954d-4414-ac05-7a9d0834ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:55.648616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dcc7b-954d-4414-ac05-7a9d0834ed8a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:55.649045 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dcc7b-954d-4414-ac05-7a9d0834ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:55.649557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dcc7b-954d-4414-ac05-7a9d0834ed8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:55.661003 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dcc7b-954d-4414-ac05-7a9d0834ed8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:55.662697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dcc7b-954d-4414-ac05-7a9d0834ed8a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-2e2dcc7b-954d-4414-ac05-7a9d0834ed8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:55.680601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:55.681524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:55.682516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:55.682516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:55.682516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:55.682516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:55.685167 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 474/935] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:55.692179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dcc7b-954d-4414-ac05-7a9d0834ed8a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:55.727820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339ea32-ccff-47f3-8b76-d155a176af9a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:55.758607 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:55.766102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1004b-1f11-411f-abb5-d3dceb73fba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:55.767192 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1004b-1f11-411f-abb5-d3dceb73fba1 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:55.767678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1004b-1f11-411f-abb5-d3dceb73fba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:55.768152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1004b-1f11-411f-abb5-d3dceb73fba1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:55.769097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1004b-1f11-411f-abb5-d3dceb73fba1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:55.770894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1004b-1f11-411f-abb5-d3dceb73fba1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:55.803248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 462/936] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Jun 26 02:52:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:55.815784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dcc7b-954d-4414-ac05-7a9d0834ed8a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:55.860137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2ffe0-b234-41cd-955c-890b37621870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:55.860809 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ffe0-b234-41cd-955c-890b37621870 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:55.861083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ffe0-b234-41cd-955c-890b37621870 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:55.861357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2ffe0-b234-41cd-955c-890b37621870 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:55.862086 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2ffe0-b234-41cd-955c-890b37621870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:55.862388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2ffe0-b234-41cd-955c-890b37621870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:55.863899 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2ffe0-b234-41cd-955c-890b37621870 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:55.878339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 475/937] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:55.884071 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1004b-1f11-411f-abb5-d3dceb73fba1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:55.998063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1004b-1f11-411f-abb5-d3dceb73fba1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:56.032415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a531-cac1-4617-8c51-0fc863eca3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:56.033182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a531-cac1-4617-8c51-0fc863eca3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.033501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a531-cac1-4617-8c51-0fc863eca3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.033777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a531-cac1-4617-8c51-0fc863eca3f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.042053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47a531-cac1-4617-8c51-0fc863eca3f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:56.043627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47a531-cac1-4617-8c51-0fc863eca3f8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-6b47a531-cac1-4617-8c51-0fc863eca3f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:56.059000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:56.059982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:56.060915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:56.060915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:56.060915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:56.060915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:56.060915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:56.060915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:56.060915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:56.060915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:56.060915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:52:56.060915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:56.060915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 463/938] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Jun 26 02:52:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:56.066444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2ffe0-b234-41cd-955c-890b37621870 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:56.086713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15db0b-db4a-43b6-8dd7-e40d2bd9b644 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.087058 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15db0b-db4a-43b6-8dd7-e40d2bd9b644 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.087316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15db0b-db4a-43b6-8dd7-e40d2bd9b644 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.088952 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 464/939] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:56.093859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2110f4-897c-43a3-b89a-2891f96d94db None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.094151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2110f4-897c-43a3-b89a-2891f96d94db None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.094428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2110f4-897c-43a3-b89a-2891f96d94db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.098591 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:56.115455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-dc2110f4-897c-43a3-b89a-2891f96d94db None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:56.116908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-dc2110f4-897c-43a3-b89a-2891f96d94db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:56.171929 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2ffe0-b234-41cd-955c-890b37621870 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:56.176204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:56.209160 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 465/940] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:56.217933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a72104-7113-4d61-89ac-abff2a9698b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:56.218609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72104-7113-4d61-89ac-abff2a9698b6 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.218888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72104-7113-4d61-89ac-abff2a9698b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.219200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72104-7113-4d61-89ac-abff2a9698b6 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.220037 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a72104-7113-4d61-89ac-abff2a9698b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:56.220341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a72104-7113-4d61-89ac-abff2a9698b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:56.221771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a72104-7113-4d61-89ac-abff2a9698b6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:56.236012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2110f4-897c-43a3-b89a-2891f96d94db None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:56.245558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 476/941] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Jun 26 02:52:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:56.254234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a72104-7113-4d61-89ac-abff2a9698b6 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:56.355128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2110f4-897c-43a3-b89a-2891f96d94db None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:56.372635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:56.390606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a72104-7113-4d61-89ac-abff2a9698b6 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:56.392916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491d59c-c332-4782-b945-e4355bf7711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:56.393594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d59c-c332-4782-b945-e4355bf7711e None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.393881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d59c-c332-4782-b945-e4355bf7711e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.394978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d59c-c332-4782-b945-e4355bf7711e None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.394978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491d59c-c332-4782-b945-e4355bf7711e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:56.396414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491d59c-c332-4782-b945-e4355bf7711e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:56.397801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: WARNING keystone.server.flask.common [None req-f491d59c-c332-4782-b945-e4355bf7711e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 26 02:52:56.417294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.sql.core [None req-f491d59c-c332-4782-b945-e4355bf7711e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 26 02:52:56.417294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 26 02:52:56.417294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [parameters: {'id': '7524ad44e1d542bfa32ad8d2beaed7aa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 26 02:52:56.417294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80128) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-f491d59c-c332-4782-b945-e4355bf7711e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7524ad44e1d542bfa32ad8d2beaed7aa.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7524ad44e1d542bfa32ad8d2beaed7aa. Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application result = self._query(query) Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application conn.query(q) Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 26 02:52:56.425601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application result.read() Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 26 02:52:56.426417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application next(self.gen) Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application yield resource Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application next(self.gen) Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self.session.rollback() Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self.force_reraise() Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise self.value Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application session.commit() Jun 26 02:52:56.431675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._prepare_impl() Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self.session.flush() Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._flush(objects) Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application compat.raise_( Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application flush_context.execute() Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 26 02:52:56.432576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rec.execute(self) Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 26 02:52:56.433504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application result = self._query(query) Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application conn.query(q) Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application result.read() Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 26 02:52:56.434422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [parameters: {'id': '7524ad44e1d542bfa32ad8d2beaed7aa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:56.435368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:56.436222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:56.437345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:56.437345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 26 02:52:56.437345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 26 02:52:56.437345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:56.437345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:56.437345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 26 02:52:56.437345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 26 02:52:56.437345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7524ad44e1d542bfa32ad8d2beaed7aa. Jun 26 02:52:56.437345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:56.437345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 466/942] 10.222.0.36 () {60 vars in 1140 bytes} [Sun Jun 26 02:52:56 2022] POST /identity/v3/projects => generated 262 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:56.439169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491d59c-c332-4782-b945-e4355bf7711e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:56.444223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb96cf-cb51-4ee6-b8b3-6b4e6ffb2db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:56.444745 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb96cf-cb51-4ee6-b8b3-6b4e6ffb2db1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.445094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb96cf-cb51-4ee6-b8b3-6b4e6ffb2db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.445455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb96cf-cb51-4ee6-b8b3-6b4e6ffb2db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.457433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb96cf-cb51-4ee6-b8b3-6b4e6ffb2db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:56.459070 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb96cf-cb51-4ee6-b8b3-6b4e6ffb2db1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:56.476115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-1deb96cf-cb51-4ee6-b8b3-6b4e6ffb2db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:52:56.479344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:56.480214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:56.481154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:52:56.481154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:52:56.481154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:52:56.481154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:56.486159 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 477/943] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:56.487084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb96cf-cb51-4ee6-b8b3-6b4e6ffb2db1 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:56.553425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491d59c-c332-4782-b945-e4355bf7711e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:56.587741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c3371-26be-4b99-8a84-e1a53745085a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:56.588880 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c3371-26be-4b99-8a84-e1a53745085a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.589352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c3371-26be-4b99-8a84-e1a53745085a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.589875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c3371-26be-4b99-8a84-e1a53745085a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.597139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c3371-26be-4b99-8a84-e1a53745085a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:56.599069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c3371-26be-4b99-8a84-e1a53745085a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:56.600722 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb96cf-cb51-4ee6-b8b3-6b4e6ffb2db1 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-ee3c3371-26be-4b99-8a84-e1a53745085a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:56.613894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:56.614815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:56.615753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:56.615753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:56.615753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:56.615753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:56.615753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:56.615753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:56.615753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:56.615753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:56.618383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 467/944] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:56.623811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c3371-26be-4b99-8a84-e1a53745085a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:56.643535 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7c1f7-233a-4920-a891-7bfb3ee355ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:56.644292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7c1f7-233a-4920-a891-7bfb3ee355ec None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.644643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7c1f7-233a-4920-a891-7bfb3ee355ec None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.644991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7c1f7-233a-4920-a891-7bfb3ee355ec None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.645789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7c1f7-233a-4920-a891-7bfb3ee355ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:56.646165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7c1f7-233a-4920-a891-7bfb3ee355ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:56.647832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7c1f7-233a-4920-a891-7bfb3ee355ec None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:56.657119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:56.667439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 478/945] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:56.668680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7c1f7-233a-4920-a891-7bfb3ee355ec None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:56.722538 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:56.729532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c3371-26be-4b99-8a84-e1a53745085a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:56.765377 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413afb-f8a4-42e6-bcff-0b83850eb9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:56.766236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413afb-f8a4-42e6-bcff-0b83850eb9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.766956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413afb-f8a4-42e6-bcff-0b83850eb9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.766956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413afb-f8a4-42e6-bcff-0b83850eb9e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.767946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413afb-f8a4-42e6-bcff-0b83850eb9e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:56.768398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413afb-f8a4-42e6-bcff-0b83850eb9e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:56.769814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413afb-f8a4-42e6-bcff-0b83850eb9e4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:56.780019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7c1f7-233a-4920-a891-7bfb3ee355ec None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:56.796143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 468/946] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:52:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:56.821428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2b944-62df-4c46-b67a-39738ead6bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:56.822219 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2b944-62df-4c46-b67a-39738ead6bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.822493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2b944-62df-4c46-b67a-39738ead6bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.822766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2b944-62df-4c46-b67a-39738ead6bf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.830909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2b944-62df-4c46-b67a-39738ead6bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:56.832495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2b944-62df-4c46-b67a-39738ead6bf0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-62a2b944-62df-4c46-b67a-39738ead6bf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:52:56.848174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:56.849144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:56.850024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:52:56.850024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:52:56.850024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:52:56.850024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:52:56.850024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:52:56.850024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:52:56.850024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:52:56.850024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:56.850024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 479/947] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:56.857050 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413afb-f8a4-42e6-bcff-0b83850eb9e4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:56.904175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f8a39-8c11-40d3-a33a-79e72bfd703b None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.904544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f8a39-8c11-40d3-a33a-79e72bfd703b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.904717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f8a39-8c11-40d3-a33a-79e72bfd703b None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.907027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 480/948] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:52:56.913355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3de88-e11c-4678-99b4-fce5e142f3ea None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:56.913680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3de88-e11c-4678-99b4-fce5e142f3ea None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:56.913869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3de88-e11c-4678-99b4-fce5e142f3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:56.935959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-46f3de88-e11c-4678-99b4-fce5e142f3ea None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:56.937186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-46f3de88-e11c-4678-99b4-fce5e142f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:56.986927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413afb-f8a4-42e6-bcff-0b83850eb9e4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:57.020539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:57.035808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234607b0-01c8-408e-9c38-81580fffa0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:57.036397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 481/949] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:57.037308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234607b0-01c8-408e-9c38-81580fffa0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:57.037599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234607b0-01c8-408e-9c38-81580fffa0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:57.037880 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234607b0-01c8-408e-9c38-81580fffa0c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:57.038717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234607b0-01c8-408e-9c38-81580fffa0c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:57.039193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234607b0-01c8-408e-9c38-81580fffa0c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:57.040914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234607b0-01c8-408e-9c38-81580fffa0c7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:57.054462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 469/950] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:52:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:57.060290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3de88-e11c-4678-99b4-fce5e142f3ea None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:57.061315 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234607b0-01c8-408e-9c38-81580fffa0c7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:57.082107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:57.171585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3de88-e11c-4678-99b4-fce5e142f3ea None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:57.187274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234607b0-01c8-408e-9c38-81580fffa0c7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:57.212753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb8c50-1ee7-47f3-a790-15a90a1361f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:57.213765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb8c50-1ee7-47f3-a790-15a90a1361f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:57.214110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb8c50-1ee7-47f3-a790-15a90a1361f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:57.214452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb8c50-1ee7-47f3-a790-15a90a1361f8 None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/d78da06180d0420f82074fa5e3cbc71e/roles/e8e8025982464049a613a57d9e11f8be` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:57.216833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb8c50-1ee7-47f3-a790-15a90a1361f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=d78da06180d0420f82074fa5e3cbc71e, role_id=e8e8025982464049a613a57d9e11f8be)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:57.218354 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb8c50-1ee7-47f3-a790-15a90a1361f8 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:57.225185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8bb1a-903a-4e0b-9b7b-c1224ff1d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:57.226315 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bb1a-903a-4e0b-9b7b-c1224ff1d1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:57.226863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bb1a-903a-4e0b-9b7b-c1224ff1d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:57.227330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bb1a-903a-4e0b-9b7b-c1224ff1d1a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:57.228361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8bb1a-903a-4e0b-9b7b-c1224ff1d1a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:57.230306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8bb1a-903a-4e0b-9b7b-c1224ff1d1a9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:57.233888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 482/951] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:52:57 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/d78da06180d0420f82074fa5e3cbc71e/roles/e8e8025982464049a613a57d9e11f8be => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-00d8bb1a-903a-4e0b-9b7b-c1224ff1d1a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:57.245406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:57.246635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:52:57.247509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:57.250328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 470/952] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Jun 26 02:52:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:57.256550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb8c50-1ee7-47f3-a790-15a90a1361f8 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:57.318953 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:57.390358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb8c50-1ee7-47f3-a790-15a90a1361f8 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:57.428629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c008-8af1-447a-ba24-966c089af53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:57.429556 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c008-8af1-447a-ba24-966c089af53e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:57.429979 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c008-8af1-447a-ba24-966c089af53e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:57.430393 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c008-8af1-447a-ba24-966c089af53e None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:57.431276 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c008-8af1-447a-ba24-966c089af53e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:57.431744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c008-8af1-447a-ba24-966c089af53e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:57.433264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c008-8af1-447a-ba24-966c089af53e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:57.439156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 483/953] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Jun 26 02:52:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:57.444773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8bb1a-903a-4e0b-9b7b-c1224ff1d1a9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:57.534193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:57.556786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8bb1a-903a-4e0b-9b7b-c1224ff1d1a9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:57.590644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f2374-b2d0-424f-8808-846a0f7d0ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:57.591352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f2374-b2d0-424f-8808-846a0f7d0ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:57.591630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f2374-b2d0-424f-8808-846a0f7d0ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:57.591903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f2374-b2d0-424f-8808-846a0f7d0ab6 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:57.592612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f2374-b2d0-424f-8808-846a0f7d0ab6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:57.592920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f2374-b2d0-424f-8808-846a0f7d0ab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:57.594299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f2374-b2d0-424f-8808-846a0f7d0ab6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:57.600122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 471/954] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Jun 26 02:52:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:52:57.605873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c008-8af1-447a-ba24-966c089af53e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:57.717345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c008-8af1-447a-ba24-966c089af53e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:57.731675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:57.757025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc05006-3551-420e-8f41-ffe6e9886ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:57.757688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05006-3551-420e-8f41-ffe6e9886ed2 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:57.757966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05006-3551-420e-8f41-ffe6e9886ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:57.758238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05006-3551-420e-8f41-ffe6e9886ed2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:57.758977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc05006-3551-420e-8f41-ffe6e9886ed2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:57.760432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc05006-3551-420e-8f41-ffe6e9886ed2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:57.780384 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 484/955] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Jun 26 02:52:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:52:58.003949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f529f3-7481-499a-85b5-c431b059513c None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:58.004722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f529f3-7481-499a-85b5-c431b059513c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:58.005224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f529f3-7481-499a-85b5-c431b059513c None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:58.007096 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 472/956] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:58.012618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e400e-ffc4-43e7-ae19-01960b2a6813 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:58.013196 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e400e-ffc4-43e7-ae19-01960b2a6813 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:58.013688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e400e-ffc4-43e7-ae19-01960b2a6813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:58.031377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-513e400e-ffc4-43e7-ae19-01960b2a6813 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:58.032909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-513e400e-ffc4-43e7-ae19-01960b2a6813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:58.111124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 485/957] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:58.134151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f529f3-7481-499a-85b5-c431b059513c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:58.242612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f529f3-7481-499a-85b5-c431b059513c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:58.276679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6f0ae-4089-4cbf-8d96-e4518111e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:58.277515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6f0ae-4089-4cbf-8d96-e4518111e4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:58.277802 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6f0ae-4089-4cbf-8d96-e4518111e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:58.278074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6f0ae-4089-4cbf-8d96-e4518111e4b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:58.278765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6f0ae-4089-4cbf-8d96-e4518111e4b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:58.280186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6f0ae-4089-4cbf-8d96-e4518111e4b3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-18a6f0ae-4089-4cbf-8d96-e4518111e4b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:58.292617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:58.293797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:58.294718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 473/958] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:52:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:58.302293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e400e-ffc4-43e7-ae19-01960b2a6813 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:58.400498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:58.405948 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e400e-ffc4-43e7-ae19-01960b2a6813 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:58.447803 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9334b3-006c-40f9-8d09-6abdff1a3eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:58.448476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9334b3-006c-40f9-8d09-6abdff1a3eef None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:58.448754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9334b3-006c-40f9-8d09-6abdff1a3eef None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:58.449027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9334b3-006c-40f9-8d09-6abdff1a3eef None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:58.449850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9334b3-006c-40f9-8d09-6abdff1a3eef None admin] RBAC: Adding query filter params (name=compute) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:58.450149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9334b3-006c-40f9-8d09-6abdff1a3eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:58.451562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9334b3-006c-40f9-8d09-6abdff1a3eef None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:58.456794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 486/959] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:52:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:58.462542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6f0ae-4089-4cbf-8d96-e4518111e4b3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:58.472483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:58.575944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6f0ae-4089-4cbf-8d96-e4518111e4b3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:58.609848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e7449-e2a3-40b0-94b2-cd2756683a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:58.610507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e7449-e2a3-40b0-94b2-cd2756683a98 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:58.610787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e7449-e2a3-40b0-94b2-cd2756683a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:58.611100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e7449-e2a3-40b0-94b2-cd2756683a98 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:58.611800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e7449-e2a3-40b0-94b2-cd2756683a98 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:58.612104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e7449-e2a3-40b0-94b2-cd2756683a98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:58.613472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e7449-e2a3-40b0-94b2-cd2756683a98 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:58.618422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 474/960] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:52:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:59.010099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc36af-6aae-4e52-8dee-96b8003539e2 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:59.010292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc36af-6aae-4e52-8dee-96b8003539e2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:59.010559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc36af-6aae-4e52-8dee-96b8003539e2 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:59.012447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 487/961] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:59.018025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa516e9-56ff-4ad5-9556-cbad77515e31 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:59.018524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa516e9-56ff-4ad5-9556-cbad77515e31 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:59.018961 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa516e9-56ff-4ad5-9556-cbad77515e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:59.037628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-6aa516e9-56ff-4ad5-9556-cbad77515e31 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:59.039771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6aa516e9-56ff-4ad5-9556-cbad77515e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:59.106764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:59.112488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 475/962] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:59.138120 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc36af-6aae-4e52-8dee-96b8003539e2 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:59.239929 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc36af-6aae-4e52-8dee-96b8003539e2 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:59.274954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e12113-f8da-4768-9564-fd1021f99d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:59.275675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e12113-f8da-4768-9564-fd1021f99d61 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:59.275959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e12113-f8da-4768-9564-fd1021f99d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:59.276237 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e12113-f8da-4768-9564-fd1021f99d61 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:59.276960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e12113-f8da-4768-9564-fd1021f99d61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:59.278461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e12113-f8da-4768-9564-fd1021f99d61 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:59.279817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: WARNING keystone.server.flask.common [None req-c6e12113-f8da-4768-9564-fd1021f99d61 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 26 02:52:59.294606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.sql.core [None req-c6e12113-f8da-4768-9564-fd1021f99d61 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 26 02:52:59.294606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 26 02:52:59.294606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [parameters: {'user_id': 'ea035f604b8642249c20cb33038db2bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 26 02:52:59.294606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80129) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-c6e12113-f8da-4768-9564-fd1021f99d61 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application result = self._query(query) Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application conn.query(q) Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application result.read() Jun 26 02:52:59.312786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 26 02:52:59.314492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application next(self.gen) Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application yield resource Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application next(self.gen) Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self.session.rollback() Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self.force_reraise() Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise self.value Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application session.commit() Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 26 02:52:59.315516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._prepare_impl() Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self.session.flush() Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._flush(objects) Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application compat.raise_( Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application flush_context.execute() Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rec.execute(self) Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 26 02:52:59.316428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 26 02:52:59.317360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application result = self._query(query) Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application conn.query(q) Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application result.read() Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 26 02:52:59.319920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ea035f604b8642249c20cb33038db2bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:59.321869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 26 02:52:59.325268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 26 02:52:59.327451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 26 02:52:59.327451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 26 02:52:59.327451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 26 02:52:59.327451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 26 02:52:59.327451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 26 02:52:59.327451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:59.327451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 488/963] 10.222.0.36 () {60 vars in 1131 bytes} [Sun Jun 26 02:52:59 2022] POST /identity/v3/users => generated 160 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:59.328343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa516e9-56ff-4ad5-9556-cbad77515e31 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:59.424264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa516e9-56ff-4ad5-9556-cbad77515e31 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:59.459352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fb388-6fbf-47d5-abc9-b9d524de54d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:59.460556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fb388-6fbf-47d5-abc9-b9d524de54d6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:59.461046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fb388-6fbf-47d5-abc9-b9d524de54d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:59.461520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fb388-6fbf-47d5-abc9-b9d524de54d6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:59.469278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fb388-6fbf-47d5-abc9-b9d524de54d6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:59.470942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71fb388-6fbf-47d5-abc9-b9d524de54d6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-d71fb388-6fbf-47d5-abc9-b9d524de54d6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:52:59.485704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:59.486708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:59.487682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:59.487682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:59.487682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:52:59.487682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:52:59.487682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:52:59.487682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:52:59.487682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:52:59.487682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:52:59.487682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 26 02:52:59.487682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:52:59.489073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fb851-b545-4421-a12a-fea085f630e8 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:59.489366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fb851-b545-4421-a12a-fea085f630e8 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:59.489652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fb851-b545-4421-a12a-fea085f630e8 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:59.490950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 476/964] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:52:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:52:59.502807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 489/965] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:59.504557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a85c-ce40-42f6-853a-ff94694d85ef None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:59.504851 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a85c-ce40-42f6-853a-ff94694d85ef None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:59.504966 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fb388-6fbf-47d5-abc9-b9d524de54d6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:59.505134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a85c-ce40-42f6-853a-ff94694d85ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:59.523335 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4791a85c-ce40-42f6-853a-ff94694d85ef None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:59.524852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4791a85c-ce40-42f6-853a-ff94694d85ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:59.566800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:59.571390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:59.607318 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 490/966] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:52:59.620491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71fb388-6fbf-47d5-abc9-b9d524de54d6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:59.623537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791a85c-ce40-42f6-853a-ff94694d85ef None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:59.668041 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc2f7e-854b-476c-85c5-1b99b7f2d1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:59.669090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc2f7e-854b-476c-85c5-1b99b7f2d1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:59.669561 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc2f7e-854b-476c-85c5-1b99b7f2d1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:59.670122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc2f7e-854b-476c-85c5-1b99b7f2d1e2 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:59.671151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc2f7e-854b-476c-85c5-1b99b7f2d1e2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:59.671662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc2f7e-854b-476c-85c5-1b99b7f2d1e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:59.673311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc2f7e-854b-476c-85c5-1b99b7f2d1e2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:59.710169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 477/967] 10.222.0.36 () {56 vars in 1101 bytes} [Sun Jun 26 02:52:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:59.746972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791a85c-ce40-42f6-853a-ff94694d85ef None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:59.786234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe75b-0cc2-4fd0-aa8a-694ba4c3bb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:59.787169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe75b-0cc2-4fd0-aa8a-694ba4c3bb2e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:59.787461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe75b-0cc2-4fd0-aa8a-694ba4c3bb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:59.787740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe75b-0cc2-4fd0-aa8a-694ba4c3bb2e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:59.800324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfe75b-0cc2-4fd0-aa8a-694ba4c3bb2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-1ccfe75b-0cc2-4fd0-aa8a-694ba4c3bb2e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:52:59.808830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:52:59.809850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:52:59.810693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 491/968] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Jun 26 02:52:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:52:59.818442 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc2f7e-854b-476c-85c5-1b99b7f2d1e2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:52:59.858007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cca147-4f69-4783-994d-f83b5243e393 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:59.858337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cca147-4f69-4783-994d-f83b5243e393 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:59.858573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cca147-4f69-4783-994d-f83b5243e393 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:59.861512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 492/969] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:52:59.866100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9a664-c1cd-40a9-b046-f9de5a94012e None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:59.866386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9a664-c1cd-40a9-b046-f9de5a94012e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:59.866669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9a664-c1cd-40a9-b046-f9de5a94012e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:59.884666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4ee9a664-c1cd-40a9-b046-f9de5a94012e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:52:59.885851 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4ee9a664-c1cd-40a9-b046-f9de5a94012e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:52:59.894642 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:59.939413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc2f7e-854b-476c-85c5-1b99b7f2d1e2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:52:59.961102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:52:59.978001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 493/970] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:52:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:52:59.980895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808b7fb-ca16-43c2-bdd7-326fc1b55c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:52:59.981571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808b7fb-ca16-43c2-bdd7-326fc1b55c64 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:52:59.981852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808b7fb-ca16-43c2-bdd7-326fc1b55c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:52:59.982125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808b7fb-ca16-43c2-bdd7-326fc1b55c64 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:52:59.982873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808b7fb-ca16-43c2-bdd7-326fc1b55c64 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:52:59.983213 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808b7fb-ca16-43c2-bdd7-326fc1b55c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:52:59.984583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808b7fb-ca16-43c2-bdd7-326fc1b55c64 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:52:59.993910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 478/971] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Jun 26 02:52:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:52:59.999892 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9a664-c1cd-40a9-b046-f9de5a94012e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:00.004083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808b7fb-ca16-43c2-bdd7-326fc1b55c64 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:00.106850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9a664-c1cd-40a9-b046-f9de5a94012e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:00.122405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808b7fb-ca16-43c2-bdd7-326fc1b55c64 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:00.143144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013b69-6134-4396-b1a7-a1d3acb7f73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:00.143948 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013b69-6134-4396-b1a7-a1d3acb7f73f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.144224 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013b69-6134-4396-b1a7-a1d3acb7f73f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.144491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50013b69-6134-4396-b1a7-a1d3acb7f73f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.154431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50013b69-6134-4396-b1a7-a1d3acb7f73f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:00.156047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50013b69-6134-4396-b1a7-a1d3acb7f73f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:00.157723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:00.158906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc624-66a0-480c-b855-6184a864d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:00.159749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc624-66a0-480c-b855-6184a864d140 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.160065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc624-66a0-480c-b855-6184a864d140 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.160320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc624-66a0-480c-b855-6184a864d140 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.161012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc624-66a0-480c-b855-6184a864d140 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:00.162401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc624-66a0-480c-b855-6184a864d140 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-f18cc624-66a0-480c-b855-6184a864d140 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:00.175707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:00.176724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:53:00.177779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-50013b69-6134-4396-b1a7-a1d3acb7f73f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:53:00.178665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:00.179654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:00.180525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:53:00.180525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:53:00.180525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:00.180525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:00.180761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 479/972] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Jun 26 02:53:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:53:00.182805 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc624-66a0-480c-b855-6184a864d140 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:00.183320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 494/973] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:00.188762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013b69-6134-4396-b1a7-a1d3acb7f73f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:00.239844 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:00.295245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50013b69-6134-4396-b1a7-a1d3acb7f73f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:00.299482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc624-66a0-480c-b855-6184a864d140 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:00.330614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48909-163a-4595-b633-291580859556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:00.331953 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48909-163a-4595-b633-291580859556 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.332237 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48909-163a-4595-b633-291580859556 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.332560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48909-163a-4595-b633-291580859556 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.333245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48909-163a-4595-b633-291580859556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:00.333551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48909-163a-4595-b633-291580859556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:00.333722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f85041-bb45-4d1d-9d54-e31caf31c7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:00.334379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f85041-bb45-4d1d-9d54-e31caf31c7bb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.334656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f85041-bb45-4d1d-9d54-e31caf31c7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.334928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f85041-bb45-4d1d-9d54-e31caf31c7bb None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.335055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48909-163a-4595-b633-291580859556 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:00.335656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f85041-bb45-4d1d-9d54-e31caf31c7bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:00.335956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f85041-bb45-4d1d-9d54-e31caf31c7bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:00.337302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f85041-bb45-4d1d-9d54-e31caf31c7bb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:00.342236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 480/974] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Jun 26 02:53:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:00.347808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f85041-bb45-4d1d-9d54-e31caf31c7bb None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:00.354591 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 495/975] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:00.357296 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48909-163a-4595-b633-291580859556 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:00.422820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:00.453869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f85041-bb45-4d1d-9d54-e31caf31c7bb None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:00.463138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:00.472515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48909-163a-4595-b633-291580859556 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:00.490448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1e407-fd47-4136-8924-80457c2a6bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:00.491826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1e407-fd47-4136-8924-80457c2a6bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.492325 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1e407-fd47-4136-8924-80457c2a6bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.492791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1e407-fd47-4136-8924-80457c2a6bf1 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.493700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1e407-fd47-4136-8924-80457c2a6bf1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:00.495059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1e407-fd47-4136-8924-80457c2a6bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:00.497136 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1e407-fd47-4136-8924-80457c2a6bf1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:00.503885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 481/976] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Jun 26 02:53:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:00.508978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a074edb-7ed2-4a77-a964-add5a58b2744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:00.509745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1e407-fd47-4136-8924-80457c2a6bf1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:00.509860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a074edb-7ed2-4a77-a964-add5a58b2744 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.510124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a074edb-7ed2-4a77-a964-add5a58b2744 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.510336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a074edb-7ed2-4a77-a964-add5a58b2744 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.519236 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a074edb-7ed2-4a77-a964-add5a58b2744 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:00.520718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a074edb-7ed2-4a77-a964-add5a58b2744 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-2a074edb-7ed2-4a77-a964-add5a58b2744 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:53:00.535272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:00.536330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:00.537277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:00.537277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:00.537277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:53:00.537277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:53:00.537277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:53:00.537277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:53:00.537277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:53:00.537277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:53:00.537277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 26 02:53:00.537277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:00.537277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 496/977] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Jun 26 02:53:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:53:00.542370 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a074edb-7ed2-4a77-a964-add5a58b2744 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:00.617197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1e407-fd47-4136-8924-80457c2a6bf1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:00.643151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a074edb-7ed2-4a77-a964-add5a58b2744 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:00.651669 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b8b0f-a308-4101-899c-b7a0dbfff5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:00.652372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8b0f-a308-4101-899c-b7a0dbfff5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.652668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8b0f-a308-4101-899c-b7a0dbfff5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.652936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8b0f-a308-4101-899c-b7a0dbfff5b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.653744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b8b0f-a308-4101-899c-b7a0dbfff5b8 None admin] RBAC: Adding query filter params (interface=admin, service_id=744ef548cbe6464abef37a70f59709af, region_id=RegionOne) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:00.654054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b8b0f-a308-4101-899c-b7a0dbfff5b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:00.655462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b8b0f-a308-4101-899c-b7a0dbfff5b8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:00.658254 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:00.666121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 482/978] 10.222.0.36 () {56 vars in 1249 bytes} [Sun Jun 26 02:53:00 2022] GET /identity/v3/endpoints?service_id=744ef548cbe6464abef37a70f59709af&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:00.667549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b8b0f-a308-4101-899c-b7a0dbfff5b8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:00.683151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc309e2-36ae-4424-a3c2-87f3a8fe3fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:00.683881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc309e2-36ae-4424-a3c2-87f3a8fe3fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.684169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc309e2-36ae-4424-a3c2-87f3a8fe3fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.684450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc309e2-36ae-4424-a3c2-87f3a8fe3fe2 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.685299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc309e2-36ae-4424-a3c2-87f3a8fe3fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:00.685612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc309e2-36ae-4424-a3c2-87f3a8fe3fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:00.687258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc309e2-36ae-4424-a3c2-87f3a8fe3fe2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:00.701334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:00.705317 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 497/979] 10.222.0.36 () {56 vars in 1149 bytes} [Sun Jun 26 02:53:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:00.707077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd943f5-da5e-464c-893a-cd629a935ac2 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.707342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd943f5-da5e-464c-893a-cd629a935ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.707624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd943f5-da5e-464c-893a-cd629a935ac2 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.711029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 498/980] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:00.711029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd943f5-da5e-464c-893a-cd629a935ac2 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:00.767087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b8b0f-a308-4101-899c-b7a0dbfff5b8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:00.799625 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aad2d-9138-441c-ab6e-d8fe5383da20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:00.800295 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aad2d-9138-441c-ab6e-d8fe5383da20 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.800567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aad2d-9138-441c-ab6e-d8fe5383da20 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.800844 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aad2d-9138-441c-ab6e-d8fe5383da20 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.801520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809aad2d-9138-441c-ab6e-d8fe5383da20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:00.802895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809aad2d-9138-441c-ab6e-d8fe5383da20 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:00.807594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd943f5-da5e-464c-893a-cd629a935ac2 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:00.808949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 483/981] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Jun 26 02:53:00 2022] GET /identity/v3/services => generated 1497 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 02:53:00.810086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99159-60e7-458b-8597-19037ea925a4 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.810376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99159-60e7-458b-8597-19037ea925a4 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.810659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99159-60e7-458b-8597-19037ea925a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.840694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5fc99159-60e7-458b-8597-19037ea925a4 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:00.841907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5fc99159-60e7-458b-8597-19037ea925a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:00.846090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75135a17-b7b1-4991-9656-029b5e8ad1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:00.846821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75135a17-b7b1-4991-9656-029b5e8ad1ef None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:00.847134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75135a17-b7b1-4991-9656-029b5e8ad1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:00.847418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75135a17-b7b1-4991-9656-029b5e8ad1ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:00.893203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:00.920628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 484/982] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:00.927111 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75135a17-b7b1-4991-9656-029b5e8ad1ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:00.928629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75135a17-b7b1-4991-9656-029b5e8ad1ef None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:00.943932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99159-60e7-458b-8597-19037ea925a4 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:00.975415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:01.046031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 499/983] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:00 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 26 02:53:01.048964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99159-60e7-458b-8597-19037ea925a4 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:01.052439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75135a17-b7b1-4991-9656-029b5e8ad1ef None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:01.084776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d38d06-b748-4ec5-b597-597836bc634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:01.085598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38d06-b748-4ec5-b597-597836bc634c None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:01.086009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38d06-b748-4ec5-b597-597836bc634c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:01.086291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38d06-b748-4ec5-b597-597836bc634c None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:01.087183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d38d06-b748-4ec5-b597-597836bc634c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:01.088577 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d38d06-b748-4ec5-b597-597836bc634c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:01.104751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 485/984] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:53:00 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:53:01.135824 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:01.172489 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75135a17-b7b1-4991-9656-029b5e8ad1ef None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:01.219036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e63f98-2a3c-4562-9e8a-d7ff2064a0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:01.220176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63f98-2a3c-4562-9e8a-d7ff2064a0ea None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:01.220677 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63f98-2a3c-4562-9e8a-d7ff2064a0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:01.221228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63f98-2a3c-4562-9e8a-d7ff2064a0ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:01.233597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e63f98-2a3c-4562-9e8a-d7ff2064a0ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:01.235510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e63f98-2a3c-4562-9e8a-d7ff2064a0ea None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-71e63f98-2a3c-4562-9e8a-d7ff2064a0ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:53:01.254941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:01.255930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:01.257727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:53:01.257727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:53:01.257727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:01.257727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:01.258891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 500/985] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:53:01.264639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d38d06-b748-4ec5-b597-597836bc634c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:01.366486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:01.379334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d38d06-b748-4ec5-b597-597836bc634c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:01.431115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b89be-ccc5-41b7-bde3-18a10c3e0a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:01.435010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b89be-ccc5-41b7-bde3-18a10c3e0a4a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:01.435010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b89be-ccc5-41b7-bde3-18a10c3e0a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:01.435010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b89be-ccc5-41b7-bde3-18a10c3e0a4a None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:01.435010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b89be-ccc5-41b7-bde3-18a10c3e0a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:01.435010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b89be-ccc5-41b7-bde3-18a10c3e0a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:01.435010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b89be-ccc5-41b7-bde3-18a10c3e0a4a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:01.455011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 486/986] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:01.455286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e63f98-2a3c-4562-9e8a-d7ff2064a0ea None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:01.563026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e63f98-2a3c-4562-9e8a-d7ff2064a0ea None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:01.583992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:01.599213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e78b7b-c8fd-436a-b2db-af9817623f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:01.600346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78b7b-c8fd-436a-b2db-af9817623f2e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:01.600893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78b7b-c8fd-436a-b2db-af9817623f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:01.601374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78b7b-c8fd-436a-b2db-af9817623f2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:01.609014 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e78b7b-c8fd-436a-b2db-af9817623f2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:01.610731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e78b7b-c8fd-436a-b2db-af9817623f2e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-71e78b7b-c8fd-436a-b2db-af9817623f2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:53:01.625088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:01.626005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:01.626914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:53:01.626914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:53:01.626914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:53:01.626914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:53:01.626914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:53:01.626914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:53:01.626914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:53:01.626914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:01.634756 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b89be-ccc5-41b7-bde3-18a10c3e0a4a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:01.635403 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 501/987] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:53:01.741984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b89be-ccc5-41b7-bde3-18a10c3e0a4a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:01.778235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69373c75-24c1-4b04-9d97-60e3afe479d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:01.780065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69373c75-24c1-4b04-9d97-60e3afe479d3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:01.780593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69373c75-24c1-4b04-9d97-60e3afe479d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:01.780869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69373c75-24c1-4b04-9d97-60e3afe479d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:01.781654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69373c75-24c1-4b04-9d97-60e3afe479d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:01.781959 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69373c75-24c1-4b04-9d97-60e3afe479d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:01.783411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69373c75-24c1-4b04-9d97-60e3afe479d3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:01.801994 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e78b7b-c8fd-436a-b2db-af9817623f2e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:01.802431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 487/988] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:01.900255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e78b7b-c8fd-436a-b2db-af9817623f2e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:01.937401 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8403f7b-e84d-4920-8a6f-d0275f0a4340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:01.938060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8403f7b-e84d-4920-8a6f-d0275f0a4340 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:01.938333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8403f7b-e84d-4920-8a6f-d0275f0a4340 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:01.938606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8403f7b-e84d-4920-8a6f-d0275f0a4340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:01.939474 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8403f7b-e84d-4920-8a6f-d0275f0a4340 None admin] RBAC: Adding query filter params (role.id=e8e8025982464049a613a57d9e11f8be, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=d78da06180d0420f82074fa5e3cbc71e) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:01.939783 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8403f7b-e84d-4920-8a6f-d0275f0a4340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:01.941220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8403f7b-e84d-4920-8a6f-d0275f0a4340 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:01.947328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 502/989] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:53:01 2022] GET /identity/v3/role_assignments?user.id=d78da06180d0420f82074fa5e3cbc71e&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=e8e8025982464049a613a57d9e11f8be => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:02.854304 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b06201-ca31-488e-b1bb-16aa46e46277 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:02.854894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b06201-ca31-488e-b1bb-16aa46e46277 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:02.854894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b06201-ca31-488e-b1bb-16aa46e46277 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:02.856497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 488/990] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:02.861739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea68833-7904-4a94-af36-c76a0258b8a2 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:02.862161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea68833-7904-4a94-af36-c76a0258b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:02.862337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea68833-7904-4a94-af36-c76a0258b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:02.879035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6ea68833-7904-4a94-af36-c76a0258b8a2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:02.880226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6ea68833-7904-4a94-af36-c76a0258b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:02.920057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:02.950267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 503/991] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:02.970603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b06201-ca31-488e-b1bb-16aa46e46277 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:02.983872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:03.078095 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b06201-ca31-488e-b1bb-16aa46e46277 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:03.112130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436a2e9-ec76-4f55-9999-84d7f70f30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:03.112845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436a2e9-ec76-4f55-9999-84d7f70f30f8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.113142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436a2e9-ec76-4f55-9999-84d7f70f30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.113417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436a2e9-ec76-4f55-9999-84d7f70f30f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:03.114083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436a2e9-ec76-4f55-9999-84d7f70f30f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:03.115496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436a2e9-ec76-4f55-9999-84d7f70f30f8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2436a2e9-ec76-4f55-9999-84d7f70f30f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:03.128008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:03.129075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 26 02:53:03.129918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:03.134349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 489/992] 10.222.0.36 () {56 vars in 1126 bytes} [Sun Jun 26 02:53:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:03.135764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea68833-7904-4a94-af36-c76a0258b8a2 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:03.148517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f43a63-1855-4fbe-a001-4059f6c3eaf2 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.148809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f43a63-1855-4fbe-a001-4059f6c3eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.149090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f43a63-1855-4fbe-a001-4059f6c3eaf2 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:03.150491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 490/993] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:03.155594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9441de2-85fc-412e-8af4-b705d1baa3d2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.155904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9441de2-85fc-412e-8af4-b705d1baa3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.156185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9441de2-85fc-412e-8af4-b705d1baa3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:03.174236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e9441de2-85fc-412e-8af4-b705d1baa3d2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:03.175438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e9441de2-85fc-412e-8af4-b705d1baa3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:03.242723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea68833-7904-4a94-af36-c76a0258b8a2 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:03.246034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 491/994] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:03.268070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9441de2-85fc-412e-8af4-b705d1baa3d2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:03.271336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:03.278106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e1a1-0a31-447d-b91b-d9fba4f94a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:03.278804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e1a1-0a31-447d-b91b-d9fba4f94a9c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.279194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e1a1-0a31-447d-b91b-d9fba4f94a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.279505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10e1a1-0a31-447d-b91b-d9fba4f94a9c None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:03.280249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10e1a1-0a31-447d-b91b-d9fba4f94a9c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:03.280575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10e1a1-0a31-447d-b91b-d9fba4f94a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:03.282012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10e1a1-0a31-447d-b91b-d9fba4f94a9c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:03.287019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 504/995] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Jun 26 02:53:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:03.293143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e1a1-0a31-447d-b91b-d9fba4f94a9c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:03.332559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:03.379956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9441de2-85fc-412e-8af4-b705d1baa3d2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:03.397449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10e1a1-0a31-447d-b91b-d9fba4f94a9c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:03.419606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0ba3-8eb5-4cd8-8b94-41e9df0ef3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:03.420413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0ba3-8eb5-4cd8-8b94-41e9df0ef3ab None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.420678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0ba3-8eb5-4cd8-8b94-41e9df0ef3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.420962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0ba3-8eb5-4cd8-8b94-41e9df0ef3ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:03.421593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde0ba3-8eb5-4cd8-8b94-41e9df0ef3ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:03.423080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde0ba3-8eb5-4cd8-8b94-41e9df0ef3ab None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:03.433612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf313a2-e064-4777-af15-a4de2a88aacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:03.434425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf313a2-e064-4777-af15-a4de2a88aacd None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.434739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf313a2-e064-4777-af15-a4de2a88aacd None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-abde0ba3-8eb5-4cd8-8b94-41e9df0ef3ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:03.435004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:03.436025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 26 02:53:03.436894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:03.437636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf313a2-e064-4777-af15-a4de2a88aacd None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:03.437636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf313a2-e064-4777-af15-a4de2a88aacd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:03.437636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf313a2-e064-4777-af15-a4de2a88aacd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:03.439421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf313a2-e064-4777-af15-a4de2a88aacd None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:03.441281 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 492/996] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:53:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:03.441970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0ba3-8eb5-4cd8-8b94-41e9df0ef3ab None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:03.446686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 505/997] 10.222.0.36 () {56 vars in 1122 bytes} [Sun Jun 26 02:53:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:03.452294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf313a2-e064-4777-af15-a4de2a88aacd None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:03.516542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:03.554208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0ba3-8eb5-4cd8-8b94-41e9df0ef3ab None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:03.566145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf313a2-e064-4777-af15-a4de2a88aacd None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:03.568245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:03.588011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7cbb6-de76-45f7-bea2-83a39368e444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:03.588679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7cbb6-de76-45f7-bea2-83a39368e444 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.588960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7cbb6-de76-45f7-bea2-83a39368e444 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.589233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7cbb6-de76-45f7-bea2-83a39368e444 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:03.589978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7cbb6-de76-45f7-bea2-83a39368e444 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:03.590284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7cbb6-de76-45f7-bea2-83a39368e444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:03.591687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7cbb6-de76-45f7-bea2-83a39368e444 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:03.601108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 493/998] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:53:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:03.602053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7cbb6-de76-45f7-bea2-83a39368e444 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:03.608773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2564-dbe7-404b-9554-dd533021260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:03.609452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2564-dbe7-404b-9554-dd533021260f None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.609766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2564-dbe7-404b-9554-dd533021260f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.610074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2564-dbe7-404b-9554-dd533021260f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:03.610947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c2564-dbe7-404b-9554-dd533021260f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:03.612765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c2564-dbe7-404b-9554-dd533021260f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:03.631764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 506/999] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Jun 26 02:53:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:53:03.724145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7cbb6-de76-45f7-bea2-83a39368e444 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:03.756315 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:03.769997 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa97e-7df5-4a9d-96ea-4b0cd2b3fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:03.770681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa97e-7df5-4a9d-96ea-4b0cd2b3fc28 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.770965 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa97e-7df5-4a9d-96ea-4b0cd2b3fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.771272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa97e-7df5-4a9d-96ea-4b0cd2b3fc28 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:03.771980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efa97e-7df5-4a9d-96ea-4b0cd2b3fc28 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:03.772290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efa97e-7df5-4a9d-96ea-4b0cd2b3fc28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:03.773714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efa97e-7df5-4a9d-96ea-4b0cd2b3fc28 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:03.779586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 494/1000] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:53:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:03.785499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2564-dbe7-404b-9554-dd533021260f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:03.888333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2564-dbe7-404b-9554-dd533021260f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:03.921749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914e555-190f-44bd-9f4e-44f9b591625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:03.922422 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914e555-190f-44bd-9f4e-44f9b591625b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.922734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914e555-190f-44bd-9f4e-44f9b591625b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.923062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914e555-190f-44bd-9f4e-44f9b591625b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:03.923873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914e555-190f-44bd-9f4e-44f9b591625b None admin] RBAC: Adding query filter params (interface=public, service_id=6dcc251f29934f50b98f6faa0c8f65f5, region_id=RegionOne) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:03.924185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914e555-190f-44bd-9f4e-44f9b591625b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:03.925564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914e555-190f-44bd-9f4e-44f9b591625b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:03.930947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 507/1001] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Jun 26 02:53:03 2022] GET /identity/v3/endpoints?service_id=6dcc251f29934f50b98f6faa0c8f65f5&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:03.936600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa97e-7df5-4a9d-96ea-4b0cd2b3fc28 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:03.987541 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f05df2-2f0f-4f07-a6de-fcdd4bfb2fe1 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.987896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f05df2-2f0f-4f07-a6de-fcdd4bfb2fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.988161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f05df2-2f0f-4f07-a6de-fcdd4bfb2fe1 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:03.989526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 508/1002] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:03.994338 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04d473-345f-42ba-be76-2c7e9d5ed2f0 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:03.994658 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04d473-345f-42ba-be76-2c7e9d5ed2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:03.994966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04d473-345f-42ba-be76-2c7e9d5ed2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:04.012015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-0d04d473-345f-42ba-be76-2c7e9d5ed2f0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:04.013191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-0d04d473-345f-42ba-be76-2c7e9d5ed2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:04.035904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:04.050825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa97e-7df5-4a9d-96ea-4b0cd2b3fc28 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:04.091027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 509/1003] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:03 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:53:04.095612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e56744-9a20-47be-88d7-0873e671ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:04.096686 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e56744-9a20-47be-88d7-0873e671ac51 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:04.097378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e56744-9a20-47be-88d7-0873e671ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:04.097652 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e56744-9a20-47be-88d7-0873e671ac51 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:04.098405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e56744-9a20-47be-88d7-0873e671ac51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:04.099809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e56744-9a20-47be-88d7-0873e671ac51 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:04.106571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 495/1004] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Jun 26 02:53:03 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 02:53:04.114252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04d473-345f-42ba-be76-2c7e9d5ed2f0 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:04.224900 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04d473-345f-42ba-be76-2c7e9d5ed2f0 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:04.265923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4803a7f-a1a2-4204-b6f5-54a61b9e92e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:04.266764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4803a7f-a1a2-4204-b6f5-54a61b9e92e6 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:04.267037 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4803a7f-a1a2-4204-b6f5-54a61b9e92e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:04.267334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4803a7f-a1a2-4204-b6f5-54a61b9e92e6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:04.267963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4803a7f-a1a2-4204-b6f5-54a61b9e92e6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:04.269344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4803a7f-a1a2-4204-b6f5-54a61b9e92e6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-d4803a7f-a1a2-4204-b6f5-54a61b9e92e6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:04.280858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:04.281868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:04.282930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 510/1005] 10.222.0.36 () {56 vars in 1105 bytes} [Sun Jun 26 02:53:04 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:04.289259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e56744-9a20-47be-88d7-0873e671ac51 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:04.348117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:04.397315 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e56744-9a20-47be-88d7-0873e671ac51 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:04.432421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c58a0c-9e03-42b4-bf0e-f113ceb2f80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:04.433082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58a0c-9e03-42b4-bf0e-f113ceb2f80d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:04.433395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58a0c-9e03-42b4-bf0e-f113ceb2f80d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:04.433665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58a0c-9e03-42b4-bf0e-f113ceb2f80d None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:04.434364 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c58a0c-9e03-42b4-bf0e-f113ceb2f80d None admin] RBAC: Adding query filter params (name=image) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:04.434663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c58a0c-9e03-42b4-bf0e-f113ceb2f80d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:04.436057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c58a0c-9e03-42b4-bf0e-f113ceb2f80d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:04.441148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 496/1006] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:04.446723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4803a7f-a1a2-4204-b6f5-54a61b9e92e6 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:04.470106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:04.555861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4803a7f-a1a2-4204-b6f5-54a61b9e92e6 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:04.590947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dec26-b78b-4d53-a06f-e98aa7b3b7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:04.591646 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dec26-b78b-4d53-a06f-e98aa7b3b7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:04.591928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dec26-b78b-4d53-a06f-e98aa7b3b7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:04.592205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dec26-b78b-4d53-a06f-e98aa7b3b7e7 None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:04.592916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dec26-b78b-4d53-a06f-e98aa7b3b7e7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:04.593222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dec26-b78b-4d53-a06f-e98aa7b3b7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:04.594608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dec26-b78b-4d53-a06f-e98aa7b3b7e7 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:04.599485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 511/1007] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:05.685825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1371bdb-c3df-4bf4-a3ef-8e1b05cbe9aa None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:05.686375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1371bdb-c3df-4bf4-a3ef-8e1b05cbe9aa None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:05.686375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1371bdb-c3df-4bf4-a3ef-8e1b05cbe9aa None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:05.688280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 497/1008] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:05.693271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0d4a3-ac9c-4b67-8805-8154f573b140 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:05.693697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0d4a3-ac9c-4b67-8805-8154f573b140 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:05.693867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0d4a3-ac9c-4b67-8805-8154f573b140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:05.711422 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-46e0d4a3-ac9c-4b67-8805-8154f573b140 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:05.712608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-46e0d4a3-ac9c-4b67-8805-8154f573b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:05.783128 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 512/1009] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:05.807152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1371bdb-c3df-4bf4-a3ef-8e1b05cbe9aa None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:05.913610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1371bdb-c3df-4bf4-a3ef-8e1b05cbe9aa None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:05.933705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:05.949135 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc5e60-ea1f-427f-9df1-5f765082673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:05.949934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc5e60-ea1f-427f-9df1-5f765082673c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:05.950219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc5e60-ea1f-427f-9df1-5f765082673c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:05.950491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc5e60-ea1f-427f-9df1-5f765082673c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:05.951704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc5e60-ea1f-427f-9df1-5f765082673c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:05.953158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc5e60-ea1f-427f-9df1-5f765082673c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:05.955010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 498/1010] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:05.960843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0d4a3-ac9c-4b67-8805-8154f573b140 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:05.976377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:06.064308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0d4a3-ac9c-4b67-8805-8154f573b140 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:06.100227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086357c-a10d-4bd7-9fea-1710c67c0089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:06.101009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086357c-a10d-4bd7-9fea-1710c67c0089 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:06.101287 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086357c-a10d-4bd7-9fea-1710c67c0089 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:06.101563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086357c-a10d-4bd7-9fea-1710c67c0089 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:06.102288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086357c-a10d-4bd7-9fea-1710c67c0089 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:06.103783 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086357c-a10d-4bd7-9fea-1710c67c0089 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:06.133004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 513/1011] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:53:05 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:53:06.141109 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d5a1-4709-400d-a893-34657363cbb7 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:06.141394 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d5a1-4709-400d-a893-34657363cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:06.141813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d5a1-4709-400d-a893-34657363cbb7 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:06.143572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 499/1012] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:06.149830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b13867-7aeb-4404-8c21-56b58ea95b96 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:06.150079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b13867-7aeb-4404-8c21-56b58ea95b96 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:06.150386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b13867-7aeb-4404-8c21-56b58ea95b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:06.169234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-b1b13867-7aeb-4404-8c21-56b58ea95b96 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:06.170434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b1b13867-7aeb-4404-8c21-56b58ea95b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:06.242150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:06.255022 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 514/1013] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:06.277568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d5a1-4709-400d-a893-34657363cbb7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:06.385854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d5a1-4709-400d-a893-34657363cbb7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:06.421533 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b213838-a474-4758-bd12-7b8054104fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:06.422345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b213838-a474-4758-bd12-7b8054104fca None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:06.422630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b213838-a474-4758-bd12-7b8054104fca None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:06.422912 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b213838-a474-4758-bd12-7b8054104fca None admin] PATH_INFO: `/v3/services/compute` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:06.423611 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b213838-a474-4758-bd12-7b8054104fca None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:06.424995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b213838-a474-4758-bd12-7b8054104fca None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-1b213838-a474-4758-bd12-7b8054104fca None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:06.436898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:06.437870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:06.438796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 500/1014] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:53:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:06.444288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b13867-7aeb-4404-8c21-56b58ea95b96 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:06.552120 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b13867-7aeb-4404-8c21-56b58ea95b96 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:06.587378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2affb6a-fec3-439a-9de0-5a73f13d797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:06.588046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2affb6a-fec3-439a-9de0-5a73f13d797a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:06.588320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2affb6a-fec3-439a-9de0-5a73f13d797a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:06.588595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2affb6a-fec3-439a-9de0-5a73f13d797a None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:06.589309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2affb6a-fec3-439a-9de0-5a73f13d797a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:06.589636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2affb6a-fec3-439a-9de0-5a73f13d797a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:06.591021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2affb6a-fec3-439a-9de0-5a73f13d797a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:06.593769 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6346a-e17b-4cfe-9d58-4cb438e7367d None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:06.594039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6346a-e17b-4cfe-9d58-4cb438e7367d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:06.594320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6346a-e17b-4cfe-9d58-4cb438e7367d None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:06.595865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 501/1015] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:53:06.600962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 515/1016] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:53:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:06.601082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a44d2-ede4-4b34-8e08-ce83547df6a9 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:06.601082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a44d2-ede4-4b34-8e08-ce83547df6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:06.601082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a44d2-ede4-4b34-8e08-ce83547df6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:06.601783 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2affb6a-fec3-439a-9de0-5a73f13d797a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:06.618148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f62a44d2-ede4-4b34-8e08-ce83547df6a9 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:06.619369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f62a44d2-ede4-4b34-8e08-ce83547df6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:06.662438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:06.672812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:06.693297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 502/1017] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:06.706510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2affb6a-fec3-439a-9de0-5a73f13d797a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:06.715733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a44d2-ede4-4b34-8e08-ce83547df6a9 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:06.742097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd253e-d6d1-42b2-89a6-6444a2a9b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:06.742767 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd253e-d6d1-42b2-89a6-6444a2a9b00b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:06.743074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd253e-d6d1-42b2-89a6-6444a2a9b00b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:06.743350 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd253e-d6d1-42b2-89a6-6444a2a9b00b None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:06.744054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd253e-d6d1-42b2-89a6-6444a2a9b00b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:06.744357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd253e-d6d1-42b2-89a6-6444a2a9b00b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:06.745818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd253e-d6d1-42b2-89a6-6444a2a9b00b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:06.750636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 516/1018] 10.222.0.36 () {56 vars in 1112 bytes} [Sun Jun 26 02:53:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:06.756598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd253e-d6d1-42b2-89a6-6444a2a9b00b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:06.816728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a44d2-ede4-4b34-8e08-ce83547df6a9 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:06.853828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cf084-5208-4eaa-bb3e-4c742497b2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:06.854500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cf084-5208-4eaa-bb3e-4c742497b2c4 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:06.854781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cf084-5208-4eaa-bb3e-4c742497b2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:06.855144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cf084-5208-4eaa-bb3e-4c742497b2c4 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:06.855868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cf084-5208-4eaa-bb3e-4c742497b2c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:06.857258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cf084-5208-4eaa-bb3e-4c742497b2c4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:06.861949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd253e-d6d1-42b2-89a6-6444a2a9b00b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:06.872758 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 503/1019] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:53:06 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:53:06.896224 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:06.916564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22e9e0-b20d-4859-9285-e832fdaf3cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:06.917205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e9e0-b20d-4859-9285-e832fdaf3cf1 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:06.917524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e9e0-b20d-4859-9285-e832fdaf3cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:06.917799 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e9e0-b20d-4859-9285-e832fdaf3cf1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:06.918647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22e9e0-b20d-4859-9285-e832fdaf3cf1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:06.920261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22e9e0-b20d-4859-9285-e832fdaf3cf1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:06.951017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 517/1020] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Jun 26 02:53:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:53:08.190583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90656702-aca4-4c74-be6a-1f5638372d29 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:08.191181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90656702-aca4-4c74-be6a-1f5638372d29 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:08.191284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90656702-aca4-4c74-be6a-1f5638372d29 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:08.192662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 504/1021] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:08.198001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b2554-0560-45af-94ac-841d4a37a64b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:08.198418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b2554-0560-45af-94ac-841d4a37a64b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:08.198761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b2554-0560-45af-94ac-841d4a37a64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:08.215702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-aa0b2554-0560-45af-94ac-841d4a37a64b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:08.216871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-aa0b2554-0560-45af-94ac-841d4a37a64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:08.288068 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 518/1022] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:08.312470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90656702-aca4-4c74-be6a-1f5638372d29 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:08.356692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:08.414119 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90656702-aca4-4c74-be6a-1f5638372d29 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:08.447892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea67bd-a1b6-4ea7-b698-2746ebe0a5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:08.448647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea67bd-a1b6-4ea7-b698-2746ebe0a5ab None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:08.448933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea67bd-a1b6-4ea7-b698-2746ebe0a5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:08.449211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea67bd-a1b6-4ea7-b698-2746ebe0a5ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:08.450386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea67bd-a1b6-4ea7-b698-2746ebe0a5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:08.451864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea67bd-a1b6-4ea7-b698-2746ebe0a5ab None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:08.458383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 505/1023] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:08.459587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b2554-0560-45af-94ac-841d4a37a64b None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:08.575846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b2554-0560-45af-94ac-841d4a37a64b None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:08.577989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:08.614303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab351c5-73b8-45b6-b832-64d23e77467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:08.615278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab351c5-73b8-45b6-b832-64d23e77467d None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:08.615710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab351c5-73b8-45b6-b832-64d23e77467d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:08.616247 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab351c5-73b8-45b6-b832-64d23e77467d None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:08.617100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab351c5-73b8-45b6-b832-64d23e77467d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:08.618861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab351c5-73b8-45b6-b832-64d23e77467d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:08.647016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 519/1024] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:53:08 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:53:08.909925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af27897-10d3-4b4c-9826-9e234e84c822 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:08.910332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af27897-10d3-4b4c-9826-9e234e84c822 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:08.910459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af27897-10d3-4b4c-9826-9e234e84c822 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:08.912099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 506/1025] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:08.917912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f9238-dcaa-4a3d-be86-41a44b79576c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:08.918211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f9238-dcaa-4a3d-be86-41a44b79576c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:08.918504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f9238-dcaa-4a3d-be86-41a44b79576c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:08.937462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-914f9238-dcaa-4a3d-be86-41a44b79576c None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:08.938680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-914f9238-dcaa-4a3d-be86-41a44b79576c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:09.009193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 520/1026] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:09.032016 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af27897-10d3-4b4c-9826-9e234e84c822 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:09.072203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fc1ba-1d09-4207-bc40-b8ac4d3670c8 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:09.072555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fc1ba-1d09-4207-bc40-b8ac4d3670c8 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:09.072748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fc1ba-1d09-4207-bc40-b8ac4d3670c8 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:09.074397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 521/1027] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:53:09.079235 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35928c1c-de82-4b86-a417-87db5c7fa568 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:09.079521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35928c1c-de82-4b86-a417-87db5c7fa568 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:09.079800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35928c1c-de82-4b86-a417-87db5c7fa568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:09.096949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-35928c1c-de82-4b86-a417-87db5c7fa568 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:09.098200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-35928c1c-de82-4b86-a417-87db5c7fa568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:09.139725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af27897-10d3-4b4c-9826-9e234e84c822 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:09.151548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:09.169801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 522/1028] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:09.177982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e4c0-a09f-49b4-ba3e-f1cd58f22627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:09.179304 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e4c0-a09f-49b4-ba3e-f1cd58f22627 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:09.179615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e4c0-a09f-49b4-ba3e-f1cd58f22627 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:09.179904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e4c0-a09f-49b4-ba3e-f1cd58f22627 None admin] PATH_INFO: `/v3/services/image` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:09.180560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54e4c0-a09f-49b4-ba3e-f1cd58f22627 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:09.181955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54e4c0-a09f-49b4-ba3e-f1cd58f22627 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:09.192761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35928c1c-de82-4b86-a417-87db5c7fa568 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-7c54e4c0-a09f-49b4-ba3e-f1cd58f22627 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:09.193876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:09.195230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:09.196081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 507/1029] 10.222.0.36 () {56 vars in 1105 bytes} [Sun Jun 26 02:53:09 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:09.200824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e4c0-a09f-49b4-ba3e-f1cd58f22627 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:09.216019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:09.300791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35928c1c-de82-4b86-a417-87db5c7fa568 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:09.315702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e4c0-a09f-49b4-ba3e-f1cd58f22627 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:09.337759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b2118-a0bf-4874-87d9-cb700ced9f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:09.338822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b2118-a0bf-4874-87d9-cb700ced9f72 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:09.339168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b2118-a0bf-4874-87d9-cb700ced9f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:09.339537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b2118-a0bf-4874-87d9-cb700ced9f72 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:09.350751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b07a9-eef8-4e05-a687-6f516307f0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:09.350926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b2118-a0bf-4874-87d9-cb700ced9f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:53:09.351576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b07a9-eef8-4e05-a687-6f516307f0ee None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:09.351869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b07a9-eef8-4e05-a687-6f516307f0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:09.352153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b07a9-eef8-4e05-a687-6f516307f0ee None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:09.352863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b07a9-eef8-4e05-a687-6f516307f0ee None admin] RBAC: Adding query filter params (name=image) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:09.353172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b07a9-eef8-4e05-a687-6f516307f0ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:09.354560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b07a9-eef8-4e05-a687-6f516307f0ee None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-d93b2118-a0bf-4874-87d9-cb700ced9f72 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:53:09.358844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:09.359788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:53:09.360628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:09.364359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 508/1030] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:09.364863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 523/1031] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Jun 26 02:53:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:53:09.365275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b07a9-eef8-4e05-a687-6f516307f0ee None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:09.365567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b2118-a0bf-4874-87d9-cb700ced9f72 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:09.408315 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:09.452326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:09.472803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b07a9-eef8-4e05-a687-6f516307f0ee None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:09.476252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b2118-a0bf-4874-87d9-cb700ced9f72 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:09.508333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4369660-c947-4c38-ae20-d4205f9f30ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:09.509020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369660-c947-4c38-ae20-d4205f9f30ff None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:09.509303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369660-c947-4c38-ae20-d4205f9f30ff None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:09.509582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369660-c947-4c38-ae20-d4205f9f30ff None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:09.510291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4369660-c947-4c38-ae20-d4205f9f30ff None admin] RBAC: Adding query filter params (type=image) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:09.510599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4369660-c947-4c38-ae20-d4205f9f30ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:09.512125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4369660-c947-4c38-ae20-d4205f9f30ff None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:09.517152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 509/1032] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:09.520649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd1dc1-04ba-4de3-973c-574308ccbbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:09.521506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd1dc1-04ba-4de3-973c-574308ccbbeb None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:09.522035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd1dc1-04ba-4de3-973c-574308ccbbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:09.522144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd1dc1-04ba-4de3-973c-574308ccbbeb None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:09.522889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd1dc1-04ba-4de3-973c-574308ccbbeb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:09.523177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4369660-c947-4c38-ae20-d4205f9f30ff None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:09.523280 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd1dc1-04ba-4de3-973c-574308ccbbeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:09.524603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd1dc1-04ba-4de3-973c-574308ccbbeb None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:09.537647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 524/1033] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Jun 26 02:53:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:09.539015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd1dc1-04ba-4de3-973c-574308ccbbeb None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:09.624873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4369660-c947-4c38-ae20-d4205f9f30ff None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:09.626897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:09.638329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd1dc1-04ba-4de3-973c-574308ccbbeb None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:09.662173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63704ff2-d4e9-4823-95f0-fbcea8809c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:09.662935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63704ff2-d4e9-4823-95f0-fbcea8809c35 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:09.663331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63704ff2-d4e9-4823-95f0-fbcea8809c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:09.663608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63704ff2-d4e9-4823-95f0-fbcea8809c35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:09.664521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63704ff2-d4e9-4823-95f0-fbcea8809c35 None admin] RBAC: Adding query filter params (interface=public, service_id=d7c5882c9178422c9d9099b59193057f, region_id=RegionOne) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:09.664828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63704ff2-d4e9-4823-95f0-fbcea8809c35 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:09.666663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63704ff2-d4e9-4823-95f0-fbcea8809c35 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:09.672122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2174e7-d2d4-40af-8635-2a7c375f1eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:09.676671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 510/1034] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Jun 26 02:53:09 2022] GET /identity/v3/endpoints?service_id=d7c5882c9178422c9d9099b59193057f&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:09.676767 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2174e7-d2d4-40af-8635-2a7c375f1eda None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:09.676767 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2174e7-d2d4-40af-8635-2a7c375f1eda None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:09.676767 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2174e7-d2d4-40af-8635-2a7c375f1eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:09.677549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63704ff2-d4e9-4823-95f0-fbcea8809c35 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:09.684368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:09.687146 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2174e7-d2d4-40af-8635-2a7c375f1eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:09.688658 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2174e7-d2d4-40af-8635-2a7c375f1eda None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-4d2174e7-d2d4-40af-8635-2a7c375f1eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:53:09.706626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:09.707560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:09.708475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:53:09.708475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:53:09.708475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:09.708475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:09.708475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 525/1035] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:09.713367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2174e7-d2d4-40af-8635-2a7c375f1eda None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:09.792090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63704ff2-d4e9-4823-95f0-fbcea8809c35 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:09.820713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2174e7-d2d4-40af-8635-2a7c375f1eda None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:09.829335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df482ef2-5996-4665-9bf9-c799e1f1d1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:09.830021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482ef2-5996-4665-9bf9-c799e1f1d1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:09.830300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482ef2-5996-4665-9bf9-c799e1f1d1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:09.830586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482ef2-5996-4665-9bf9-c799e1f1d1b3 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:09.831307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df482ef2-5996-4665-9bf9-c799e1f1d1b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:09.832693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df482ef2-5996-4665-9bf9-c799e1f1d1b3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:09.843386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 511/1036] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Jun 26 02:53:09 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 02:53:09.859320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb648d0b-d932-4d5f-b29a-e28964f04be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:09.860343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648d0b-d932-4d5f-b29a-e28964f04be2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:09.860837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648d0b-d932-4d5f-b29a-e28964f04be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:09.861297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648d0b-d932-4d5f-b29a-e28964f04be2 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:09.862224 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb648d0b-d932-4d5f-b29a-e28964f04be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:09.862714 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb648d0b-d932-4d5f-b29a-e28964f04be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:09.864355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb648d0b-d932-4d5f-b29a-e28964f04be2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:09.878737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 526/1037] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:09.884881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df482ef2-5996-4665-9bf9-c799e1f1d1b3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:09.921797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:09.998783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df482ef2-5996-4665-9bf9-c799e1f1d1b3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:10.036399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287889be-b72e-4cab-b117-64f945cc20e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:10.037507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287889be-b72e-4cab-b117-64f945cc20e0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:10.038000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287889be-b72e-4cab-b117-64f945cc20e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:10.038455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287889be-b72e-4cab-b117-64f945cc20e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:10.046881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287889be-b72e-4cab-b117-64f945cc20e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:10.048535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287889be-b72e-4cab-b117-64f945cc20e0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-287889be-b72e-4cab-b117-64f945cc20e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:53:10.062630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:10.063674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:10.064631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:10.064631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:10.064631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:53:10.064631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:53:10.064631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:53:10.064631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:53:10.064631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:53:10.064631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:53:10.064631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:53:10.064631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:10.065177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 512/1038] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Jun 26 02:53:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:10.070133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb648d0b-d932-4d5f-b29a-e28964f04be2 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:10.124212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:10.175993 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb648d0b-d932-4d5f-b29a-e28964f04be2 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:10.212103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43913-b02a-4a2d-9d18-6adf05ddaaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:10.212814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43913-b02a-4a2d-9d18-6adf05ddaaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:10.213107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43913-b02a-4a2d-9d18-6adf05ddaaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:10.213372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43913-b02a-4a2d-9d18-6adf05ddaaa2 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:10.214341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf43913-b02a-4a2d-9d18-6adf05ddaaa2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:10.214646 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf43913-b02a-4a2d-9d18-6adf05ddaaa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:10.216149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf43913-b02a-4a2d-9d18-6adf05ddaaa2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:10.234483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 527/1039] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Jun 26 02:53:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:10.240115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287889be-b72e-4cab-b117-64f945cc20e0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:10.332263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:10.343505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287889be-b72e-4cab-b117-64f945cc20e0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:10.376978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dc534-7f0c-484b-958a-40aea3d622a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:10.377635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc534-7f0c-484b-958a-40aea3d622a6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:10.377921 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc534-7f0c-484b-958a-40aea3d622a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:10.378200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc534-7f0c-484b-958a-40aea3d622a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:10.447098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dc534-7f0c-484b-958a-40aea3d622a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:10.448675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dc534-7f0c-484b-958a-40aea3d622a6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:10.550853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:10.566928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 513/1040] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 26 02:53:10.568246 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43913-b02a-4a2d-9d18-6adf05ddaaa2 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:10.671446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43913-b02a-4a2d-9d18-6adf05ddaaa2 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:10.682061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:10.701313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1836e-7d26-4aa2-b12c-8740815d4ee0 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:10.701601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1836e-7d26-4aa2-b12c-8740815d4ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:10.701884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1836e-7d26-4aa2-b12c-8740815d4ee0 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:10.703585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 514/1041] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:53:10.708661 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c50ef3-fa23-4c11-b652-d0801450560c None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:10.708959 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c50ef3-fa23-4c11-b652-d0801450560c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:10.709219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c50ef3-fa23-4c11-b652-d0801450560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:10.710433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98187-be2c-4f5d-904e-af86a3e2c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:10.711272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98187-be2c-4f5d-904e-af86a3e2c9da None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:10.711550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98187-be2c-4f5d-904e-af86a3e2c9da None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:10.711821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98187-be2c-4f5d-904e-af86a3e2c9da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:10.722199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e98187-be2c-4f5d-904e-af86a3e2c9da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:10.723690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e98187-be2c-4f5d-904e-af86a3e2c9da None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:10.726688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-49c50ef3-fa23-4c11-b652-d0801450560c None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:10.727999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-49c50ef3-fa23-4c11-b652-d0801450560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-33e98187-be2c-4f5d-904e-af86a3e2c9da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:53:10.742074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:10.743110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:10.744027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:53:10.744027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:53:10.744027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:10.744027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:10.744027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 528/1042] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:10.749020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98187-be2c-4f5d-904e-af86a3e2c9da None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:10.807021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 515/1043] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:53:10.830152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c50ef3-fa23-4c11-b652-d0801450560c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:10.855206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98187-be2c-4f5d-904e-af86a3e2c9da None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:10.893137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420269f6-626b-45c7-9981-f4749a23d0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:10.893772 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420269f6-626b-45c7-9981-f4749a23d0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:10.894030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420269f6-626b-45c7-9981-f4749a23d0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:10.894316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420269f6-626b-45c7-9981-f4749a23d0a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:10.895194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420269f6-626b-45c7-9981-f4749a23d0a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:10.895385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420269f6-626b-45c7-9981-f4749a23d0a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:10.897168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420269f6-626b-45c7-9981-f4749a23d0a7 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:10.909901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 529/1044] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:10.915600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420269f6-626b-45c7-9981-f4749a23d0a7 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:10.938680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c50ef3-fa23-4c11-b652-d0801450560c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:10.944669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:10.962971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:10.977682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1192f6-930b-4a8f-be99-d293f5b3008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:10.978489 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1192f6-930b-4a8f-be99-d293f5b3008e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:10.978775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1192f6-930b-4a8f-be99-d293f5b3008e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:10.979077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1192f6-930b-4a8f-be99-d293f5b3008e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:10.990127 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1192f6-930b-4a8f-be99-d293f5b3008e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-6e1192f6-930b-4a8f-be99-d293f5b3008e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:53:10.997820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:10.998751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:10.999646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 516/1045] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:53:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:11.004908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1192f6-930b-4a8f-be99-d293f5b3008e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:11.031843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420269f6-626b-45c7-9981-f4749a23d0a7 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:11.066380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d8b8d-23f2-4bc4-9b88-40457de2955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:11.067245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d8b8d-23f2-4bc4-9b88-40457de2955e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:11.067533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d8b8d-23f2-4bc4-9b88-40457de2955e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:11.067807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d8b8d-23f2-4bc4-9b88-40457de2955e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:11.074794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d8b8d-23f2-4bc4-9b88-40457de2955e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:11.076299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d8b8d-23f2-4bc4-9b88-40457de2955e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-f84d8b8d-23f2-4bc4-9b88-40457de2955e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:53:11.090032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:11.091143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:11.092258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:53:11.092258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:53:11.092258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:53:11.092258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:53:11.092258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:53:11.092258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:53:11.092258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:53:11.092258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:11.092258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 530/1046] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:53:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:53:11.096847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d8b8d-23f2-4bc4-9b88-40457de2955e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:11.112428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1192f6-930b-4a8f-be99-d293f5b3008e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:11.148592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8cfcc-2f2f-49b4-995c-9d5a2e64b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:11.149252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8cfcc-2f2f-49b4-995c-9d5a2e64b882 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:11.149531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8cfcc-2f2f-49b4-995c-9d5a2e64b882 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:11.149809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8cfcc-2f2f-49b4-995c-9d5a2e64b882 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:11.150548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8cfcc-2f2f-49b4-995c-9d5a2e64b882 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:11.150853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8cfcc-2f2f-49b4-995c-9d5a2e64b882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:11.152370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8cfcc-2f2f-49b4-995c-9d5a2e64b882 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:11.160204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 517/1047] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:53:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:11.166055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8cfcc-2f2f-49b4-995c-9d5a2e64b882 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:11.183516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:11.204326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d8b8d-23f2-4bc4-9b88-40457de2955e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:11.209272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:11.241851 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d6b5-955e-4a75-a7ba-a0194410e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:11.242802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d6b5-955e-4a75-a7ba-a0194410e943 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:11.242802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d6b5-955e-4a75-a7ba-a0194410e943 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:11.243084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d6b5-955e-4a75-a7ba-a0194410e943 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:11.243862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429d6b5-955e-4a75-a7ba-a0194410e943 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:11.244168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429d6b5-955e-4a75-a7ba-a0194410e943 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:11.245654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429d6b5-955e-4a75-a7ba-a0194410e943 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:11.257242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 531/1048] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:53:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:11.263037 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d6b5-955e-4a75-a7ba-a0194410e943 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:11.268955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8cfcc-2f2f-49b4-995c-9d5a2e64b882 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:11.311942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bf0c4-1aac-48c3-a789-e81490b761f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:11.312971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bf0c4-1aac-48c3-a789-e81490b761f7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:11.313254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bf0c4-1aac-48c3-a789-e81490b761f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:11.313528 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bf0c4-1aac-48c3-a789-e81490b761f7 None admin] PATH_INFO: `/v3/users/84cdde72eb3e4775816e2499526090f6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:11.327274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bf0c4-1aac-48c3-a789-e81490b761f7 None admin] RBAC: Authorizing `identity:get_user(user_id=84cdde72eb3e4775816e2499526090f6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:11.328710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bf0c4-1aac-48c3-a789-e81490b761f7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:11.330703 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 518/1049] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:11 2022] GET /identity/v3/users/84cdde72eb3e4775816e2499526090f6 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:11.335950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bf0c4-1aac-48c3-a789-e81490b761f7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:11.371941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d6b5-955e-4a75-a7ba-a0194410e943 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:11.408387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce773b24-f4a9-4717-a18d-69a68270be19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:11.409051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce773b24-f4a9-4717-a18d-69a68270be19 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:11.409338 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce773b24-f4a9-4717-a18d-69a68270be19 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:11.409618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce773b24-f4a9-4717-a18d-69a68270be19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:11.410445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce773b24-f4a9-4717-a18d-69a68270be19 None admin] RBAC: Adding query filter params (role.id=e8e8025982464049a613a57d9e11f8be, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=24319e5e83ed4caf9dd3ae4b3937b3fb) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:11.410760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce773b24-f4a9-4717-a18d-69a68270be19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:11.412246 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce773b24-f4a9-4717-a18d-69a68270be19 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:11.425675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 532/1050] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:53:11 2022] GET /identity/v3/role_assignments?user.id=24319e5e83ed4caf9dd3ae4b3937b3fb&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=e8e8025982464049a613a57d9e11f8be => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:11.445276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:11.449124 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bf0c4-1aac-48c3-a789-e81490b761f7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:11.489754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1783c-2b35-40a7-bbbd-3e026e3e520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:11.490326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1783c-2b35-40a7-bbbd-3e026e3e520b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:11.490605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1783c-2b35-40a7-bbbd-3e026e3e520b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:11.490877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1783c-2b35-40a7-bbbd-3e026e3e520b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:11.570586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1783c-2b35-40a7-bbbd-3e026e3e520b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:11.572115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1783c-2b35-40a7-bbbd-3e026e3e520b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:11.669459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:11.674466 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 519/1051] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 26 02:53:11.680311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce773b24-f4a9-4717-a18d-69a68270be19 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:11.690078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:11.785757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce773b24-f4a9-4717-a18d-69a68270be19 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:11.819337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ed4af-ff2e-49a2-8162-54b5bbb6d1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:11.820202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ed4af-ff2e-49a2-8162-54b5bbb6d1bf None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:11.820481 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ed4af-ff2e-49a2-8162-54b5bbb6d1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:11.820751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ed4af-ff2e-49a2-8162-54b5bbb6d1bf None admin] PATH_INFO: `/v3/projects/3165cdd92e654009b08887ec4d4d589c` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:11.821912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ed4af-ff2e-49a2-8162-54b5bbb6d1bf None admin] RBAC: Authorizing `identity:get_project(project_id=3165cdd92e654009b08887ec4d4d589c)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:11.823379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ed4af-ff2e-49a2-8162-54b5bbb6d1bf None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:11.830058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 533/1052] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:53:11 2022] GET /identity/v3/projects/3165cdd92e654009b08887ec4d4d589c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:11.831451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1783c-2b35-40a7-bbbd-3e026e3e520b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:11.883884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87674ede-0605-48cb-b4b7-8b4b4ff346d5 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:11.884259 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87674ede-0605-48cb-b4b7-8b4b4ff346d5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:11.884540 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87674ede-0605-48cb-b4b7-8b4b4ff346d5 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:11.886917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 534/1053] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:53:11.893487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a5f2-1e47-4edc-bd98-7ef87acc11d8 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:11.893850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a5f2-1e47-4edc-bd98-7ef87acc11d8 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:11.894137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a5f2-1e47-4edc-bd98-7ef87acc11d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:11.911932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-48e8a5f2-1e47-4edc-bd98-7ef87acc11d8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:11.913119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-48e8a5f2-1e47-4edc-bd98-7ef87acc11d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:11.936628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1783c-2b35-40a7-bbbd-3e026e3e520b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:11.971670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86053bbd-4f93-4088-807a-079f5a868ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:11.972328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053bbd-4f93-4088-807a-079f5a868ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:11.972610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053bbd-4f93-4088-807a-079f5a868ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:11.972881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053bbd-4f93-4088-807a-079f5a868ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:11.973707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86053bbd-4f93-4088-807a-079f5a868ff7 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=3165cdd92e654009b08887ec4d4d589c, user.id=84cdde72eb3e4775816e2499526090f6) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:11.974024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86053bbd-4f93-4088-807a-079f5a868ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:11.975499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86053bbd-4f93-4088-807a-079f5a868ff7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:11.981306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 520/1054] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:53:11 2022] GET /identity/v3/role_assignments?user.id=84cdde72eb3e4775816e2499526090f6&scope.project.id=3165cdd92e654009b08887ec4d4d589c&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:11.983023 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 535/1055] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:53:12.004669 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86053bbd-4f93-4088-807a-079f5a868ff7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:12.078277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:12.120945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86053bbd-4f93-4088-807a-079f5a868ff7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:12.158438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd65d0-03a3-42b6-bcf3-bfcc1cbf655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:12.159267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd65d0-03a3-42b6-bcf3-bfcc1cbf655b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:12.159555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd65d0-03a3-42b6-bcf3-bfcc1cbf655b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:12.159836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd65d0-03a3-42b6-bcf3-bfcc1cbf655b None admin] PATH_INFO: `/v3/services/image` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:12.160496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd65d0-03a3-42b6-bcf3-bfcc1cbf655b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:12.161878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd65d0-03a3-42b6-bcf3-bfcc1cbf655b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-c3cd65d0-03a3-42b6-bcf3-bfcc1cbf655b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:12.173922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:12.174928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:12.176003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 521/1056] 10.222.0.36 () {56 vars in 1105 bytes} [Sun Jun 26 02:53:12 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:12.183450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a5f2-1e47-4edc-bd98-7ef87acc11d8 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:12.187814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:12.290524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a5f2-1e47-4edc-bd98-7ef87acc11d8 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:12.324938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fdc9f-491c-45c8-86e0-19e433d6bc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:12.325613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fdc9f-491c-45c8-86e0-19e433d6bc85 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:12.325897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fdc9f-491c-45c8-86e0-19e433d6bc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:12.326174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fdc9f-491c-45c8-86e0-19e433d6bc85 None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:12.326885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fdc9f-491c-45c8-86e0-19e433d6bc85 None admin] RBAC: Adding query filter params (name=image) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:12.327225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fdc9f-491c-45c8-86e0-19e433d6bc85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:12.328742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fdc9f-491c-45c8-86e0-19e433d6bc85 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:12.333931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 536/1057] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:12.339839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd65d0-03a3-42b6-bcf3-bfcc1cbf655b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:12.443655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd65d0-03a3-42b6-bcf3-bfcc1cbf655b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:12.470752 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:12.481251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb00d-f074-44ea-9f4c-c5f9a3f0e621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:12.481938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb00d-f074-44ea-9f4c-c5f9a3f0e621 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:12.482224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb00d-f074-44ea-9f4c-c5f9a3f0e621 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:12.482508 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb00d-f074-44ea-9f4c-c5f9a3f0e621 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:12.483281 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb00d-f074-44ea-9f4c-c5f9a3f0e621 None admin] RBAC: Adding query filter params (type=image) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:12.483589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb00d-f074-44ea-9f4c-c5f9a3f0e621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:12.484982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb00d-f074-44ea-9f4c-c5f9a3f0e621 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:12.491552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 522/1058] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:12.497630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fdc9f-491c-45c8-86e0-19e433d6bc85 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:12.572972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:12.609602 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fdc9f-491c-45c8-86e0-19e433d6bc85 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:12.645898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fd015-094a-4468-9399-2d274d292694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:12.646563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fd015-094a-4468-9399-2d274d292694 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:12.646842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fd015-094a-4468-9399-2d274d292694 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:12.647155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fd015-094a-4468-9399-2d274d292694 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:12.647887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fd015-094a-4468-9399-2d274d292694 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:12.649284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fd015-094a-4468-9399-2d274d292694 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:12.679017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 537/1059] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Jun 26 02:53:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:53:13.455082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0226b-9880-444e-971b-c5f531c734b3 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:13.455621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0226b-9880-444e-971b-c5f531c734b3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:13.455621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0226b-9880-444e-971b-c5f531c734b3 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:13.457169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 523/1060] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:53:13.462187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662231d3-4e20-4387-b85d-221131eca924 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:13.462560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662231d3-4e20-4387-b85d-221131eca924 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:13.462749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662231d3-4e20-4387-b85d-221131eca924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:13.479739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-662231d3-4e20-4387-b85d-221131eca924 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:13.480668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-662231d3-4e20-4387-b85d-221131eca924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:13.567010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 538/1061] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:13.582979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0226b-9880-444e-971b-c5f531c734b3 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:13.687201 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0226b-9880-444e-971b-c5f531c734b3 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:13.721829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839aaada-0c1e-47e3-9f38-aeb3817cbd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:13.722557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aaada-0c1e-47e3-9f38-aeb3817cbd3c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:13.722834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aaada-0c1e-47e3-9f38-aeb3817cbd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:13.723099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aaada-0c1e-47e3-9f38-aeb3817cbd3c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:13.733868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839aaada-0c1e-47e3-9f38-aeb3817cbd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-839aaada-0c1e-47e3-9f38-aeb3817cbd3c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:53:13.741992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:13.743139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:13.744776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 524/1062] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Jun 26 02:53:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:13.749351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662231d3-4e20-4387-b85d-221131eca924 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:13.803155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:13.857430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662231d3-4e20-4387-b85d-221131eca924 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:13.891090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92e2b9-8910-4f39-96ff-c8cf5b2bfdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:13.891770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92e2b9-8910-4f39-96ff-c8cf5b2bfdeb None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:13.892054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92e2b9-8910-4f39-96ff-c8cf5b2bfdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:13.892331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92e2b9-8910-4f39-96ff-c8cf5b2bfdeb None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:13.893087 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92e2b9-8910-4f39-96ff-c8cf5b2bfdeb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:13.893399 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92e2b9-8910-4f39-96ff-c8cf5b2bfdeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:13.894792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92e2b9-8910-4f39-96ff-c8cf5b2bfdeb None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:13.903321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 539/1063] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Jun 26 02:53:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:13.909062 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839aaada-0c1e-47e3-9f38-aeb3817cbd3c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:13.963602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:13.990583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b98216-244c-4fa8-a7f4-84e8da17a536 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:13.990780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b98216-244c-4fa8-a7f4-84e8da17a536 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:13.991075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b98216-244c-4fa8-a7f4-84e8da17a536 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:13.992559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 540/1064] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:53:13.997530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80c5b-c336-44c5-a8fd-0ccacc08051a None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:13.997821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80c5b-c336-44c5-a8fd-0ccacc08051a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:13.998098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b80c5b-c336-44c5-a8fd-0ccacc08051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.014199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839aaada-0c1e-47e3-9f38-aeb3817cbd3c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:14.015878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-51b80c5b-c336-44c5-a8fd-0ccacc08051a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:14.017056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-51b80c5b-c336-44c5-a8fd-0ccacc08051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:14.050140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fb1cd-ce10-45c1-be73-feccbe088a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:14.050944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fb1cd-ce10-45c1-be73-feccbe088a71 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.051315 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fb1cd-ce10-45c1-be73-feccbe088a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.051594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fb1cd-ce10-45c1-be73-feccbe088a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.061561 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64fb1cd-ce10-45c1-be73-feccbe088a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:14.063055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64fb1cd-ce10-45c1-be73-feccbe088a71 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-a64fb1cd-ce10-45c1-be73-feccbe088a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:53:14.081053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:14.081954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:14.082856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:53:14.082856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:53:14.082856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:14.082856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:14.082856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 525/1065] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:14.088065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fb1cd-ce10-45c1-be73-feccbe088a71 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:14.093060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 541/1066] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:14.115404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b80c5b-c336-44c5-a8fd-0ccacc08051a None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:14.163605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:14.189717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fb1cd-ce10-45c1-be73-feccbe088a71 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:14.192120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:14.225077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b80c5b-c336-44c5-a8fd-0ccacc08051a None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:14.226693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e778a-d187-428a-b1ae-9f2e6c4669f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:14.227398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e778a-d187-428a-b1ae-9f2e6c4669f6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.227677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e778a-d187-428a-b1ae-9f2e6c4669f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.227949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e778a-d187-428a-b1ae-9f2e6c4669f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.228660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e778a-d187-428a-b1ae-9f2e6c4669f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:14.229076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e778a-d187-428a-b1ae-9f2e6c4669f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:14.230655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e778a-d187-428a-b1ae-9f2e6c4669f6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:14.244746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 526/1067] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:14.250162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e778a-d187-428a-b1ae-9f2e6c4669f6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:14.260628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eba4e1-6d0b-45bf-9605-b9149f13ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:14.261512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eba4e1-6d0b-45bf-9605-b9149f13ff5e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.261782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eba4e1-6d0b-45bf-9605-b9149f13ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.262066 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eba4e1-6d0b-45bf-9605-b9149f13ff5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.272771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eba4e1-6d0b-45bf-9605-b9149f13ff5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-85eba4e1-6d0b-45bf-9605-b9149f13ff5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:53:14.280308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:14.281234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:14.282079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 542/1068] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:53:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:53:14.287545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eba4e1-6d0b-45bf-9605-b9149f13ff5e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:14.359223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e778a-d187-428a-b1ae-9f2e6c4669f6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:14.388723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eba4e1-6d0b-45bf-9605-b9149f13ff5e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:14.390727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:14.394270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42e8a1-8a01-46a1-8b51-70c6dbd96345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:14.395104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42e8a1-8a01-46a1-8b51-70c6dbd96345 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.395389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42e8a1-8a01-46a1-8b51-70c6dbd96345 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.395664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42e8a1-8a01-46a1-8b51-70c6dbd96345 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.403708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42e8a1-8a01-46a1-8b51-70c6dbd96345 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:14.405154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42e8a1-8a01-46a1-8b51-70c6dbd96345 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2d42e8a1-8a01-46a1-8b51-70c6dbd96345 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:53:14.419349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:14.420289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:14.421217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:14.421217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:14.421217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:53:14.421217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:53:14.421217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:53:14.421217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:53:14.421217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:53:14.421217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:53:14.421217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:53:14.421217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:14.421217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 527/1069] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Jun 26 02:53:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:53:14.426208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42e8a1-8a01-46a1-8b51-70c6dbd96345 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:14.431216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e9330-dffd-495d-b239-0474dd13717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:14.432056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e9330-dffd-495d-b239-0474dd13717a None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.432476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e9330-dffd-495d-b239-0474dd13717a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.432955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e9330-dffd-495d-b239-0474dd13717a None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.433855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e9330-dffd-495d-b239-0474dd13717a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:14.434297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e9330-dffd-495d-b239-0474dd13717a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:14.436243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e9330-dffd-495d-b239-0474dd13717a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:14.447181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 543/1070] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:53:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:14.451455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:14.453386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e9330-dffd-495d-b239-0474dd13717a None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:14.540890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42e8a1-8a01-46a1-8b51-70c6dbd96345 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:14.562239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e9330-dffd-495d-b239-0474dd13717a None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:14.576860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189154-af90-4f81-9824-e10f8bb376f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:14.577715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189154-af90-4f81-9824-e10f8bb376f9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.578261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189154-af90-4f81-9824-e10f8bb376f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.578669 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189154-af90-4f81-9824-e10f8bb376f9 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.579732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6189154-af90-4f81-9824-e10f8bb376f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:14.580193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6189154-af90-4f81-9824-e10f8bb376f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:14.581879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6189154-af90-4f81-9824-e10f8bb376f9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:14.599279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dccee-8f02-4eed-8606-e3310206c4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:14.600180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dccee-8f02-4eed-8606-e3310206c4ff None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.600460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dccee-8f02-4eed-8606-e3310206c4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.600737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dccee-8f02-4eed-8606-e3310206c4ff None admin] PATH_INFO: `/v3/users/84cdde72eb3e4775816e2499526090f6` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.601362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 528/1071] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Jun 26 02:53:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:14.609174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dccee-8f02-4eed-8606-e3310206c4ff None admin] RBAC: Authorizing `identity:get_user(user_id=84cdde72eb3e4775816e2499526090f6)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:14.609442 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189154-af90-4f81-9824-e10f8bb376f9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:14.610628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dccee-8f02-4eed-8606-e3310206c4ff None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:14.612551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 544/1072] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:14 2022] GET /identity/v3/users/84cdde72eb3e4775816e2499526090f6 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:14.617962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dccee-8f02-4eed-8606-e3310206c4ff None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:14.653395 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:14.701277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:14.721133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189154-af90-4f81-9824-e10f8bb376f9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:14.734346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dccee-8f02-4eed-8606-e3310206c4ff None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:14.754435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712bbcf-83d8-4225-bace-1cccd6b13f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:14.755206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bbcf-83d8-4225-bace-1cccd6b13f91 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.755485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bbcf-83d8-4225-bace-1cccd6b13f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.755754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bbcf-83d8-4225-bace-1cccd6b13f91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.765521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712bbcf-83d8-4225-bace-1cccd6b13f91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:14.766941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05beb88f-9b1c-47e7-89fc-98acf940e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:14.767098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712bbcf-83d8-4225-bace-1cccd6b13f91 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:14.767846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beb88f-9b1c-47e7-89fc-98acf940e344 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.768134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beb88f-9b1c-47e7-89fc-98acf940e344 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.768409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beb88f-9b1c-47e7-89fc-98acf940e344 None admin] PATH_INFO: `/v3/projects/3165cdd92e654009b08887ec4d4d589c` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.769584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05beb88f-9b1c-47e7-89fc-98acf940e344 None admin] RBAC: Authorizing `identity:get_project(project_id=3165cdd92e654009b08887ec4d4d589c)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:14.771037 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05beb88f-9b1c-47e7-89fc-98acf940e344 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:14.772738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 545/1073] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:53:14 2022] GET /identity/v3/projects/3165cdd92e654009b08887ec4d4d589c => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:14.773896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabc340-4a98-4a92-b58f-802ceae91e78 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.774177 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabc340-4a98-4a92-b58f-802ceae91e78 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.774455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabc340-4a98-4a92-b58f-802ceae91e78 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.775856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 546/1074] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:14.778539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabc340-4a98-4a92-b58f-802ceae91e78 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2712bbcf-83d8-4225-bace-1cccd6b13f91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:53:14.784793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:14.785858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:14.787093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:53:14.787093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:53:14.787093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:14.787093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:14.791464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 529/1075] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:53:14.792482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb63b-1ac7-4f27-b97c-12f4c6e78c22 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.792766 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb63b-1ac7-4f27-b97c-12f4c6e78c22 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.793042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb63b-1ac7-4f27-b97c-12f4c6e78c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.810025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-bd8eb63b-1ac7-4f27-b97c-12f4c6e78c22 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:14.811252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-bd8eb63b-1ac7-4f27-b97c-12f4c6e78c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:14.873502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:14.877639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 530/1076] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:14.878335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eb63b-1ac7-4f27-b97c-12f4c6e78c22 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:14.878620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabc340-4a98-4a92-b58f-802ceae91e78 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:14.913861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fa9ff-c60c-4c64-97cd-ecdff4588642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:14.914757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fa9ff-c60c-4c64-97cd-ecdff4588642 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:14.915430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fa9ff-c60c-4c64-97cd-ecdff4588642 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:14.915709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fa9ff-c60c-4c64-97cd-ecdff4588642 None admin] PATH_INFO: `/v3/projects/3165cdd92e654009b08887ec4d4d589c/users/84cdde72eb3e4775816e2499526090f6/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:14.917767 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fa9ff-c60c-4c64-97cd-ecdff4588642 None admin] RBAC: Authorizing `identity:create_grant(project_id=3165cdd92e654009b08887ec4d4d589c, user_id=84cdde72eb3e4775816e2499526090f6, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:14.919241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fa9ff-c60c-4c64-97cd-ecdff4588642 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:14.932243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 547/1077] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:53:14 2022] PUT /identity/v3/projects/3165cdd92e654009b08887ec4d4d589c/users/84cdde72eb3e4775816e2499526090f6/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 02:53:14.933056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fa9ff-c60c-4c64-97cd-ecdff4588642 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:14.948522 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:14.998133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eb63b-1ac7-4f27-b97c-12f4c6e78c22 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:15.039121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6de47-0bc8-42b7-a667-25788173f8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:15.040482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6de47-0bc8-42b7-a667-25788173f8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:15.040763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6de47-0bc8-42b7-a667-25788173f8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:15.041040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6de47-0bc8-42b7-a667-25788173f8c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:15.041775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6de47-0bc8-42b7-a667-25788173f8c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:15.042169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6de47-0bc8-42b7-a667-25788173f8c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:15.043657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6de47-0bc8-42b7-a667-25788173f8c0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:15.060639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 531/1078] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:15.060848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fa9ff-c60c-4c64-97cd-ecdff4588642 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:15.062213 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6de47-0bc8-42b7-a667-25788173f8c0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:15.102101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a7353-6873-4396-9fce-1be5b1ef235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:15.102888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a7353-6873-4396-9fce-1be5b1ef235e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:15.103195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a7353-6873-4396-9fce-1be5b1ef235e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:15.103490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a7353-6873-4396-9fce-1be5b1ef235e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:15.133729 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:15.174239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6de47-0bc8-42b7-a667-25788173f8c0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:15.180529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a7353-6873-4396-9fce-1be5b1ef235e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:15.182006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a7353-6873-4396-9fce-1be5b1ef235e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:15.198723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:15.210737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19b452-f13f-4832-bb6a-fcd8f805bf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:15.211570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b452-f13f-4832-bb6a-fcd8f805bf4c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:15.211853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b452-f13f-4832-bb6a-fcd8f805bf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:15.212124 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b452-f13f-4832-bb6a-fcd8f805bf4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:15.218934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19b452-f13f-4832-bb6a-fcd8f805bf4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:15.220411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19b452-f13f-4832-bb6a-fcd8f805bf4c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-ea19b452-f13f-4832-bb6a-fcd8f805bf4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:53:15.234671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:15.235922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:15.237318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:53:15.237318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:53:15.237318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:53:15.237318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:53:15.237318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:53:15.237318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:53:15.237318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:53:15.237318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:15.237318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 532/1079] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:53:15.241715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19b452-f13f-4832-bb6a-fcd8f805bf4c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:15.292571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 548/1080] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:53:15.293394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a7353-6873-4396-9fce-1be5b1ef235e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:15.341854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19b452-f13f-4832-bb6a-fcd8f805bf4c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:15.352840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:15.381244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c7e8a-ead4-42e4-80eb-5c5a5bb5a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:15.381914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c7e8a-ead4-42e4-80eb-5c5a5bb5a256 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:15.382202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c7e8a-ead4-42e4-80eb-5c5a5bb5a256 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:15.382477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c7e8a-ead4-42e4-80eb-5c5a5bb5a256 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:15.383294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c7e8a-ead4-42e4-80eb-5c5a5bb5a256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:15.383600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c7e8a-ead4-42e4-80eb-5c5a5bb5a256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:15.385037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c7e8a-ead4-42e4-80eb-5c5a5bb5a256 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:15.397385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a7353-6873-4396-9fce-1be5b1ef235e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:15.399311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 533/1081] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:15.402759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c7e8a-ead4-42e4-80eb-5c5a5bb5a256 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:15.432990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f4dfb-57ca-4b59-b65f-cbd12d0e3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:15.433791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f4dfb-57ca-4b59-b65f-cbd12d0e3aee None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:15.434072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f4dfb-57ca-4b59-b65f-cbd12d0e3aee None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:15.434350 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f4dfb-57ca-4b59-b65f-cbd12d0e3aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:15.445160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f4dfb-57ca-4b59-b65f-cbd12d0e3aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:15.446623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f4dfb-57ca-4b59-b65f-cbd12d0e3aee None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:15.449500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-543f4dfb-57ca-4b59-b65f-cbd12d0e3aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:53:15.465700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:15.466622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:15.467821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:53:15.467821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:53:15.467821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:15.467821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:15.467821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 549/1082] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:15.472728 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f4dfb-57ca-4b59-b65f-cbd12d0e3aee None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:15.511415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c7e8a-ead4-42e4-80eb-5c5a5bb5a256 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:15.545415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585504e2-09a4-45e5-8120-3293f110d1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:15.546228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585504e2-09a4-45e5-8120-3293f110d1f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:15.546507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585504e2-09a4-45e5-8120-3293f110d1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:15.546785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585504e2-09a4-45e5-8120-3293f110d1f3 None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/24319e5e83ed4caf9dd3ae4b3937b3fb/roles/e8e8025982464049a613a57d9e11f8be` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:15.549024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585504e2-09a4-45e5-8120-3293f110d1f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=24319e5e83ed4caf9dd3ae4b3937b3fb, role_id=e8e8025982464049a613a57d9e11f8be)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:15.550467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585504e2-09a4-45e5-8120-3293f110d1f3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:15.567714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 534/1083] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:53:15 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/24319e5e83ed4caf9dd3ae4b3937b3fb/roles/e8e8025982464049a613a57d9e11f8be => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 02:53:15.581579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f4dfb-57ca-4b59-b65f-cbd12d0e3aee None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:15.597226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:15.621733 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d4f6e-b898-4172-8526-04ed6269a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:15.622612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d4f6e-b898-4172-8526-04ed6269a65e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:15.623016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d4f6e-b898-4172-8526-04ed6269a65e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:15.623293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d4f6e-b898-4172-8526-04ed6269a65e None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:15.624076 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d4f6e-b898-4172-8526-04ed6269a65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:15.624385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d4f6e-b898-4172-8526-04ed6269a65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:15.625826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d4f6e-b898-4172-8526-04ed6269a65e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:15.646733 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 550/1084] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:16.943087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09873-587b-4632-b33d-88d1565ba012 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:16.945996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09873-587b-4632-b33d-88d1565ba012 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:16.945996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d09873-587b-4632-b33d-88d1565ba012 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:16.945996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 535/1085] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:16.950597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c5baf-b5c4-4427-a629-61b36703a344 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:16.951101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c5baf-b5c4-4427-a629-61b36703a344 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:16.951209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c5baf-b5c4-4427-a629-61b36703a344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:16.968943 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-951c5baf-b5c4-4427-a629-61b36703a344 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:16.970127 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-951c5baf-b5c4-4427-a629-61b36703a344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:17.037895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 551/1086] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:17.061993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d09873-587b-4632-b33d-88d1565ba012 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:17.165470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d09873-587b-4632-b33d-88d1565ba012 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:17.167877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:17.201739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1c9ce-ab8c-4318-9bfc-81ac1d62c0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:17.202453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1c9ce-ab8c-4318-9bfc-81ac1d62c0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:17.202736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1c9ce-ab8c-4318-9bfc-81ac1d62c0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:17.203027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1c9ce-ab8c-4318-9bfc-81ac1d62c0d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:17.213286 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1c9ce-ab8c-4318-9bfc-81ac1d62c0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-06e1c9ce-ab8c-4318-9bfc-81ac1d62c0d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:53:17.220947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:17.221980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:17.222951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 536/1087] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:53:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:17.228249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c5baf-b5c4-4427-a629-61b36703a344 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:17.332488 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c5baf-b5c4-4427-a629-61b36703a344 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:17.333994 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:17.369027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaaeba-60d9-4014-b2b1-ea718aa2bfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:17.369696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaaeba-60d9-4014-b2b1-ea718aa2bfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:17.369958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaaeba-60d9-4014-b2b1-ea718aa2bfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:17.370273 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaaeba-60d9-4014-b2b1-ea718aa2bfd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:17.371034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaaeba-60d9-4014-b2b1-ea718aa2bfd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:17.371445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaaeba-60d9-4014-b2b1-ea718aa2bfd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:17.375317 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faaaeba-60d9-4014-b2b1-ea718aa2bfd8 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:17.383098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 552/1088] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:53:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:17.389030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1c9ce-ab8c-4318-9bfc-81ac1d62c0d2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:17.490784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1c9ce-ab8c-4318-9bfc-81ac1d62c0d2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:17.526708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5084199-6260-4f2e-89a0-f977d991c123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:17.527612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084199-6260-4f2e-89a0-f977d991c123 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:17.527889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084199-6260-4f2e-89a0-f977d991c123 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:17.528161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084199-6260-4f2e-89a0-f977d991c123 None admin] PATH_INFO: `/v3/users/84cdde72eb3e4775816e2499526090f6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:17.529370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5084199-6260-4f2e-89a0-f977d991c123 None admin] RBAC: Authorizing `identity:get_user(user_id=84cdde72eb3e4775816e2499526090f6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:17.530797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5084199-6260-4f2e-89a0-f977d991c123 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:17.532690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 537/1089] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:17 2022] GET /identity/v3/users/84cdde72eb3e4775816e2499526090f6 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:17.538272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaaeba-60d9-4014-b2b1-ea718aa2bfd8 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:17.582674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f352ad4-f825-483f-a87b-9822a41df85e None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:17.582927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f352ad4-f825-483f-a87b-9822a41df85e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:17.583257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f352ad4-f825-483f-a87b-9822a41df85e None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:17.584620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 538/1090] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:17.590271 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62505944-9b3b-440f-97d1-7c51bd0eeefc None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:17.590560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62505944-9b3b-440f-97d1-7c51bd0eeefc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:17.590841 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62505944-9b3b-440f-97d1-7c51bd0eeefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:17.608534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-62505944-9b3b-440f-97d1-7c51bd0eeefc None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:17.609741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-62505944-9b3b-440f-97d1-7c51bd0eeefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:17.637037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:17.643231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaaeba-60d9-4014-b2b1-ea718aa2bfd8 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:17.675823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706e3c9-69c7-46c7-99d9-7b074796b98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:17.676475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706e3c9-69c7-46c7-99d9-7b074796b98b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:17.676760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706e3c9-69c7-46c7-99d9-7b074796b98b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:17.677038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706e3c9-69c7-46c7-99d9-7b074796b98b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:17.679744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 539/1091] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:17.707446 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62505944-9b3b-440f-97d1-7c51bd0eeefc None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:17.710725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:17.754176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706e3c9-69c7-46c7-99d9-7b074796b98b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:17.755669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706e3c9-69c7-46c7-99d9-7b074796b98b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:17.814979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62505944-9b3b-440f-97d1-7c51bd0eeefc None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:17.848236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c0a70-c37b-4916-a610-e6defc7ea4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:17.849046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c0a70-c37b-4916-a610-e6defc7ea4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:17.849321 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c0a70-c37b-4916-a610-e6defc7ea4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:17.849597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c0a70-c37b-4916-a610-e6defc7ea4d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:17.851582 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 553/1092] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:53:17.857512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706e3c9-69c7-46c7-99d9-7b074796b98b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:17.864482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c0a70-c37b-4916-a610-e6defc7ea4d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-905c0a70-c37b-4916-a610-e6defc7ea4d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:53:17.872571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:17.873505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 26 02:53:17.874340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:17.878658 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 540/1093] 10.222.0.36 () {56 vars in 1120 bytes} [Sun Jun 26 02:53:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:17.879549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c0a70-c37b-4916-a610-e6defc7ea4d8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:17.903306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:17.917352 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:17.954855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706e3c9-69c7-46c7-99d9-7b074796b98b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:17.978119 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c0a70-c37b-4916-a610-e6defc7ea4d8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:17.988661 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c6a8-c507-4e94-8f1f-ab4c1bfeb4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:17.989517 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c6a8-c507-4e94-8f1f-ab4c1bfeb4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:17.989793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c6a8-c507-4e94-8f1f-ab4c1bfeb4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:17.990069 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591c6a8-c507-4e94-8f1f-ab4c1bfeb4d4 None admin] PATH_INFO: `/v3/projects/3165cdd92e654009b08887ec4d4d589c` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:17.991252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591c6a8-c507-4e94-8f1f-ab4c1bfeb4d4 None admin] RBAC: Authorizing `identity:get_project(project_id=3165cdd92e654009b08887ec4d4d589c)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:17.992691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591c6a8-c507-4e94-8f1f-ab4c1bfeb4d4 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:17.994377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 554/1094] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:53:17 2022] GET /identity/v3/projects/3165cdd92e654009b08887ec4d4d589c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:18.000378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c6a8-c507-4e94-8f1f-ab4c1bfeb4d4 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:18.013984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ef04-d520-4dbc-83f1-5fdbaf1cd889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:18.014555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ef04-d520-4dbc-83f1-5fdbaf1cd889 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:18.014940 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ef04-d520-4dbc-83f1-5fdbaf1cd889 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:18.015168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ef04-d520-4dbc-83f1-5fdbaf1cd889 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:18.015859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0ef04-d520-4dbc-83f1-5fdbaf1cd889 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:18.016168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0ef04-d520-4dbc-83f1-5fdbaf1cd889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:18.017559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0ef04-d520-4dbc-83f1-5fdbaf1cd889 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:18.026071 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 541/1095] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Jun 26 02:53:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:18.031955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ef04-d520-4dbc-83f1-5fdbaf1cd889 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:18.105015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591c6a8-c507-4e94-8f1f-ab4c1bfeb4d4 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:18.120589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:18.133247 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:18.137816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ef04-d520-4dbc-83f1-5fdbaf1cd889 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:18.138622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25b311-b3de-4e2f-b807-71b2c58772a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:18.139325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25b311-b3de-4e2f-b807-71b2c58772a2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:18.139609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25b311-b3de-4e2f-b807-71b2c58772a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:18.139886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25b311-b3de-4e2f-b807-71b2c58772a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:18.140747 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25b311-b3de-4e2f-b807-71b2c58772a2 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=3165cdd92e654009b08887ec4d4d589c, user.id=84cdde72eb3e4775816e2499526090f6) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:18.141043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25b311-b3de-4e2f-b807-71b2c58772a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:18.142486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25b311-b3de-4e2f-b807-71b2c58772a2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:18.148460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 555/1096] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:53:17 2022] GET /identity/v3/role_assignments?user.id=84cdde72eb3e4775816e2499526090f6&scope.project.id=3165cdd92e654009b08887ec4d4d589c&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:18.173475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02f6aa-aa09-4911-8b88-848bbb811b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:18.174311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f6aa-aa09-4911-8b88-848bbb811b81 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:18.174599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f6aa-aa09-4911-8b88-848bbb811b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:18.174878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f6aa-aa09-4911-8b88-848bbb811b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:18.188127 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02f6aa-aa09-4911-8b88-848bbb811b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:18.189615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02f6aa-aa09-4911-8b88-848bbb811b81 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-3a02f6aa-aa09-4911-8b88-848bbb811b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:53:18.208010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:18.209005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:18.209893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:53:18.209893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:53:18.209893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:18.209893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:18.209893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 542/1097] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:53:18.215668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25b311-b3de-4e2f-b807-71b2c58772a2 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:18.322777 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25b311-b3de-4e2f-b807-71b2c58772a2 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:18.358450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e0ee4-4c05-42ed-bec8-a2156950fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:18.359142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e0ee4-4c05-42ed-bec8-a2156950fd6f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:18.359425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e0ee4-4c05-42ed-bec8-a2156950fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:18.359705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e0ee4-4c05-42ed-bec8-a2156950fd6f None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:18.360425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e0ee4-4c05-42ed-bec8-a2156950fd6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:18.360732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e0ee4-4c05-42ed-bec8-a2156950fd6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:18.362118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e0ee4-4c05-42ed-bec8-a2156950fd6f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:18.374240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 556/1098] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:18.379990 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02f6aa-aa09-4911-8b88-848bbb811b81 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:18.482198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02f6aa-aa09-4911-8b88-848bbb811b81 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:18.517877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817621d-3f3a-40e5-9583-54b595acc0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:18.518675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817621d-3f3a-40e5-9583-54b595acc0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:18.518963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817621d-3f3a-40e5-9583-54b595acc0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:18.519287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817621d-3f3a-40e5-9583-54b595acc0a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:18.522216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:18.527536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817621d-3f3a-40e5-9583-54b595acc0a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:18.529532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817621d-3f3a-40e5-9583-54b595acc0a1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9817621d-3f3a-40e5-9583-54b595acc0a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:53:18.544308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:18.545393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:18.546354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:18.546354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:18.546354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:53:18.546354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:53:18.546354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:53:18.546354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:53:18.546354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:53:18.546354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:53:18.546354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 26 02:53:18.546354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:18.546354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 543/1099] 10.222.0.36 () {56 vars in 1093 bytes} [Sun Jun 26 02:53:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:18.551693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e0ee4-4c05-42ed-bec8-a2156950fd6f None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:18.611929 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:18.656489 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e0ee4-4c05-42ed-bec8-a2156950fd6f None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:18.691167 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d0288-7a63-4bb7-ae99-369c961c066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:18.691833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d0288-7a63-4bb7-ae99-369c961c066b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:18.692115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d0288-7a63-4bb7-ae99-369c961c066b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:18.692372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d0288-7a63-4bb7-ae99-369c961c066b None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:18.693207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d0288-7a63-4bb7-ae99-369c961c066b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:18.693512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d0288-7a63-4bb7-ae99-369c961c066b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:18.694957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d0288-7a63-4bb7-ae99-369c961c066b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:18.712387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 557/1100] 10.222.0.36 () {56 vars in 1133 bytes} [Sun Jun 26 02:53:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:18.718420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817621d-3f3a-40e5-9583-54b595acc0a1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:18.817845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817621d-3f3a-40e5-9583-54b595acc0a1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:18.850638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6dddd-2031-4334-b1a8-9cefd742a31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:18.851313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6dddd-2031-4334-b1a8-9cefd742a31e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:18.851592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6dddd-2031-4334-b1a8-9cefd742a31e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:18.851868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6dddd-2031-4334-b1a8-9cefd742a31e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:18.911094 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:18.918580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6dddd-2031-4334-b1a8-9cefd742a31e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:18.920091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6dddd-2031-4334-b1a8-9cefd742a31e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:19.018421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 544/1101] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:53:19.024319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d0288-7a63-4bb7-ae99-369c961c066b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:19.122828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d0288-7a63-4bb7-ae99-369c961c066b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:19.136993 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:19.158766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5a38a-ff0d-4fc6-b707-f6793b966981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:19.159590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5a38a-ff0d-4fc6-b707-f6793b966981 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:19.159856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5a38a-ff0d-4fc6-b707-f6793b966981 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:19.160133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5a38a-ff0d-4fc6-b707-f6793b966981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:19.170794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5a38a-ff0d-4fc6-b707-f6793b966981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:19.172224 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5a38a-ff0d-4fc6-b707-f6793b966981 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-f2b5a38a-ff0d-4fc6-b707-f6793b966981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:53:19.189545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:19.190614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:19.191549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:53:19.191549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:53:19.191549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:53:19.191549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:19.191549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 558/1102] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:19.196631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6dddd-2031-4334-b1a8-9cefd742a31e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:19.297717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:19.303770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6dddd-2031-4334-b1a8-9cefd742a31e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:19.338373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeb85b-a929-4083-9383-f839cc6330ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:19.339086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb85b-a929-4083-9383-f839cc6330ff None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:19.339366 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb85b-a929-4083-9383-f839cc6330ff None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:19.339644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb85b-a929-4083-9383-f839cc6330ff None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:19.340364 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeb85b-a929-4083-9383-f839cc6330ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:19.340665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeb85b-a929-4083-9383-f839cc6330ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:19.342042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeb85b-a929-4083-9383-f839cc6330ff None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:19.353232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 545/1103] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:19.361263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5a38a-ff0d-4fc6-b707-f6793b966981 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:19.467099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5a38a-ff0d-4fc6-b707-f6793b966981 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:19.504143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cdaa6-eac6-43ed-9aa1-5bd488afaef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:19.504944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cdaa6-eac6-43ed-9aa1-5bd488afaef0 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:19.505231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cdaa6-eac6-43ed-9aa1-5bd488afaef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:19.505507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cdaa6-eac6-43ed-9aa1-5bd488afaef0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:19.512348 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cdaa6-eac6-43ed-9aa1-5bd488afaef0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:19.513801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cdaa6-eac6-43ed-9aa1-5bd488afaef0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-8a6cdaa6-eac6-43ed-9aa1-5bd488afaef0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:53:19.527404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:19.528339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:19.529252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:53:19.529252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:53:19.529252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:53:19.529252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:53:19.529252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:53:19.529252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:53:19.529252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:53:19.529252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:19.529252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 559/1104] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:19.534753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeb85b-a929-4083-9383-f839cc6330ff None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:19.639979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeb85b-a929-4083-9383-f839cc6330ff None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:19.674568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27db32-9676-4a02-9631-a8fb6d8a0e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:19.675251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27db32-9676-4a02-9631-a8fb6d8a0e26 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:19.676147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27db32-9676-4a02-9631-a8fb6d8a0e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:19.676429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27db32-9676-4a02-9631-a8fb6d8a0e26 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:19.677202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27db32-9676-4a02-9631-a8fb6d8a0e26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:19.677510 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27db32-9676-4a02-9631-a8fb6d8a0e26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:19.678942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27db32-9676-4a02-9631-a8fb6d8a0e26 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:19.699844 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 546/1105] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:53:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:19.706054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cdaa6-eac6-43ed-9aa1-5bd488afaef0 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:19.735474 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:19.810551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cdaa6-eac6-43ed-9aa1-5bd488afaef0 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:19.847242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d32d21-a132-401c-87ca-d40dc5751567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:19.847897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d32d21-a132-401c-87ca-d40dc5751567 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:19.848176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d32d21-a132-401c-87ca-d40dc5751567 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:19.848447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d32d21-a132-401c-87ca-d40dc5751567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:19.849275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d32d21-a132-401c-87ca-d40dc5751567 None admin] RBAC: Adding query filter params (role.id=e8e8025982464049a613a57d9e11f8be, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=24319e5e83ed4caf9dd3ae4b3937b3fb) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:19.849586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d32d21-a132-401c-87ca-d40dc5751567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:19.851029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d32d21-a132-401c-87ca-d40dc5751567 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:19.857324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 560/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:53:19 2022] GET /identity/v3/role_assignments?user.id=24319e5e83ed4caf9dd3ae4b3937b3fb&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=e8e8025982464049a613a57d9e11f8be => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:20.180799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46633820-a2e8-4d54-9f9b-7f3b080e2c45 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:20.181321 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46633820-a2e8-4d54-9f9b-7f3b080e2c45 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:20.181428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46633820-a2e8-4d54-9f9b-7f3b080e2c45 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:20.182773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 547/1107] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:20.188156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b53e-559f-42c1-bd6c-8a2deefa42f1 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:20.188591 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b53e-559f-42c1-bd6c-8a2deefa42f1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:20.188706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b53e-559f-42c1-bd6c-8a2deefa42f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:20.206827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ea78b53e-559f-42c1-bd6c-8a2deefa42f1 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:20.208089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ea78b53e-559f-42c1-bd6c-8a2deefa42f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:20.279196 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 561/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:20.304482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46633820-a2e8-4d54-9f9b-7f3b080e2c45 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:20.323130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:20.408701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46633820-a2e8-4d54-9f9b-7f3b080e2c45 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:20.443471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eeb4e-4227-497c-aaad-893f837e33b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:20.444207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eeb4e-4227-497c-aaad-893f837e33b0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:20.444525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eeb4e-4227-497c-aaad-893f837e33b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:20.444801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eeb4e-4227-497c-aaad-893f837e33b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:20.445991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3eeb4e-4227-497c-aaad-893f837e33b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:20.447468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3eeb4e-4227-497c-aaad-893f837e33b0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:20.449133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 548/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:20.455997 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b53e-559f-42c1-bd6c-8a2deefa42f1 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:20.477294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:20.557885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b53e-559f-42c1-bd6c-8a2deefa42f1 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:20.591651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d56db-3c47-4b4d-b223-19afe1da471a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:20.592327 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d56db-3c47-4b4d-b223-19afe1da471a None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:20.592609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d56db-3c47-4b4d-b223-19afe1da471a None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:20.592884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d56db-3c47-4b4d-b223-19afe1da471a None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:20.593590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d56db-3c47-4b4d-b223-19afe1da471a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:20.595079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d56db-3c47-4b4d-b223-19afe1da471a None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:20.615084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 562/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:53:20 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 02:53:22.647941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad322d18-f104-49f1-8336-c5a48e3947d0 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:22.648775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad322d18-f104-49f1-8336-c5a48e3947d0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:22.648775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad322d18-f104-49f1-8336-c5a48e3947d0 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:22.651174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 549/1111] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:22.656869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb0af9-d35a-4312-8f55-a8c2504c2e92 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:22.657298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb0af9-d35a-4312-8f55-a8c2504c2e92 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:22.657404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb0af9-d35a-4312-8f55-a8c2504c2e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:22.676957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ebdb0af9-d35a-4312-8f55-a8c2504c2e92 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:22.678148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ebdb0af9-d35a-4312-8f55-a8c2504c2e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:22.748286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 563/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:22.771929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad322d18-f104-49f1-8336-c5a48e3947d0 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:22.858467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:22.878582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad322d18-f104-49f1-8336-c5a48e3947d0 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:22.914065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63625bd-308f-49e3-a64b-d27c794884e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:22.915295 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63625bd-308f-49e3-a64b-d27c794884e1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:22.915573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63625bd-308f-49e3-a64b-d27c794884e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:22.915848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63625bd-308f-49e3-a64b-d27c794884e1 None admin] PATH_INFO: `/v3/roles/c81f6283cf3a418bad94b56a1e9ea2b3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:22.917455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63625bd-308f-49e3-a64b-d27c794884e1 None admin] RBAC: Authorizing `identity:get_role(role_id=c81f6283cf3a418bad94b56a1e9ea2b3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:22.918832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63625bd-308f-49e3-a64b-d27c794884e1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:22.920237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 550/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:22 2022] GET /identity/v3/roles/c81f6283cf3a418bad94b56a1e9ea2b3 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:22.926108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb0af9-d35a-4312-8f55-a8c2504c2e92 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:22.934735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:23.034334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb0af9-d35a-4312-8f55-a8c2504c2e92 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:23.069483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23a70f-94dd-4fd8-8c13-665e7700950d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:23.070358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23a70f-94dd-4fd8-8c13-665e7700950d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:23.070635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23a70f-94dd-4fd8-8c13-665e7700950d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:23.070904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23a70f-94dd-4fd8-8c13-665e7700950d None admin] PATH_INFO: `/v3/users/efaad6fc47914643b048c2791c92d679` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:23.084110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23a70f-94dd-4fd8-8c13-665e7700950d None admin] RBAC: Authorizing `identity:get_user(user_id=efaad6fc47914643b048c2791c92d679)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:23.085551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23a70f-94dd-4fd8-8c13-665e7700950d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:23.087210 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 564/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:22 2022] GET /identity/v3/users/efaad6fc47914643b048c2791c92d679 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:23.096549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63625bd-308f-49e3-a64b-d27c794884e1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:23.198068 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63625bd-308f-49e3-a64b-d27c794884e1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:23.232749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3373519-5051-45e8-8922-b03181909b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:23.233418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3373519-5051-45e8-8922-b03181909b11 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:23.233700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3373519-5051-45e8-8922-b03181909b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:23.234018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3373519-5051-45e8-8922-b03181909b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:23.263286 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:23.307653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3373519-5051-45e8-8922-b03181909b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:23.309042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3373519-5051-45e8-8922-b03181909b11 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:23.408089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 551/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:53:23.415163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23a70f-94dd-4fd8-8c13-665e7700950d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:23.485345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:23.523329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23a70f-94dd-4fd8-8c13-665e7700950d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:23.559849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7b6d5-4e3e-4928-ac76-7009f61f4a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:23.560649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b6d5-4e3e-4928-ac76-7009f61f4a78 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:23.560931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b6d5-4e3e-4928-ac76-7009f61f4a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:23.561209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b6d5-4e3e-4928-ac76-7009f61f4a78 None admin] PATH_INFO: `/v3/projects/3165cdd92e654009b08887ec4d4d589c` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:23.562407 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7b6d5-4e3e-4928-ac76-7009f61f4a78 None admin] RBAC: Authorizing `identity:get_project(project_id=3165cdd92e654009b08887ec4d4d589c)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:23.563895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7b6d5-4e3e-4928-ac76-7009f61f4a78 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:23.565605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 565/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:53:23 2022] GET /identity/v3/projects/3165cdd92e654009b08887ec4d4d589c => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:23.571986 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3373519-5051-45e8-8922-b03181909b11 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:23.625081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:23.673374 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3373519-5051-45e8-8922-b03181909b11 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:23.709529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef520c-386e-41c5-90a7-c37a5b34b858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:23.710176 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef520c-386e-41c5-90a7-c37a5b34b858 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:23.710470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef520c-386e-41c5-90a7-c37a5b34b858 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:23.710740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef520c-386e-41c5-90a7-c37a5b34b858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:23.711609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef520c-386e-41c5-90a7-c37a5b34b858 None admin] RBAC: Adding query filter params (role.id=c81f6283cf3a418bad94b56a1e9ea2b3, scope.project.id=3165cdd92e654009b08887ec4d4d589c, user.id=efaad6fc47914643b048c2791c92d679) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:23.711922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef520c-386e-41c5-90a7-c37a5b34b858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:23.713363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef520c-386e-41c5-90a7-c37a5b34b858 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:23.718968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 552/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:53:23 2022] GET /identity/v3/role_assignments?user.id=efaad6fc47914643b048c2791c92d679&scope.project.id=3165cdd92e654009b08887ec4d4d589c&role.id=c81f6283cf3a418bad94b56a1e9ea2b3 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:25.696696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7562486-3ae3-4093-a431-4261d9f789bb None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:25.697272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7562486-3ae3-4093-a431-4261d9f789bb None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:25.697272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7562486-3ae3-4093-a431-4261d9f789bb None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:25.698667 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 566/1118] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:25.707832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed108-036f-45f5-bf58-01b9bfd31add None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:25.708530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed108-036f-45f5-bf58-01b9bfd31add None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:25.708712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed108-036f-45f5-bf58-01b9bfd31add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:25.728420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-555ed108-036f-45f5-bf58-01b9bfd31add None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:25.729620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-555ed108-036f-45f5-bf58-01b9bfd31add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:25.798277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 553/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:25.821195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7562486-3ae3-4093-a431-4261d9f789bb None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:25.934973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7562486-3ae3-4093-a431-4261d9f789bb None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:25.966489 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:25.975378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3382865-c91b-487a-a885-dc85fb8e99f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:25.976643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3382865-c91b-487a-a885-dc85fb8e99f4 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:25.977015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3382865-c91b-487a-a885-dc85fb8e99f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:25.977397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3382865-c91b-487a-a885-dc85fb8e99f4 None admin] PATH_INFO: `/v3/roles/c81f6283cf3a418bad94b56a1e9ea2b3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:25.979557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3382865-c91b-487a-a885-dc85fb8e99f4 None admin] RBAC: Authorizing `identity:get_role(role_id=c81f6283cf3a418bad94b56a1e9ea2b3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:25.980948 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3382865-c91b-487a-a885-dc85fb8e99f4 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:25.982320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 567/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:25 2022] GET /identity/v3/roles/c81f6283cf3a418bad94b56a1e9ea2b3 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:25.988287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ed108-036f-45f5-bf58-01b9bfd31add None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:26.035559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:26.100601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ed108-036f-45f5-bf58-01b9bfd31add None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:26.135388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2056bdd-6a2e-429d-9f93-51379176ed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:26.136279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2056bdd-6a2e-429d-9f93-51379176ed45 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:26.136558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2056bdd-6a2e-429d-9f93-51379176ed45 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:26.136837 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2056bdd-6a2e-429d-9f93-51379176ed45 None admin] PATH_INFO: `/v3/users/efaad6fc47914643b048c2791c92d679` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:26.138054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2056bdd-6a2e-429d-9f93-51379176ed45 None admin] RBAC: Authorizing `identity:get_user(user_id=efaad6fc47914643b048c2791c92d679)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:26.139535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2056bdd-6a2e-429d-9f93-51379176ed45 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:26.141179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 554/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:25 2022] GET /identity/v3/users/efaad6fc47914643b048c2791c92d679 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:26.150041 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3382865-c91b-487a-a885-dc85fb8e99f4 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:26.261938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3382865-c91b-487a-a885-dc85fb8e99f4 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:26.302079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f0b9c-5ad6-4234-8aa8-cddc88dbd739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:26.302930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0b9c-5ad6-4234-8aa8-cddc88dbd739 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:26.303234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0b9c-5ad6-4234-8aa8-cddc88dbd739 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:26.303504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0b9c-5ad6-4234-8aa8-cddc88dbd739 None admin] PATH_INFO: `/v3/projects/3165cdd92e654009b08887ec4d4d589c` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:26.304816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f0b9c-5ad6-4234-8aa8-cddc88dbd739 None admin] RBAC: Authorizing `identity:get_project(project_id=3165cdd92e654009b08887ec4d4d589c)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:26.306261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f0b9c-5ad6-4234-8aa8-cddc88dbd739 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:26.307988 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 568/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:53:26 2022] GET /identity/v3/projects/3165cdd92e654009b08887ec4d4d589c => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:26.314248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2056bdd-6a2e-429d-9f93-51379176ed45 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:26.414129 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2056bdd-6a2e-429d-9f93-51379176ed45 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:26.428322 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:26.450882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e9346-6c61-4d5e-baa4-ececd797537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:26.451825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9346-6c61-4d5e-baa4-ececd797537a None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:26.452108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9346-6c61-4d5e-baa4-ececd797537a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:26.452386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9346-6c61-4d5e-baa4-ececd797537a None admin] PATH_INFO: `/v3/projects/3165cdd92e654009b08887ec4d4d589c/users/efaad6fc47914643b048c2791c92d679/roles/c81f6283cf3a418bad94b56a1e9ea2b3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:26.454781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e9346-6c61-4d5e-baa4-ececd797537a None admin] RBAC: Authorizing `identity:create_grant(project_id=3165cdd92e654009b08887ec4d4d589c, user_id=efaad6fc47914643b048c2791c92d679, role_id=c81f6283cf3a418bad94b56a1e9ea2b3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:26.456273 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e9346-6c61-4d5e-baa4-ececd797537a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:26.471228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 555/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:53:26 2022] PUT /identity/v3/projects/3165cdd92e654009b08887ec4d4d589c/users/efaad6fc47914643b048c2791c92d679/roles/c81f6283cf3a418bad94b56a1e9ea2b3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:53:28.453552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2580a9-24c9-42f0-8637-848aa0d92734 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:28.454106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2580a9-24c9-42f0-8637-848aa0d92734 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:28.454106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2580a9-24c9-42f0-8637-848aa0d92734 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:28.456609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 569/1124] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:28.465315 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adb4a-c212-4361-9010-ef1b987e15a2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:28.465707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adb4a-c212-4361-9010-ef1b987e15a2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:28.465934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adb4a-c212-4361-9010-ef1b987e15a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:28.487336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-009adb4a-c212-4361-9010-ef1b987e15a2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:28.488497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-009adb4a-c212-4361-9010-ef1b987e15a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:28.581179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 556/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:28.605873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2580a9-24c9-42f0-8637-848aa0d92734 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:28.683546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:28.721211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2580a9-24c9-42f0-8637-848aa0d92734 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:28.756387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c52db7-7936-43cd-a327-b5b19e85e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:28.757244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c52db7-7936-43cd-a327-b5b19e85e774 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:28.757528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c52db7-7936-43cd-a327-b5b19e85e774 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:28.757806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c52db7-7936-43cd-a327-b5b19e85e774 None admin] PATH_INFO: `/v3/roles/c81f6283cf3a418bad94b56a1e9ea2b3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:28.759456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c52db7-7936-43cd-a327-b5b19e85e774 None admin] RBAC: Authorizing `identity:get_role(role_id=c81f6283cf3a418bad94b56a1e9ea2b3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:28.760875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c52db7-7936-43cd-a327-b5b19e85e774 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:28.762262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 570/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:28 2022] GET /identity/v3/roles/c81f6283cf3a418bad94b56a1e9ea2b3 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:28.768598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009adb4a-c212-4361-9010-ef1b987e15a2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:28.877586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009adb4a-c212-4361-9010-ef1b987e15a2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:28.880076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:28.914002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a96f87-a9f5-4d7f-8b0a-046803877462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:28.915263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a96f87-a9f5-4d7f-8b0a-046803877462 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:28.915544 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a96f87-a9f5-4d7f-8b0a-046803877462 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:28.915819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a96f87-a9f5-4d7f-8b0a-046803877462 None admin] PATH_INFO: `/v3/users/efaad6fc47914643b048c2791c92d679` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:28.917062 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a96f87-a9f5-4d7f-8b0a-046803877462 None admin] RBAC: Authorizing `identity:get_user(user_id=efaad6fc47914643b048c2791c92d679)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:28.918508 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a96f87-a9f5-4d7f-8b0a-046803877462 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:28.920197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 557/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:28 2022] GET /identity/v3/users/efaad6fc47914643b048c2791c92d679 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:28.927383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c52db7-7936-43cd-a327-b5b19e85e774 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:29.051528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c52db7-7936-43cd-a327-b5b19e85e774 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:29.086476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b64862-1496-4c90-804f-4a885d21a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:29.087152 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64862-1496-4c90-804f-4a885d21a64c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:29.087434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64862-1496-4c90-804f-4a885d21a64c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:29.087710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64862-1496-4c90-804f-4a885d21a64c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:29.091371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:29.155875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b64862-1496-4c90-804f-4a885d21a64c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:29.157343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b64862-1496-4c90-804f-4a885d21a64c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:29.275571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 571/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:53:29.285372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a96f87-a9f5-4d7f-8b0a-046803877462 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:29.386552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a96f87-a9f5-4d7f-8b0a-046803877462 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:29.422316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6776-ae07-4646-ad24-288f79a7d4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:29.423187 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6776-ae07-4646-ad24-288f79a7d4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:29.423463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6776-ae07-4646-ad24-288f79a7d4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:29.423738 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6776-ae07-4646-ad24-288f79a7d4d4 None admin] PATH_INFO: `/v3/projects/3165cdd92e654009b08887ec4d4d589c` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:29.425031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6776-ae07-4646-ad24-288f79a7d4d4 None admin] RBAC: Authorizing `identity:get_project(project_id=3165cdd92e654009b08887ec4d4d589c)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:29.426459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6776-ae07-4646-ad24-288f79a7d4d4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:29.428194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 558/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:53:29 2022] GET /identity/v3/projects/3165cdd92e654009b08887ec4d4d589c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:29.434434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b64862-1496-4c90-804f-4a885d21a64c None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:29.468952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:29.546432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b64862-1496-4c90-804f-4a885d21a64c None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:29.581467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2db9e2-7ebc-43af-86e3-33eab0bf8d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:29.582113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db9e2-7ebc-43af-86e3-33eab0bf8d97 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:29.582402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db9e2-7ebc-43af-86e3-33eab0bf8d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:29.582676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db9e2-7ebc-43af-86e3-33eab0bf8d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:29.583533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2db9e2-7ebc-43af-86e3-33eab0bf8d97 None admin] RBAC: Adding query filter params (role.id=c81f6283cf3a418bad94b56a1e9ea2b3, scope.project.id=3165cdd92e654009b08887ec4d4d589c, user.id=efaad6fc47914643b048c2791c92d679) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:29.583843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2db9e2-7ebc-43af-86e3-33eab0bf8d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:29.585285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2db9e2-7ebc-43af-86e3-33eab0bf8d97 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:29.591346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 572/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:53:29 2022] GET /identity/v3/role_assignments?user.id=efaad6fc47914643b048c2791c92d679&scope.project.id=3165cdd92e654009b08887ec4d4d589c&role.id=c81f6283cf3a418bad94b56a1e9ea2b3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:31.605730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a094bf0-f330-469d-b914-12c002fcda4b None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:31.606580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a094bf0-f330-469d-b914-12c002fcda4b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:31.606580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a094bf0-f330-469d-b914-12c002fcda4b None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:31.608923 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 559/1131] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:31.614336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb185f-6bc2-46b7-9bcc-144897ade085 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:31.614772 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb185f-6bc2-46b7-9bcc-144897ade085 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:31.614873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb185f-6bc2-46b7-9bcc-144897ade085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:31.632293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-78cb185f-6bc2-46b7-9bcc-144897ade085 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:31.633457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-78cb185f-6bc2-46b7-9bcc-144897ade085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:31.701620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 573/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:31.725955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a094bf0-f330-469d-b914-12c002fcda4b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:31.779373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:31.841004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a094bf0-f330-469d-b914-12c002fcda4b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:31.876005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaa46c-7d66-4f03-b7c8-df6372d50395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:31.876785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa46c-7d66-4f03-b7c8-df6372d50395 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:31.877065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa46c-7d66-4f03-b7c8-df6372d50395 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:31.877345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa46c-7d66-4f03-b7c8-df6372d50395 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:31.878636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaa46c-7d66-4f03-b7c8-df6372d50395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:31.880129 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaa46c-7d66-4f03-b7c8-df6372d50395 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:31.881751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 560/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:31.888566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb185f-6bc2-46b7-9bcc-144897ade085 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:31.925679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:31.997076 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb185f-6bc2-46b7-9bcc-144897ade085 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:32.032024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3bdbb-cc62-4e7b-9e54-cd701eef42b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:32.032609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3bdbb-cc62-4e7b-9e54-cd701eef42b6 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:32.032898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3bdbb-cc62-4e7b-9e54-cd701eef42b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:32.033168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3bdbb-cc62-4e7b-9e54-cd701eef42b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:32.033871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3bdbb-cc62-4e7b-9e54-cd701eef42b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:32.035342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3bdbb-cc62-4e7b-9e54-cd701eef42b6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:32.065877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 574/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:53:31 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:53:34.108033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7786e-f21f-476f-a43c-69e4a90816ac None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:34.108616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7786e-f21f-476f-a43c-69e4a90816ac None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:34.108616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7786e-f21f-476f-a43c-69e4a90816ac None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:34.110707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 561/1135] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:34.119570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7b2f-460a-4466-ada6-ebd9f785acd9 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:34.119966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7b2f-460a-4466-ada6-ebd9f785acd9 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:34.120129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7b2f-460a-4466-ada6-ebd9f785acd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:34.139240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f7cf7b2f-460a-4466-ada6-ebd9f785acd9 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:34.140423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f7cf7b2f-460a-4466-ada6-ebd9f785acd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:34.209545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 575/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:34.234431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7786e-f21f-476f-a43c-69e4a90816ac None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:34.350461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7786e-f21f-476f-a43c-69e4a90816ac None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:34.359688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:34.394706 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb30edf-8dd4-42f6-9086-e756aa3328d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:34.395527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb30edf-8dd4-42f6-9086-e756aa3328d4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:34.395808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb30edf-8dd4-42f6-9086-e756aa3328d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:34.396084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb30edf-8dd4-42f6-9086-e756aa3328d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:34.397324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb30edf-8dd4-42f6-9086-e756aa3328d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:34.398782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb30edf-8dd4-42f6-9086-e756aa3328d4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:34.400434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 562/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:53:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:34.406313 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf7b2f-460a-4466-ada6-ebd9f785acd9 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:34.425942 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:34.522853 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf7b2f-460a-4466-ada6-ebd9f785acd9 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:34.560067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976361c-157d-4acd-b1ee-863b595a0edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:34.560727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976361c-157d-4acd-b1ee-863b595a0edb None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:34.561008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976361c-157d-4acd-b1ee-863b595a0edb None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:34.561278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976361c-157d-4acd-b1ee-863b595a0edb None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:34.561980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976361c-157d-4acd-b1ee-863b595a0edb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:34.563478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976361c-157d-4acd-b1ee-863b595a0edb None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:34.586347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 576/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:53:34 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:53:36.626623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a7e72-f6e4-4f37-bb0a-841a8d47c86d None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:36.627204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a7e72-f6e4-4f37-bb0a-841a8d47c86d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:36.627204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a7e72-f6e4-4f37-bb0a-841a8d47c86d None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:36.629323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 563/1139] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:36.637864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da22e33-9e32-4e61-9ede-8295180a6213 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:36.638269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da22e33-9e32-4e61-9ede-8295180a6213 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:36.638481 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da22e33-9e32-4e61-9ede-8295180a6213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:36.666872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-2da22e33-9e32-4e61-9ede-8295180a6213 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:36.668081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2da22e33-9e32-4e61-9ede-8295180a6213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:36.730619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:36.736805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 577/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:36.769342 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a7e72-f6e4-4f37-bb0a-841a8d47c86d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:36.879331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a7e72-f6e4-4f37-bb0a-841a8d47c86d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:36.917886 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19201f75-f8fd-4c0f-9079-a7a19a89ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:36.918662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201f75-f8fd-4c0f-9079-a7a19a89ef39 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:36.918933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201f75-f8fd-4c0f-9079-a7a19a89ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:36.919235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201f75-f8fd-4c0f-9079-a7a19a89ef39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:36.930830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19201f75-f8fd-4c0f-9079-a7a19a89ef39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-19201f75-f8fd-4c0f-9079-a7a19a89ef39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:53:36.938431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:36.939570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:36.940643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:36.943153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 564/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:53:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:36.945637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da22e33-9e32-4e61-9ede-8295180a6213 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:37.047655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da22e33-9e32-4e61-9ede-8295180a6213 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:37.082199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62862c40-0b47-4aff-beb7-6c0d62014beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:37.082853 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62862c40-0b47-4aff-beb7-6c0d62014beb None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:37.083165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62862c40-0b47-4aff-beb7-6c0d62014beb None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:37.083438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62862c40-0b47-4aff-beb7-6c0d62014beb None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:37.084191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62862c40-0b47-4aff-beb7-6c0d62014beb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:37.084498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62862c40-0b47-4aff-beb7-6c0d62014beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:37.085886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62862c40-0b47-4aff-beb7-6c0d62014beb None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:37.093990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 578/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:53:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:37.102294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19201f75-f8fd-4c0f-9079-a7a19a89ef39 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:37.140455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:37.206293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19201f75-f8fd-4c0f-9079-a7a19a89ef39 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:37.242736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28ffbe-91f3-4382-aca2-d629e17dda05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:37.243779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28ffbe-91f3-4382-aca2-d629e17dda05 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:37.244112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28ffbe-91f3-4382-aca2-d629e17dda05 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:37.244420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28ffbe-91f3-4382-aca2-d629e17dda05 None admin] PATH_INFO: `/v3/users/6be42a713ac74d0f96ea5143488a28ef` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:37.258949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28ffbe-91f3-4382-aca2-d629e17dda05 None admin] RBAC: Authorizing `identity:get_user(user_id=6be42a713ac74d0f96ea5143488a28ef)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:37.260521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28ffbe-91f3-4382-aca2-d629e17dda05 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:37.262183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 565/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:37 2022] GET /identity/v3/users/6be42a713ac74d0f96ea5143488a28ef => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:37.268179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62862c40-0b47-4aff-beb7-6c0d62014beb None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:37.329017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:37.372736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62862c40-0b47-4aff-beb7-6c0d62014beb None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:37.406891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df04b9-c76e-4b36-9346-16c78441739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:37.407550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df04b9-c76e-4b36-9346-16c78441739d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:37.407828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df04b9-c76e-4b36-9346-16c78441739d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:37.408103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df04b9-c76e-4b36-9346-16c78441739d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:37.475888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df04b9-c76e-4b36-9346-16c78441739d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:37.477355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df04b9-c76e-4b36-9346-16c78441739d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:37.535452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:37.577122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 579/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 26 02:53:37.586074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28ffbe-91f3-4382-aca2-d629e17dda05 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:37.689406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:37.697064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28ffbe-91f3-4382-aca2-d629e17dda05 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:37.732430 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa4a77-3957-4e73-bbaf-55cc2b96c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:37.733277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa4a77-3957-4e73-bbaf-55cc2b96c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:37.733558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa4a77-3957-4e73-bbaf-55cc2b96c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:37.733827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa4a77-3957-4e73-bbaf-55cc2b96c5e1 None admin] PATH_INFO: `/v3/projects/41942522b92640678c259f0fe2a55f8f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:37.735072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa4a77-3957-4e73-bbaf-55cc2b96c5e1 None admin] RBAC: Authorizing `identity:get_project(project_id=41942522b92640678c259f0fe2a55f8f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:37.736496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa4a77-3957-4e73-bbaf-55cc2b96c5e1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:37.738185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 566/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:53:37 2022] GET /identity/v3/projects/41942522b92640678c259f0fe2a55f8f => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:37.745297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df04b9-c76e-4b36-9346-16c78441739d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:37.857814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df04b9-c76e-4b36-9346-16c78441739d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:37.893310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1501f2-6f7a-444d-9390-803285fb569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:37.893959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1501f2-6f7a-444d-9390-803285fb569c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:37.894239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1501f2-6f7a-444d-9390-803285fb569c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:37.894520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1501f2-6f7a-444d-9390-803285fb569c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:37.895385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1501f2-6f7a-444d-9390-803285fb569c None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=41942522b92640678c259f0fe2a55f8f, user.id=6be42a713ac74d0f96ea5143488a28ef) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:37.895696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1501f2-6f7a-444d-9390-803285fb569c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:37.897146 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1501f2-6f7a-444d-9390-803285fb569c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:37.902756 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 580/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:53:37 2022] GET /identity/v3/role_assignments?user.id=6be42a713ac74d0f96ea5143488a28ef&scope.project.id=41942522b92640678c259f0fe2a55f8f&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:39.859846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea6eee-1971-4897-bfe2-c875867426b7 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:39.860429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea6eee-1971-4897-bfe2-c875867426b7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:39.860429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea6eee-1971-4897-bfe2-c875867426b7 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:39.861771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 567/1147] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:39.868134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70221-9b45-429b-a815-73f18af91d63 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:39.868793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70221-9b45-429b-a815-73f18af91d63 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:39.869044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70221-9b45-429b-a815-73f18af91d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:39.886511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-7ce70221-9b45-429b-a815-73f18af91d63 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:39.887716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7ce70221-9b45-429b-a815-73f18af91d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:39.905372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:39.956330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 581/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:39.979370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea6eee-1971-4897-bfe2-c875867426b7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:40.086912 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea6eee-1971-4897-bfe2-c875867426b7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:40.121370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d8734-fa38-4941-a1bd-799a89be2d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:40.122077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8734-fa38-4941-a1bd-799a89be2d2b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:40.122355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8734-fa38-4941-a1bd-799a89be2d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:40.122623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8734-fa38-4941-a1bd-799a89be2d2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:40.132983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d8734-fa38-4941-a1bd-799a89be2d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-811d8734-fa38-4941-a1bd-799a89be2d2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:53:40.140477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:40.141530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:40.142852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 568/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:53:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:40.147970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce70221-9b45-429b-a815-73f18af91d63 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:40.251879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce70221-9b45-429b-a815-73f18af91d63 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:40.293549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab0407-2c25-4fd6-ae17-3d71843a7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:40.294204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab0407-2c25-4fd6-ae17-3d71843a7502 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:40.294487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab0407-2c25-4fd6-ae17-3d71843a7502 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:40.294764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab0407-2c25-4fd6-ae17-3d71843a7502 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:40.295544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab0407-2c25-4fd6-ae17-3d71843a7502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:40.295851 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab0407-2c25-4fd6-ae17-3d71843a7502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:40.297249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab0407-2c25-4fd6-ae17-3d71843a7502 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:40.305297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 582/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:53:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:40.311160 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d8734-fa38-4941-a1bd-799a89be2d2b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:40.337282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:40.430742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d8734-fa38-4941-a1bd-799a89be2d2b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:40.468750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cd8b2-de88-4be2-b09f-d014ff3f05d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:40.469615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd8b2-de88-4be2-b09f-d014ff3f05d9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:40.469894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd8b2-de88-4be2-b09f-d014ff3f05d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:40.470165 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd8b2-de88-4be2-b09f-d014ff3f05d9 None admin] PATH_INFO: `/v3/users/6be42a713ac74d0f96ea5143488a28ef` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:40.471491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cd8b2-de88-4be2-b09f-d014ff3f05d9 None admin] RBAC: Authorizing `identity:get_user(user_id=6be42a713ac74d0f96ea5143488a28ef)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:40.472931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cd8b2-de88-4be2-b09f-d014ff3f05d9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:40.474551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 569/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:40 2022] GET /identity/v3/users/6be42a713ac74d0f96ea5143488a28ef => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:40.480553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab0407-2c25-4fd6-ae17-3d71843a7502 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:40.501819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:40.610344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab0407-2c25-4fd6-ae17-3d71843a7502 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:40.645659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53cb8b-6f0d-4b63-a0f3-a0b7dc119878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:40.646510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53cb8b-6f0d-4b63-a0f3-a0b7dc119878 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:40.646791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53cb8b-6f0d-4b63-a0f3-a0b7dc119878 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:40.647093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53cb8b-6f0d-4b63-a0f3-a0b7dc119878 None admin] PATH_INFO: `/v3/projects/41942522b92640678c259f0fe2a55f8f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:40.648380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53cb8b-6f0d-4b63-a0f3-a0b7dc119878 None admin] RBAC: Authorizing `identity:get_project(project_id=41942522b92640678c259f0fe2a55f8f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:40.649824 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53cb8b-6f0d-4b63-a0f3-a0b7dc119878 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:40.651629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 583/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:53:40 2022] GET /identity/v3/projects/41942522b92640678c259f0fe2a55f8f => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:40.661101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cd8b2-de88-4be2-b09f-d014ff3f05d9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:40.772609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:40.784012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cd8b2-de88-4be2-b09f-d014ff3f05d9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:40.818771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64da2ee-5053-46ce-add2-c6f06c374fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:40.819680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64da2ee-5053-46ce-add2-c6f06c374fa6 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:40.819954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64da2ee-5053-46ce-add2-c6f06c374fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:40.820229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64da2ee-5053-46ce-add2-c6f06c374fa6 None admin] PATH_INFO: `/v3/projects/41942522b92640678c259f0fe2a55f8f/users/6be42a713ac74d0f96ea5143488a28ef/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:40.822429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64da2ee-5053-46ce-add2-c6f06c374fa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=41942522b92640678c259f0fe2a55f8f, user_id=6be42a713ac74d0f96ea5143488a28ef, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:40.823887 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64da2ee-5053-46ce-add2-c6f06c374fa6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:40.840598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 570/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:53:40 2022] PUT /identity/v3/projects/41942522b92640678c259f0fe2a55f8f/users/6be42a713ac74d0f96ea5143488a28ef/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:53:42.864291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39d8be-0de6-49cd-ae3d-3d94d6119fb2 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:42.865168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39d8be-0de6-49cd-ae3d-3d94d6119fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:42.865168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39d8be-0de6-49cd-ae3d-3d94d6119fb2 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:42.867465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 584/1154] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:42.874325 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c888b7-835e-4f4b-a1dd-2bf396673f30 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:42.874728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c888b7-835e-4f4b-a1dd-2bf396673f30 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:42.874924 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c888b7-835e-4f4b-a1dd-2bf396673f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:42.900973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-77c888b7-835e-4f4b-a1dd-2bf396673f30 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:42.902165 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-77c888b7-835e-4f4b-a1dd-2bf396673f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:42.972798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 571/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:43.004952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39d8be-0de6-49cd-ae3d-3d94d6119fb2 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:43.100097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:43.123807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39d8be-0de6-49cd-ae3d-3d94d6119fb2 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:43.163150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1a44-aea1-4da8-8e27-b73af539be78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:43.163942 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1a44-aea1-4da8-8e27-b73af539be78 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:43.164580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1a44-aea1-4da8-8e27-b73af539be78 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:43.164854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b1a44-aea1-4da8-8e27-b73af539be78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:43.176156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b1a44-aea1-4da8-8e27-b73af539be78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-eb5b1a44-aea1-4da8-8e27-b73af539be78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:53:43.183629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:43.184687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:43.185585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 585/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:53:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:43.193144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c888b7-835e-4f4b-a1dd-2bf396673f30 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:43.273292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:43.293763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c888b7-835e-4f4b-a1dd-2bf396673f30 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:43.327926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dcdb6-c0eb-4e46-9e61-062f6fcd066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:43.328584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dcdb6-c0eb-4e46-9e61-062f6fcd066c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:43.328862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dcdb6-c0eb-4e46-9e61-062f6fcd066c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:43.329135 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dcdb6-c0eb-4e46-9e61-062f6fcd066c None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:43.329877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dcdb6-c0eb-4e46-9e61-062f6fcd066c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:43.330183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dcdb6-c0eb-4e46-9e61-062f6fcd066c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:43.331593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0dcdb6-c0eb-4e46-9e61-062f6fcd066c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:43.339637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 572/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:53:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:53:43.348982 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1a44-aea1-4da8-8e27-b73af539be78 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:43.455891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b1a44-aea1-4da8-8e27-b73af539be78 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:43.498085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e41c-b37e-4e33-b3ec-fd9c87aa2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:43.499447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e41c-b37e-4e33-b3ec-fd9c87aa2983 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:43.499849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e41c-b37e-4e33-b3ec-fd9c87aa2983 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:43.500247 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e41c-b37e-4e33-b3ec-fd9c87aa2983 None admin] PATH_INFO: `/v3/users/6be42a713ac74d0f96ea5143488a28ef` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:43.502003 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544e41c-b37e-4e33-b3ec-fd9c87aa2983 None admin] RBAC: Authorizing `identity:get_user(user_id=6be42a713ac74d0f96ea5143488a28ef)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:43.504284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544e41c-b37e-4e33-b3ec-fd9c87aa2983 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:43.506879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 586/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:43 2022] GET /identity/v3/users/6be42a713ac74d0f96ea5143488a28ef => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:43.513805 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dcdb6-c0eb-4e46-9e61-062f6fcd066c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:43.614877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dcdb6-c0eb-4e46-9e61-062f6fcd066c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:43.649277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157dd05-ede4-495f-af1b-84ae252c1973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:43.649951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157dd05-ede4-495f-af1b-84ae252c1973 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:43.650229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157dd05-ede4-495f-af1b-84ae252c1973 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:43.650505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157dd05-ede4-495f-af1b-84ae252c1973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:43.663100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:43.720090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157dd05-ede4-495f-af1b-84ae252c1973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:43.721553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157dd05-ede4-495f-af1b-84ae252c1973 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:43.820551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 573/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:53:43.827435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e41c-b37e-4e33-b3ec-fd9c87aa2983 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:43.846401 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:43.937674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e41c-b37e-4e33-b3ec-fd9c87aa2983 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:43.974439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561e2d9-6933-4e01-b229-0facfe8fa57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:43.975266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561e2d9-6933-4e01-b229-0facfe8fa57b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:43.975546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561e2d9-6933-4e01-b229-0facfe8fa57b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:43.975819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561e2d9-6933-4e01-b229-0facfe8fa57b None admin] PATH_INFO: `/v3/projects/41942522b92640678c259f0fe2a55f8f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:43.977079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561e2d9-6933-4e01-b229-0facfe8fa57b None admin] RBAC: Authorizing `identity:get_project(project_id=41942522b92640678c259f0fe2a55f8f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:43.978626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561e2d9-6933-4e01-b229-0facfe8fa57b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:43.980430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 587/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:53:43 2022] GET /identity/v3/projects/41942522b92640678c259f0fe2a55f8f => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:43.989594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157dd05-ede4-495f-af1b-84ae252c1973 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:44.034163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:44.095275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157dd05-ede4-495f-af1b-84ae252c1973 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:44.142368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ddb98-61f9-4654-8ea6-e1ee826d2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:44.143031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ddb98-61f9-4654-8ea6-e1ee826d2fab None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:44.143329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ddb98-61f9-4654-8ea6-e1ee826d2fab None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:44.143609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ddb98-61f9-4654-8ea6-e1ee826d2fab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:44.144449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ddb98-61f9-4654-8ea6-e1ee826d2fab None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=41942522b92640678c259f0fe2a55f8f, user.id=6be42a713ac74d0f96ea5143488a28ef) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:44.144763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ddb98-61f9-4654-8ea6-e1ee826d2fab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:44.146206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ddb98-61f9-4654-8ea6-e1ee826d2fab None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:44.152398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 574/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:53:43 2022] GET /identity/v3/role_assignments?user.id=6be42a713ac74d0f96ea5143488a28ef&scope.project.id=41942522b92640678c259f0fe2a55f8f&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:46.219794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ada6c-4867-4997-9e86-1dbc8b7bdbcc None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:46.220696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ada6c-4867-4997-9e86-1dbc8b7bdbcc None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:46.220696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ada6c-4867-4997-9e86-1dbc8b7bdbcc None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:46.222871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 588/1162] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:46.228423 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad57835-4d21-4366-b32b-3555c1445223 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:46.228840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad57835-4d21-4366-b32b-3555c1445223 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:46.228948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad57835-4d21-4366-b32b-3555c1445223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:46.246077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fad57835-4d21-4366-b32b-3555c1445223 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:46.247311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fad57835-4d21-4366-b32b-3555c1445223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:46.316811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 575/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:46.340349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ada6c-4867-4997-9e86-1dbc8b7bdbcc None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:46.436036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:46.458786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ada6c-4867-4997-9e86-1dbc8b7bdbcc None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:46.494067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efcd50-d899-49cb-a3b4-c2b395e75338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:46.494644 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efcd50-d899-49cb-a3b4-c2b395e75338 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:46.494931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efcd50-d899-49cb-a3b4-c2b395e75338 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:46.495245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efcd50-d899-49cb-a3b4-c2b395e75338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:46.567869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efcd50-d899-49cb-a3b4-c2b395e75338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:46.569330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efcd50-d899-49cb-a3b4-c2b395e75338 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:46.649963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:46.683416 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 589/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:53:46.689650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad57835-4d21-4366-b32b-3555c1445223 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:46.725851 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:46.793283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad57835-4d21-4366-b32b-3555c1445223 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:46.828219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33012-06fe-4213-974a-08a417b31e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:46.829011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33012-06fe-4213-974a-08a417b31e26 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:46.829292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33012-06fe-4213-974a-08a417b31e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:46.829568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33012-06fe-4213-974a-08a417b31e26 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:46.836593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33012-06fe-4213-974a-08a417b31e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:46.838126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33012-06fe-4213-974a-08a417b31e26 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-32c33012-06fe-4213-974a-08a417b31e26 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:46.852221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:46.857608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:53:46.858729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 576/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Jun 26 02:53:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:46.861363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efcd50-d899-49cb-a3b4-c2b395e75338 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:46.970244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efcd50-d899-49cb-a3b4-c2b395e75338 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:47.005279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39feff7a-2c48-487f-bdc2-06692c339a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:47.005916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feff7a-2c48-487f-bdc2-06692c339a22 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:47.006203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feff7a-2c48-487f-bdc2-06692c339a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:47.006477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feff7a-2c48-487f-bdc2-06692c339a22 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:47.007227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39feff7a-2c48-487f-bdc2-06692c339a22 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:47.007536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39feff7a-2c48-487f-bdc2-06692c339a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:47.008922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39feff7a-2c48-487f-bdc2-06692c339a22 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:47.016120 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 590/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Sun Jun 26 02:53:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:48.998390 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54bd4-e036-4ca4-8224-bc178119c356 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:48.999309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54bd4-e036-4ca4-8224-bc178119c356 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:48.999309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de54bd4-e036-4ca4-8224-bc178119c356 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:49.001543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 577/1167] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:49.010363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca633c12-da57-4bc9-bb52-c407070a5359 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:49.010790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca633c12-da57-4bc9-bb52-c407070a5359 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:49.010936 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca633c12-da57-4bc9-bb52-c407070a5359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:49.033843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ca633c12-da57-4bc9-bb52-c407070a5359 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:49.035046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ca633c12-da57-4bc9-bb52-c407070a5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:49.077442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:49.105292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 591/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:49.128957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de54bd4-e036-4ca4-8224-bc178119c356 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:49.237369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:49.244723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de54bd4-e036-4ca4-8224-bc178119c356 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:49.278268 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2560b1-41b3-43c3-a600-b70e18ce1a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:49.278922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2560b1-41b3-43c3-a600-b70e18ce1a65 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:49.279238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2560b1-41b3-43c3-a600-b70e18ce1a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:49.279513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2560b1-41b3-43c3-a600-b70e18ce1a65 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:49.280249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2560b1-41b3-43c3-a600-b70e18ce1a65 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:49.281636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2560b1-41b3-43c3-a600-b70e18ce1a65 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:49.300765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 578/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Sun Jun 26 02:53:49 2022] POST /identity/v3/domains => generated 267 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:53:51.323442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42c932-599b-4dff-96d6-fd79e4a8c50e None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:51.324302 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42c932-599b-4dff-96d6-fd79e4a8c50e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:51.324302 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42c932-599b-4dff-96d6-fd79e4a8c50e None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:51.326550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 592/1170] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:51.332858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761b3d0-973b-432e-95ef-111400f14f26 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:51.333296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761b3d0-973b-432e-95ef-111400f14f26 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:51.333427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761b3d0-973b-432e-95ef-111400f14f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:51.352302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-6761b3d0-973b-432e-95ef-111400f14f26 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:51.353482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6761b3d0-973b-432e-95ef-111400f14f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:51.424480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 579/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:51.448114 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42c932-599b-4dff-96d6-fd79e4a8c50e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:51.554865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42c932-599b-4dff-96d6-fd79e4a8c50e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:51.589426 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692564-1444-43f2-80a2-57cc16a4ea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:51.590198 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692564-1444-43f2-80a2-57cc16a4ea8d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:51.590473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692564-1444-43f2-80a2-57cc16a4ea8d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:51.590745 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692564-1444-43f2-80a2-57cc16a4ea8d None admin] PATH_INFO: `/v3/domains/bb96381905c14dfc96a8f60ac8cc2516` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:51.601296 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7692564-1444-43f2-80a2-57cc16a4ea8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=bb96381905c14dfc96a8f60ac8cc2516)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:51.602796 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7692564-1444-43f2-80a2-57cc16a4ea8d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:51.604431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 593/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Sun Jun 26 02:53:51 2022] GET /identity/v3/domains/bb96381905c14dfc96a8f60ac8cc2516 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:51.613202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761b3d0-973b-432e-95ef-111400f14f26 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:51.705326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:51.722702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761b3d0-973b-432e-95ef-111400f14f26 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:51.756831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46cb08-d729-4ecd-bc5b-823ccdd38f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:51.757474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46cb08-d729-4ecd-bc5b-823ccdd38f82 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:51.757752 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46cb08-d729-4ecd-bc5b-823ccdd38f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:51.758029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46cb08-d729-4ecd-bc5b-823ccdd38f82 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:51.758745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46cb08-d729-4ecd-bc5b-823ccdd38f82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:51.760285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46cb08-d729-4ecd-bc5b-823ccdd38f82 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:51.792617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 580/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:53:51 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:53:53.814375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f8b4-356e-4f3f-9916-f068b45632db None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:53.814922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f8b4-356e-4f3f-9916-f068b45632db None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:53.814922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f8b4-356e-4f3f-9916-f068b45632db None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:53.816342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 594/1174] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:53.822741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b352f-4969-4cbb-9b4f-c8dc86578c2d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:53.823478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b352f-4969-4cbb-9b4f-c8dc86578c2d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:53.823732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b352f-4969-4cbb-9b4f-c8dc86578c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:53.842418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a00b352f-4969-4cbb-9b4f-c8dc86578c2d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:53.843654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a00b352f-4969-4cbb-9b4f-c8dc86578c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:53.913373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 581/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:53.938406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2f8b4-356e-4f3f-9916-f068b45632db None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:53.981157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:54.049180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2f8b4-356e-4f3f-9916-f068b45632db None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:54.084586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382d358-c4a7-438c-a77d-d071d3d22b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:54.085384 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d358-c4a7-438c-a77d-d071d3d22b08 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:54.085654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d358-c4a7-438c-a77d-d071d3d22b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:54.085923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d358-c4a7-438c-a77d-d071d3d22b08 None admin] PATH_INFO: `/v3/domains/bb96381905c14dfc96a8f60ac8cc2516` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:54.087173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382d358-c4a7-438c-a77d-d071d3d22b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bb96381905c14dfc96a8f60ac8cc2516)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:54.088616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382d358-c4a7-438c-a77d-d071d3d22b08 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:54.090210 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 595/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Sun Jun 26 02:53:53 2022] GET /identity/v3/domains/bb96381905c14dfc96a8f60ac8cc2516 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:54.096117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b352f-4969-4cbb-9b4f-c8dc86578c2d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:54.164079 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:54.207543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b352f-4969-4cbb-9b4f-c8dc86578c2d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:54.246690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b5e7e-8989-4fba-ae6d-76caaee8e473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:54.247397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b5e7e-8989-4fba-ae6d-76caaee8e473 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:54.247677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b5e7e-8989-4fba-ae6d-76caaee8e473 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:54.247964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b5e7e-8989-4fba-ae6d-76caaee8e473 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:54.248681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b5e7e-8989-4fba-ae6d-76caaee8e473 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:54.250159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b5e7e-8989-4fba-ae6d-76caaee8e473 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:54.273708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 582/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:53:54 2022] POST /identity/v3/users => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:53:56.291615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228af44-03d9-4448-8842-330291738678 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:56.292202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228af44-03d9-4448-8842-330291738678 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:56.292202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228af44-03d9-4448-8842-330291738678 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:56.293506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 596/1178] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:56.299026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072c205-cb1a-4c18-b18a-ccca13524b5a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:56.299444 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072c205-cb1a-4c18-b18a-ccca13524b5a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:56.299611 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072c205-cb1a-4c18-b18a-ccca13524b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:56.316558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b072c205-cb1a-4c18-b18a-ccca13524b5a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:56.317727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b072c205-cb1a-4c18-b18a-ccca13524b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:56.385164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 583/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 26 02:53:56.410362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228af44-03d9-4448-8842-330291738678 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:56.515025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228af44-03d9-4448-8842-330291738678 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:56.516614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:56.552552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce4b7a-f758-4aa4-8da3-9f51514b285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:56.553283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4b7a-f758-4aa4-8da3-9f51514b285b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:56.553562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4b7a-f758-4aa4-8da3-9f51514b285b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:56.553835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4b7a-f758-4aa4-8da3-9f51514b285b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:56.564955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce4b7a-f758-4aa4-8da3-9f51514b285b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-9bce4b7a-f758-4aa4-8da3-9f51514b285b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:53:56.572409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:56.573495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:56.574371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 597/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:53:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:56.579826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072c205-cb1a-4c18-b18a-ccca13524b5a None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:56.635468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:56.681616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072c205-cb1a-4c18-b18a-ccca13524b5a None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:56.722248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5a9d-d716-4969-a440-0b57af0db789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:56.722904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5a9d-d716-4969-a440-0b57af0db789 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:56.723216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5a9d-d716-4969-a440-0b57af0db789 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:56.723492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5a9d-d716-4969-a440-0b57af0db789 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:56.724229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5a9d-d716-4969-a440-0b57af0db789 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:56.724536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5a9d-d716-4969-a440-0b57af0db789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:56.725908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5a9d-d716-4969-a440-0b57af0db789 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:56.734121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 584/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:56.740779 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce4b7a-f758-4aa4-8da3-9f51514b285b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:56.860454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce4b7a-f758-4aa4-8da3-9f51514b285b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:56.895804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17841d89-4b64-47e2-87b7-7a943c9b9be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:56.896663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841d89-4b64-47e2-87b7-7a943c9b9be9 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:56.896943 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841d89-4b64-47e2-87b7-7a943c9b9be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:56.897224 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841d89-4b64-47e2-87b7-7a943c9b9be9 None admin] PATH_INFO: `/v3/users/9c1bf79fe77341049d07be37ea6eeb45` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:56.912985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17841d89-4b64-47e2-87b7-7a943c9b9be9 None admin] RBAC: Authorizing `identity:get_user(user_id=9c1bf79fe77341049d07be37ea6eeb45)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:56.914841 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17841d89-4b64-47e2-87b7-7a943c9b9be9 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:56.916502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 598/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:53:56 2022] GET /identity/v3/users/9c1bf79fe77341049d07be37ea6eeb45 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:56.922520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5a9d-d716-4969-a440-0b57af0db789 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:57.020896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5a9d-d716-4969-a440-0b57af0db789 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:57.036736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:57.055972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c075a30-e2f9-4628-892d-d546759ec0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:57.056611 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c075a30-e2f9-4628-892d-d546759ec0cc None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:57.056890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c075a30-e2f9-4628-892d-d546759ec0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:57.057161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c075a30-e2f9-4628-892d-d546759ec0cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:57.129868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c075a30-e2f9-4628-892d-d546759ec0cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:57.131258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c075a30-e2f9-4628-892d-d546759ec0cc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:57.241890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 585/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:53:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:53:57.250865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17841d89-4b64-47e2-87b7-7a943c9b9be9 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:57.286039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:57.367512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17841d89-4b64-47e2-87b7-7a943c9b9be9 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:57.405904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfe1d1-8854-4a25-97e7-43f429f91519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:57.406696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe1d1-8854-4a25-97e7-43f429f91519 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:57.406976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe1d1-8854-4a25-97e7-43f429f91519 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:57.407287 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfe1d1-8854-4a25-97e7-43f429f91519 None admin] PATH_INFO: `/v3/projects/039bece1d25649b491cc34f697a40b33` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:57.408575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfe1d1-8854-4a25-97e7-43f429f91519 None admin] RBAC: Authorizing `identity:get_project(project_id=039bece1d25649b491cc34f697a40b33)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:57.410019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfe1d1-8854-4a25-97e7-43f429f91519 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:57.411773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 599/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:53:57 2022] GET /identity/v3/projects/039bece1d25649b491cc34f697a40b33 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:57.419322 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c075a30-e2f9-4628-892d-d546759ec0cc None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:57.441722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:57.523120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c075a30-e2f9-4628-892d-d546759ec0cc None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:57.556481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99057b-c646-4daa-aeae-7b947782a3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:57.557117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99057b-c646-4daa-aeae-7b947782a3be None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:57.557397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99057b-c646-4daa-aeae-7b947782a3be None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:57.557670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99057b-c646-4daa-aeae-7b947782a3be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:57.558492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99057b-c646-4daa-aeae-7b947782a3be None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=039bece1d25649b491cc34f697a40b33, user.id=9c1bf79fe77341049d07be37ea6eeb45) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:53:57.558805 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99057b-c646-4daa-aeae-7b947782a3be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:53:57.560306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99057b-c646-4daa-aeae-7b947782a3be None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:53:57.565942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 586/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:53:57 2022] GET /identity/v3/role_assignments?user.id=9c1bf79fe77341049d07be37ea6eeb45&scope.project.id=039bece1d25649b491cc34f697a40b33&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:53:59.549838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e641b4f-bc97-4604-be64-0d4c413e95d6 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:59.550413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e641b4f-bc97-4604-be64-0d4c413e95d6 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:59.550413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e641b4f-bc97-4604-be64-0d4c413e95d6 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:59.551787 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 600/1186] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:53:59.558058 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6246-a28d-4e23-bcc0-c5c22f88b002 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:59.558795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6246-a28d-4e23-bcc0-c5c22f88b002 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:59.558942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6246-a28d-4e23-bcc0-c5c22f88b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:59.587527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-783a6246-a28d-4e23-bcc0-c5c22f88b002 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:53:59.588721 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-783a6246-a28d-4e23-bcc0-c5c22f88b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:53:59.658798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 587/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:53:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:53:59.689907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e641b4f-bc97-4604-be64-0d4c413e95d6 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:59.781078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:59.797562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e641b4f-bc97-4604-be64-0d4c413e95d6 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:53:59.832092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cab42-a4a0-4127-94d1-6da5cb1d37f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:53:59.832865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cab42-a4a0-4127-94d1-6da5cb1d37f7 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:53:59.833142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cab42-a4a0-4127-94d1-6da5cb1d37f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:53:59.833410 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cab42-a4a0-4127-94d1-6da5cb1d37f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:53:59.843256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cab42-a4a0-4127-94d1-6da5cb1d37f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-580cab42-a4a0-4127-94d1-6da5cb1d37f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:53:59.850680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:53:59.851866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:53:59.853375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 601/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:53:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:53:59.861460 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a6246-a28d-4e23-bcc0-c5c22f88b002 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:53:59.879319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:53:59.974139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a6246-a28d-4e23-bcc0-c5c22f88b002 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:00.014494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e6b66-b833-4bbb-ab88-6337d5967d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:00.015196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e6b66-b833-4bbb-ab88-6337d5967d85 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:00.015456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e6b66-b833-4bbb-ab88-6337d5967d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:00.015754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e6b66-b833-4bbb-ab88-6337d5967d85 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:00.016507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e6b66-b833-4bbb-ab88-6337d5967d85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:54:00.016815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e6b66-b833-4bbb-ab88-6337d5967d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:00.018198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e6b66-b833-4bbb-ab88-6337d5967d85 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:00.026589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 588/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:53:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:54:00.033124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cab42-a4a0-4127-94d1-6da5cb1d37f7 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:00.151565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cab42-a4a0-4127-94d1-6da5cb1d37f7 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:00.187938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50eed1f-4b76-48c2-aa62-ccd33000f660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:00.188799 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50eed1f-4b76-48c2-aa62-ccd33000f660 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:00.189078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50eed1f-4b76-48c2-aa62-ccd33000f660 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:00.189358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50eed1f-4b76-48c2-aa62-ccd33000f660 None admin] PATH_INFO: `/v3/users/9c1bf79fe77341049d07be37ea6eeb45` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:00.190632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50eed1f-4b76-48c2-aa62-ccd33000f660 None admin] RBAC: Authorizing `identity:get_user(user_id=9c1bf79fe77341049d07be37ea6eeb45)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:00.192123 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50eed1f-4b76-48c2-aa62-ccd33000f660 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:00.193726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 602/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:54:00 2022] GET /identity/v3/users/9c1bf79fe77341049d07be37ea6eeb45 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:54:00.200202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e6b66-b833-4bbb-ab88-6337d5967d85 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:00.277700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:54:00.308876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e6b66-b833-4bbb-ab88-6337d5967d85 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:00.343016 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309c3fa-af2f-48d9-b3c6-d69997ec832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:00.343892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c3fa-af2f-48d9-b3c6-d69997ec832e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:00.344167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c3fa-af2f-48d9-b3c6-d69997ec832e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:00.344444 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c3fa-af2f-48d9-b3c6-d69997ec832e None admin] PATH_INFO: `/v3/projects/039bece1d25649b491cc34f697a40b33` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:00.345731 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309c3fa-af2f-48d9-b3c6-d69997ec832e None admin] RBAC: Authorizing `identity:get_project(project_id=039bece1d25649b491cc34f697a40b33)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:00.347199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309c3fa-af2f-48d9-b3c6-d69997ec832e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:00.348900 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 589/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:54:00 2022] GET /identity/v3/projects/039bece1d25649b491cc34f697a40b33 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:54:00.355173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50eed1f-4b76-48c2-aa62-ccd33000f660 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:00.375327 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:54:00.465384 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50eed1f-4b76-48c2-aa62-ccd33000f660 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:00.499898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad63ab7-989d-4397-b66f-5f243e0b0894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:00.500798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad63ab7-989d-4397-b66f-5f243e0b0894 None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:00.501074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad63ab7-989d-4397-b66f-5f243e0b0894 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:00.501346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad63ab7-989d-4397-b66f-5f243e0b0894 None admin] PATH_INFO: `/v3/projects/039bece1d25649b491cc34f697a40b33/users/9c1bf79fe77341049d07be37ea6eeb45/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:00.503549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad63ab7-989d-4397-b66f-5f243e0b0894 None admin] RBAC: Authorizing `identity:create_grant(project_id=039bece1d25649b491cc34f697a40b33, user_id=9c1bf79fe77341049d07be37ea6eeb45, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:00.504983 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad63ab7-989d-4397-b66f-5f243e0b0894 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:00.520039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 603/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:54:00 2022] PUT /identity/v3/projects/039bece1d25649b491cc34f697a40b33/users/9c1bf79fe77341049d07be37ea6eeb45/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:54:02.500872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea26e-71d7-415c-94b2-cbb07b5ef143 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:02.501364 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea26e-71d7-415c-94b2-cbb07b5ef143 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:02.501469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea26e-71d7-415c-94b2-cbb07b5ef143 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:02.502833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 590/1193] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:54:02.509283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c660b60-4bae-431f-8dd0-fd902a1ae055 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:02.509956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c660b60-4bae-431f-8dd0-fd902a1ae055 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:02.510129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c660b60-4bae-431f-8dd0-fd902a1ae055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:02.533064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8c660b60-4bae-431f-8dd0-fd902a1ae055 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:54:02.534234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8c660b60-4bae-431f-8dd0-fd902a1ae055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:54:02.602643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 604/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:54:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:54:02.626502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ea26e-71d7-415c-94b2-cbb07b5ef143 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:02.734673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ea26e-71d7-415c-94b2-cbb07b5ef143 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:02.768762 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c67b17-edcf-4d5c-9eef-06fbc4966bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:02.769471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67b17-edcf-4d5c-9eef-06fbc4966bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:02.769750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67b17-edcf-4d5c-9eef-06fbc4966bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:02.770022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67b17-edcf-4d5c-9eef-06fbc4966bb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:02.778334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:54:02.781874 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c67b17-edcf-4d5c-9eef-06fbc4966bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-c6c67b17-edcf-4d5c-9eef-06fbc4966bb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:54:02.790399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:54:02.791553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:54:02.792532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:54:02.795170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 591/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:54:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:54:02.797747 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c660b60-4bae-431f-8dd0-fd902a1ae055 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:02.805992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:54:02.898907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c660b60-4bae-431f-8dd0-fd902a1ae055 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:02.935683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23fe4f-32b7-4b28-8721-119848edaa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:02.936329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23fe4f-32b7-4b28-8721-119848edaa26 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:02.936605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23fe4f-32b7-4b28-8721-119848edaa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:02.936873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23fe4f-32b7-4b28-8721-119848edaa26 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:02.937603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23fe4f-32b7-4b28-8721-119848edaa26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:54:02.937900 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23fe4f-32b7-4b28-8721-119848edaa26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:02.939305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23fe4f-32b7-4b28-8721-119848edaa26 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:02.947536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 605/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:54:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:54:02.954362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c67b17-edcf-4d5c-9eef-06fbc4966bb6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:03.064561 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c67b17-edcf-4d5c-9eef-06fbc4966bb6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:03.099663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d0e33-6242-4112-b929-10a2ad6056e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:03.100517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d0e33-6242-4112-b929-10a2ad6056e0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:03.100800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d0e33-6242-4112-b929-10a2ad6056e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:03.101069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d0e33-6242-4112-b929-10a2ad6056e0 None admin] PATH_INFO: `/v3/users/9c1bf79fe77341049d07be37ea6eeb45` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:03.102274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d0e33-6242-4112-b929-10a2ad6056e0 None admin] RBAC: Authorizing `identity:get_user(user_id=9c1bf79fe77341049d07be37ea6eeb45)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:03.103761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d0e33-6242-4112-b929-10a2ad6056e0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:03.105352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 592/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Sun Jun 26 02:54:02 2022] GET /identity/v3/users/9c1bf79fe77341049d07be37ea6eeb45 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:54:03.111627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23fe4f-32b7-4b28-8721-119848edaa26 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:03.183281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:54:03.216928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23fe4f-32b7-4b28-8721-119848edaa26 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:03.257291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47835d53-511b-4333-bf21-e45357ed8773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:03.258319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835d53-511b-4333-bf21-e45357ed8773 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:03.258784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835d53-511b-4333-bf21-e45357ed8773 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:03.259295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835d53-511b-4333-bf21-e45357ed8773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:03.343130 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47835d53-511b-4333-bf21-e45357ed8773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:03.344535 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47835d53-511b-4333-bf21-e45357ed8773 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:03.409751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:54:03.444133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 606/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:54:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:54:03.450431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d0e33-6242-4112-b929-10a2ad6056e0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:03.517585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:54:03.560917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d0e33-6242-4112-b929-10a2ad6056e0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:03.599198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330f968-2010-4806-b8ad-2f7c2150bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:03.599988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330f968-2010-4806-b8ad-2f7c2150bb0b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:03.600266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330f968-2010-4806-b8ad-2f7c2150bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:03.600539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330f968-2010-4806-b8ad-2f7c2150bb0b None admin] PATH_INFO: `/v3/projects/039bece1d25649b491cc34f697a40b33` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:03.601867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330f968-2010-4806-b8ad-2f7c2150bb0b None admin] RBAC: Authorizing `identity:get_project(project_id=039bece1d25649b491cc34f697a40b33)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:03.603449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330f968-2010-4806-b8ad-2f7c2150bb0b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:03.605159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 593/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Sun Jun 26 02:54:03 2022] GET /identity/v3/projects/039bece1d25649b491cc34f697a40b33 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:54:03.611748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47835d53-511b-4333-bf21-e45357ed8773 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:03.713791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47835d53-511b-4333-bf21-e45357ed8773 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:03.748215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc5cf0-fe65-43d9-b5c7-8e83234d4069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:03.748856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc5cf0-fe65-43d9-b5c7-8e83234d4069 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:03.749140 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc5cf0-fe65-43d9-b5c7-8e83234d4069 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:03.749414 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc5cf0-fe65-43d9-b5c7-8e83234d4069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:03.750243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc5cf0-fe65-43d9-b5c7-8e83234d4069 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=039bece1d25649b491cc34f697a40b33, user.id=9c1bf79fe77341049d07be37ea6eeb45) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:54:03.750554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc5cf0-fe65-43d9-b5c7-8e83234d4069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:03.752022 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc5cf0-fe65-43d9-b5c7-8e83234d4069 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:03.757951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 607/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:54:03 2022] GET /identity/v3/role_assignments?user.id=9c1bf79fe77341049d07be37ea6eeb45&scope.project.id=039bece1d25649b491cc34f697a40b33&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:54:13.593266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=32 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:54:13.755441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=84 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:54:58.164902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fcb94-c507-43ef-a09f-610e2a140e50 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:58.165632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fcb94-c507-43ef-a09f-610e2a140e50 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:58.165632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fcb94-c507-43ef-a09f-610e2a140e50 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:58.167792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 594/1201] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:54:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:54:58.173634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daecd6-3e53-4757-aab2-3639f4837e2b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:58.174113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daecd6-3e53-4757-aab2-3639f4837e2b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:58.174264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daecd6-3e53-4757-aab2-3639f4837e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:58.193440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-24daecd6-3e53-4757-aab2-3639f4837e2b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:54:58.194790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-24daecd6-3e53-4757-aab2-3639f4837e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:54:58.298010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 608/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:54:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:54:58.329084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fcb94-c507-43ef-a09f-610e2a140e50 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:58.458654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fcb94-c507-43ef-a09f-610e2a140e50 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:58.503757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bb6f2-7c64-4ed7-8276-7ad781ffaa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:58.504608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb6f2-7c64-4ed7-8276-7ad781ffaa14 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:58.504897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb6f2-7c64-4ed7-8276-7ad781ffaa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:58.505215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb6f2-7c64-4ed7-8276-7ad781ffaa14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:58.516472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bb6f2-7c64-4ed7-8276-7ad781ffaa14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:58.517960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bb6f2-7c64-4ed7-8276-7ad781ffaa14 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-1b6bb6f2-7c64-4ed7-8276-7ad781ffaa14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:54:58.540852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:54:58.541939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:54:58.542890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:54:58.542890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:54:58.542890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:54:58.542890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:54:58.542890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 595/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:54:58.550108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daecd6-3e53-4757-aab2-3639f4837e2b None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:58.683505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daecd6-3e53-4757-aab2-3639f4837e2b None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:58.725217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:54:58.735038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582024e8-9c8e-4b59-815d-eb47b4a6732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:58.735797 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582024e8-9c8e-4b59-815d-eb47b4a6732c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:58.736111 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582024e8-9c8e-4b59-815d-eb47b4a6732c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:58.736385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582024e8-9c8e-4b59-815d-eb47b4a6732c None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:58.737211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582024e8-9c8e-4b59-815d-eb47b4a6732c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:54:58.737604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582024e8-9c8e-4b59-815d-eb47b4a6732c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:58.739264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582024e8-9c8e-4b59-815d-eb47b4a6732c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:58.757902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 609/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:54:58.764610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bb6f2-7c64-4ed7-8276-7ad781ffaa14 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:54:58.839849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:54:58.903849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bb6f2-7c64-4ed7-8276-7ad781ffaa14 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:54:58.948217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a1a44-f518-4610-ba0f-9ce7ffd548f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:54:58.949002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a1a44-f518-4610-ba0f-9ce7ffd548f9 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:54:58.949342 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a1a44-f518-4610-ba0f-9ce7ffd548f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:54:58.949650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a1a44-f518-4610-ba0f-9ce7ffd548f9 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:54:58.950416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a1a44-f518-4610-ba0f-9ce7ffd548f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:54:58.952057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a1a44-f518-4610-ba0f-9ce7ffd548f9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:54:58.984097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 596/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Sun Jun 26 02:54:58 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:55:01.371606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ebe45-da9e-4b4d-a8f5-4f05fa9bd8c9 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:01.372255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ebe45-da9e-4b4d-a8f5-4f05fa9bd8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:01.372395 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ebe45-da9e-4b4d-a8f5-4f05fa9bd8c9 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:01.374077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 610/1206] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:55:01.379511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804d9e1-0f69-49c8-91dc-f7f1f2c8cbb3 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:01.380008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804d9e1-0f69-49c8-91dc-f7f1f2c8cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:01.380110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804d9e1-0f69-49c8-91dc-f7f1f2c8cbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:01.399699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5804d9e1-0f69-49c8-91dc-f7f1f2c8cbb3 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:55:01.401015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5804d9e1-0f69-49c8-91dc-f7f1f2c8cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:55:01.475030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 597/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:55:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:55:01.499247 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ebe45-da9e-4b4d-a8f5-4f05fa9bd8c9 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:01.618897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ebe45-da9e-4b4d-a8f5-4f05fa9bd8c9 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:01.662527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199ba9a-d42e-4836-8da0-3ace8ec957d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:01.663287 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199ba9a-d42e-4836-8da0-3ace8ec957d1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:01.663567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199ba9a-d42e-4836-8da0-3ace8ec957d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:01.664006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199ba9a-d42e-4836-8da0-3ace8ec957d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:01.675668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199ba9a-d42e-4836-8da0-3ace8ec957d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-3199ba9a-d42e-4836-8da0-3ace8ec957d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:55:01.683922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:01.685212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:01.686176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 611/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:55:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:01.693292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804d9e1-0f69-49c8-91dc-f7f1f2c8cbb3 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:01.739940 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:01.806282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804d9e1-0f69-49c8-91dc-f7f1f2c8cbb3 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:01.844773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb04964-1486-4ffc-b282-dffa9d57342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:01.845462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb04964-1486-4ffc-b282-dffa9d57342e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:01.845743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb04964-1486-4ffc-b282-dffa9d57342e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:01.846165 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb04964-1486-4ffc-b282-dffa9d57342e None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:01.846925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb04964-1486-4ffc-b282-dffa9d57342e None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:01.847263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb04964-1486-4ffc-b282-dffa9d57342e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:01.848654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb04964-1486-4ffc-b282-dffa9d57342e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:01.858066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 598/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:55:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:01.864437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199ba9a-d42e-4836-8da0-3ace8ec957d1 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:01.933245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:01.994928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199ba9a-d42e-4836-8da0-3ace8ec957d1 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:02.034320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b2a86-3257-484a-aa19-c4bea96731e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:02.035326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b2a86-3257-484a-aa19-c4bea96731e6 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:02.035648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b2a86-3257-484a-aa19-c4bea96731e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:02.036267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b2a86-3257-484a-aa19-c4bea96731e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:02.066633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b2a86-3257-484a-aa19-c4bea96731e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:02.068442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b2a86-3257-484a-aa19-c4bea96731e6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-fd1b2a86-3257-484a-aa19-c4bea96731e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:02.098954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:02.100205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:02.101626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:02.101626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:02.101626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:02.101626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:02.106524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 612/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:55:02.112334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb04964-1486-4ffc-b282-dffa9d57342e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:02.281074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:02.287436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb04964-1486-4ffc-b282-dffa9d57342e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:02.353976 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5c464-7292-4b39-a7c0-5ab856f8bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:02.354595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c464-7292-4b39-a7c0-5ab856f8bf9e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:02.354952 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c464-7292-4b39-a7c0-5ab856f8bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:02.355370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c464-7292-4b39-a7c0-5ab856f8bf9e None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:02.356205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5c464-7292-4b39-a7c0-5ab856f8bf9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:02.356677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5c464-7292-4b39-a7c0-5ab856f8bf9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:02.358182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5c464-7292-4b39-a7c0-5ab856f8bf9e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:02.372654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 599/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:02.378359 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b2a86-3257-484a-aa19-c4bea96731e6 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:02.502469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b2a86-3257-484a-aa19-c4bea96731e6 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:02.504677 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:02.544054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e9288-7f3a-4ac5-8583-f63cdcf54da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:02.544054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e9288-7f3a-4ac5-8583-f63cdcf54da7 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:02.544054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e9288-7f3a-4ac5-8583-f63cdcf54da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:02.544054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e9288-7f3a-4ac5-8583-f63cdcf54da7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:02.552435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e9288-7f3a-4ac5-8583-f63cdcf54da7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:02.554397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e9288-7f3a-4ac5-8583-f63cdcf54da7 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-572e9288-7f3a-4ac5-8583-f63cdcf54da7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:55:02.572374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:02.574193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:02.575492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:02.575492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:02.575492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:55:02.575492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:55:02.575492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:55:02.575492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:55:02.575492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:55:02.575492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:55:02.575492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:02.575492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:02.575492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 613/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:02.579505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5c464-7292-4b39-a7c0-5ab856f8bf9e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:02.695636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5c464-7292-4b39-a7c0-5ab856f8bf9e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:02.731937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d36f66-c1fa-4f38-8529-da8390f55bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:02.732706 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d36f66-c1fa-4f38-8529-da8390f55bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:02.733000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d36f66-c1fa-4f38-8529-da8390f55bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:02.733242 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d36f66-c1fa-4f38-8529-da8390f55bc3 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:02.734222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d36f66-c1fa-4f38-8529-da8390f55bc3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:02.734560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d36f66-c1fa-4f38-8529-da8390f55bc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:02.736294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d36f66-c1fa-4f38-8529-da8390f55bc3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:02.756925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 600/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Jun 26 02:55:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:02.762901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e9288-7f3a-4ac5-8583-f63cdcf54da7 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:02.878653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e9288-7f3a-4ac5-8583-f63cdcf54da7 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:02.918304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f5a2e-990e-45a9-bdfe-1297935fdf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:02.918963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5a2e-990e-45a9-bdfe-1297935fdf6b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:02.919321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5a2e-990e-45a9-bdfe-1297935fdf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:02.919605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5a2e-990e-45a9-bdfe-1297935fdf6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:02.958732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:03.007365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f5a2e-990e-45a9-bdfe-1297935fdf6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:03.009064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f5a2e-990e-45a9-bdfe-1297935fdf6b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:03.126481 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 614/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:55:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 26 02:55:03.133050 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d36f66-c1fa-4f38-8529-da8390f55bc3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:03.155361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:03.245287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d36f66-c1fa-4f38-8529-da8390f55bc3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:03.290272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ee35a-16ee-44f3-8375-a1b45a840580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:03.291181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee35a-16ee-44f3-8375-a1b45a840580 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:03.293782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee35a-16ee-44f3-8375-a1b45a840580 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:03.293782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee35a-16ee-44f3-8375-a1b45a840580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:03.303810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ee35a-16ee-44f3-8375-a1b45a840580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:03.305541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ee35a-16ee-44f3-8375-a1b45a840580 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-646ee35a-16ee-44f3-8375-a1b45a840580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:03.327909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:03.329445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:03.330779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:03.330779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:03.330779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:03.330779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:03.330779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 601/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:03.335293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f5a2e-990e-45a9-bdfe-1297935fdf6b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:03.405244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:03.452819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f5a2e-990e-45a9-bdfe-1297935fdf6b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:03.495178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c692df-f0fd-43eb-8044-95c3db81ce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:03.495905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c692df-f0fd-43eb-8044-95c3db81ce1e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:03.496151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c692df-f0fd-43eb-8044-95c3db81ce1e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:03.496434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c692df-f0fd-43eb-8044-95c3db81ce1e None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:03.497181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c692df-f0fd-43eb-8044-95c3db81ce1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:03.497496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c692df-f0fd-43eb-8044-95c3db81ce1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:03.498926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c692df-f0fd-43eb-8044-95c3db81ce1e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:03.512397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 615/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:03.518715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ee35a-16ee-44f3-8375-a1b45a840580 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:03.596539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:03.634536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ee35a-16ee-44f3-8375-a1b45a840580 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:03.673579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b3df4-a216-4aec-bd2a-b20fb048de0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:03.674298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b3df4-a216-4aec-bd2a-b20fb048de0f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:03.674620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b3df4-a216-4aec-bd2a-b20fb048de0f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:03.674849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b3df4-a216-4aec-bd2a-b20fb048de0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:03.682148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b3df4-a216-4aec-bd2a-b20fb048de0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:03.683638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b3df4-a216-4aec-bd2a-b20fb048de0f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9f6b3df4-a216-4aec-bd2a-b20fb048de0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:55:03.699372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:03.700597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:03.701500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:55:03.701500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:55:03.701500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:55:03.701500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:55:03.701500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:55:03.701500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:55:03.701500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:03.701500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:03.701500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 602/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:55:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:55:03.706883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c692df-f0fd-43eb-8044-95c3db81ce1e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:03.817970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c692df-f0fd-43eb-8044-95c3db81ce1e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:03.842254 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:03.855124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2537d-0892-4fa1-b2e8-9c935353082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:03.855834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2537d-0892-4fa1-b2e8-9c935353082f None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:03.856073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2537d-0892-4fa1-b2e8-9c935353082f None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:03.856344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2537d-0892-4fa1-b2e8-9c935353082f None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:03.857134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2537d-0892-4fa1-b2e8-9c935353082f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:03.857466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2537d-0892-4fa1-b2e8-9c935353082f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:03.858888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2537d-0892-4fa1-b2e8-9c935353082f None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:03.877745 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 616/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:55:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:55:03.883963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b3df4-a216-4aec-bd2a-b20fb048de0f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:03.990059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b3df4-a216-4aec-bd2a-b20fb048de0f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:04.019604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:04.026420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335de79f-8a97-4cf0-8718-a4df9919cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:04.027226 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de79f-8a97-4cf0-8718-a4df9919cdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:04.027554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de79f-8a97-4cf0-8718-a4df9919cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:04.027895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335de79f-8a97-4cf0-8718-a4df9919cdc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:04.028810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335de79f-8a97-4cf0-8718-a4df9919cdc6 None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=5ae5f8f789424969bd575f7360847261) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:04.029182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335de79f-8a97-4cf0-8718-a4df9919cdc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:04.030662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335de79f-8a97-4cf0-8718-a4df9919cdc6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:04.047015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 603/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:55:03 2022] GET /identity/v3/role_assignments?user.id=5ae5f8f789424969bd575f7360847261&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:55:06.064139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647e8bf-1d99-43b7-9d32-f82781996d84 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:06.064696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647e8bf-1d99-43b7-9d32-f82781996d84 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:06.064696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647e8bf-1d99-43b7-9d32-f82781996d84 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:06.066082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 617/1220] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:55:06.072012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2981ede-52fd-44b5-b9f9-1d9c0142b817 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:06.072522 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2981ede-52fd-44b5-b9f9-1d9c0142b817 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:06.072713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2981ede-52fd-44b5-b9f9-1d9c0142b817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:06.090949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-d2981ede-52fd-44b5-b9f9-1d9c0142b817 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:55:06.092210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d2981ede-52fd-44b5-b9f9-1d9c0142b817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:55:06.163260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 604/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:55:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:55:06.187352 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647e8bf-1d99-43b7-9d32-f82781996d84 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:06.301297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647e8bf-1d99-43b7-9d32-f82781996d84 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:06.338549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55923b3c-43e9-4342-aa16-eb9f9c197c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:06.339423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55923b3c-43e9-4342-aa16-eb9f9c197c52 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:06.339766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55923b3c-43e9-4342-aa16-eb9f9c197c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:06.340146 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55923b3c-43e9-4342-aa16-eb9f9c197c52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:06.351689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55923b3c-43e9-4342-aa16-eb9f9c197c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-55923b3c-43e9-4342-aa16-eb9f9c197c52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:55:06.360211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:06.361382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:06.362392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 618/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:55:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:06.368476 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2981ede-52fd-44b5-b9f9-1d9c0142b817 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:06.473649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2981ede-52fd-44b5-b9f9-1d9c0142b817 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:06.500484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:06.512720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eec4af-23be-424b-84ec-65d7e815a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:06.513481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eec4af-23be-424b-84ec-65d7e815a3da None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:06.513767 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eec4af-23be-424b-84ec-65d7e815a3da None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:06.514046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eec4af-23be-424b-84ec-65d7e815a3da None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:06.514819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eec4af-23be-424b-84ec-65d7e815a3da None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:06.515255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eec4af-23be-424b-84ec-65d7e815a3da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:06.516872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eec4af-23be-424b-84ec-65d7e815a3da None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:06.526533 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 605/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:55:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:06.532974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55923b3c-43e9-4342-aa16-eb9f9c197c52 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:06.581902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:06.647651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55923b3c-43e9-4342-aa16-eb9f9c197c52 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:06.684021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2add6-3a6f-4375-b853-e2c72bd53099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:06.684820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2add6-3a6f-4375-b853-e2c72bd53099 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:06.685134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2add6-3a6f-4375-b853-e2c72bd53099 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:06.685382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2add6-3a6f-4375-b853-e2c72bd53099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:06.696495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2add6-3a6f-4375-b853-e2c72bd53099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:06.697969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2add6-3a6f-4375-b853-e2c72bd53099 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-8bb2add6-3a6f-4375-b853-e2c72bd53099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:06.715608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:06.716720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:06.717753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:06.717753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:06.717753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:06.717753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:06.717753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 619/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:06.723311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eec4af-23be-424b-84ec-65d7e815a3da None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:06.837063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eec4af-23be-424b-84ec-65d7e815a3da None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:06.875704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792c255-db69-4fac-bba8-4f60c7cce146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:06.876494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792c255-db69-4fac-bba8-4f60c7cce146 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:06.876813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792c255-db69-4fac-bba8-4f60c7cce146 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:06.877146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792c255-db69-4fac-bba8-4f60c7cce146 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:06.878029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792c255-db69-4fac-bba8-4f60c7cce146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:06.878365 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792c255-db69-4fac-bba8-4f60c7cce146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:06.879890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792c255-db69-4fac-bba8-4f60c7cce146 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:06.894507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 606/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:06.900608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2add6-3a6f-4375-b853-e2c72bd53099 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:06.999256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:07.006444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2add6-3a6f-4375-b853-e2c72bd53099 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:07.041771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56d99e-4d86-4b1c-ab91-38bf36a347cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:07.042810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d99e-4d86-4b1c-ab91-38bf36a347cd None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:07.043184 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d99e-4d86-4b1c-ab91-38bf36a347cd None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:07.043530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d99e-4d86-4b1c-ab91-38bf36a347cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:07.052570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56d99e-4d86-4b1c-ab91-38bf36a347cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:07.054463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56d99e-4d86-4b1c-ab91-38bf36a347cd None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-eb56d99e-4d86-4b1c-ab91-38bf36a347cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:55:07.071966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:07.073515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:07.074643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:07.074643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:07.074643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:55:07.074643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:55:07.074643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:55:07.074643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:55:07.074643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:55:07.074643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:55:07.074643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:07.074643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:07.074643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 620/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:07.079382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792c255-db69-4fac-bba8-4f60c7cce146 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:07.128873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:07.186803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792c255-db69-4fac-bba8-4f60c7cce146 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:07.222923 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6021d6-723e-48e9-9bda-f53cef65d46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:07.223638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6021d6-723e-48e9-9bda-f53cef65d46d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:07.223907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6021d6-723e-48e9-9bda-f53cef65d46d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:07.224259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6021d6-723e-48e9-9bda-f53cef65d46d None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:07.225217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6021d6-723e-48e9-9bda-f53cef65d46d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:07.225505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6021d6-723e-48e9-9bda-f53cef65d46d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:07.227166 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6021d6-723e-48e9-9bda-f53cef65d46d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:07.248641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 607/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Jun 26 02:55:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:07.254671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56d99e-4d86-4b1c-ab91-38bf36a347cd None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:07.363682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56d99e-4d86-4b1c-ab91-38bf36a347cd None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:07.396674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f83bf1-5caf-4b70-9283-9133a0b50fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:07.397470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83bf1-5caf-4b70-9283-9133a0b50fef None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:07.397753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83bf1-5caf-4b70-9283-9133a0b50fef None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:07.398028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83bf1-5caf-4b70-9283-9133a0b50fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:07.408304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f83bf1-5caf-4b70-9283-9133a0b50fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:07.409778 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f83bf1-5caf-4b70-9283-9133a0b50fef None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-53f83bf1-5caf-4b70-9283-9133a0b50fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:07.427176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:07.428312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:07.429843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:07.429843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:07.429843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:07.429843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:07.429843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 621/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:07.437728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6021d6-723e-48e9-9bda-f53cef65d46d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:07.546054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6021d6-723e-48e9-9bda-f53cef65d46d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:07.548631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:07.581083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ace89d-a5a4-4289-b193-afe0672570e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:07.581858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ace89d-a5a4-4289-b193-afe0672570e0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:07.582141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ace89d-a5a4-4289-b193-afe0672570e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:07.582414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ace89d-a5a4-4289-b193-afe0672570e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:07.583147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ace89d-a5a4-4289-b193-afe0672570e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:07.583476 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ace89d-a5a4-4289-b193-afe0672570e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:07.584892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ace89d-a5a4-4289-b193-afe0672570e0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:07.597068 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 608/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:07.602876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f83bf1-5caf-4b70-9283-9133a0b50fef None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:07.612257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:07.724265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f83bf1-5caf-4b70-9283-9133a0b50fef None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:07.758089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbb085-8de3-4ea6-8e84-15c4534807da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:07.758970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbb085-8de3-4ea6-8e84-15c4534807da None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:07.759278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbb085-8de3-4ea6-8e84-15c4534807da None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:07.759553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbb085-8de3-4ea6-8e84-15c4534807da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:07.769407 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbb085-8de3-4ea6-8e84-15c4534807da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:07.772185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbb085-8de3-4ea6-8e84-15c4534807da None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-60cbb085-8de3-4ea6-8e84-15c4534807da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:55:07.792895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:07.794284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:07.795408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:55:07.795408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:55:07.795408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:55:07.795408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:55:07.795408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:55:07.795408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:55:07.795408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:07.795408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:07.795408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 622/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:55:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:55:07.801764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ace89d-a5a4-4289-b193-afe0672570e0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:07.908361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ace89d-a5a4-4289-b193-afe0672570e0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:07.945798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55424621-7d63-497b-a3d3-33a62a8ce9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:07.946701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55424621-7d63-497b-a3d3-33a62a8ce9db None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:07.947226 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55424621-7d63-497b-a3d3-33a62a8ce9db None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:07.947651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55424621-7d63-497b-a3d3-33a62a8ce9db None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:07.948761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55424621-7d63-497b-a3d3-33a62a8ce9db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:07.949215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55424621-7d63-497b-a3d3-33a62a8ce9db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:07.950879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55424621-7d63-497b-a3d3-33a62a8ce9db None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:07.968062 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 609/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:55:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:07.975679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbb085-8de3-4ea6-8e84-15c4534807da None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:08.051854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:08.090187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbb085-8de3-4ea6-8e84-15c4534807da None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:08.125974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803583fc-5c3c-4cf7-bfc7-3c737925ccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:08.127070 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803583fc-5c3c-4cf7-bfc7-3c737925ccfb None admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:08.127401 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803583fc-5c3c-4cf7-bfc7-3c737925ccfb None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:08.127657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803583fc-5c3c-4cf7-bfc7-3c737925ccfb None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/5ae5f8f789424969bd575f7360847261/roles/cd3a257aec1b4b1694563a46b1e71a03` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:08.143845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803583fc-5c3c-4cf7-bfc7-3c737925ccfb None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=5ae5f8f789424969bd575f7360847261, role_id=cd3a257aec1b4b1694563a46b1e71a03)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:08.145330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803583fc-5c3c-4cf7-bfc7-3c737925ccfb None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:08.158570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 623/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:55:07 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/5ae5f8f789424969bd575f7360847261/roles/cd3a257aec1b4b1694563a46b1e71a03 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:55:10.227677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8923-bf13-4961-a0df-2d39c59918b6 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:10.228288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8923-bf13-4961-a0df-2d39c59918b6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:10.228288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8923-bf13-4961-a0df-2d39c59918b6 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:10.229708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 610/1233] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:55:10.235503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b3271-2ee7-422f-bce6-76777f9bcb78 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:10.235956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b3271-2ee7-422f-bce6-76777f9bcb78 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:10.236061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b3271-2ee7-422f-bce6-76777f9bcb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:10.253491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-864b3271-2ee7-422f-bce6-76777f9bcb78 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:55:10.254752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-864b3271-2ee7-422f-bce6-76777f9bcb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:55:10.333650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 624/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:55:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:55:10.363756 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe8923-bf13-4961-a0df-2d39c59918b6 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:10.391917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:10.479589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe8923-bf13-4961-a0df-2d39c59918b6 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:10.520975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c70b80-8d54-4aa8-af52-ad842cc483e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:10.522100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c70b80-8d54-4aa8-af52-ad842cc483e8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:10.522399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c70b80-8d54-4aa8-af52-ad842cc483e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:10.522726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c70b80-8d54-4aa8-af52-ad842cc483e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:10.536665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c70b80-8d54-4aa8-af52-ad842cc483e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-98c70b80-8d54-4aa8-af52-ad842cc483e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:55:10.544928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:10.545910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:10.546778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 611/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Sun Jun 26 02:55:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:10.552236 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b3271-2ee7-422f-bce6-76777f9bcb78 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:10.599680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:10.655812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b3271-2ee7-422f-bce6-76777f9bcb78 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:10.695148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d29cc6-a23b-482b-8022-02f3fad57358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:10.695837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d29cc6-a23b-482b-8022-02f3fad57358 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:10.696118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d29cc6-a23b-482b-8022-02f3fad57358 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:10.696391 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d29cc6-a23b-482b-8022-02f3fad57358 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:10.697142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d29cc6-a23b-482b-8022-02f3fad57358 None admin] RBAC: Adding query filter params (name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:10.697449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d29cc6-a23b-482b-8022-02f3fad57358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:10.698837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d29cc6-a23b-482b-8022-02f3fad57358 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:10.707933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 625/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Sun Jun 26 02:55:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:10.714177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c70b80-8d54-4aa8-af52-ad842cc483e8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:10.804693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:10.820958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c70b80-8d54-4aa8-af52-ad842cc483e8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:10.859797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73457721-a032-4181-ae3b-0c96955a337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:10.860674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73457721-a032-4181-ae3b-0c96955a337e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:10.860954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73457721-a032-4181-ae3b-0c96955a337e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:10.861285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73457721-a032-4181-ae3b-0c96955a337e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:10.874259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73457721-a032-4181-ae3b-0c96955a337e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:10.875923 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73457721-a032-4181-ae3b-0c96955a337e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-73457721-a032-4181-ae3b-0c96955a337e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:10.893621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:10.894717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:10.900793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:10.900793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:10.900793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:10.900793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:10.900793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 612/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:10.901122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d29cc6-a23b-482b-8022-02f3fad57358 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:11.015626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d29cc6-a23b-482b-8022-02f3fad57358 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:11.025556 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:11.053957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3524ca8-f30e-45a8-a2c9-461baaba4f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:11.054642 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3524ca8-f30e-45a8-a2c9-461baaba4f2d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:11.054976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3524ca8-f30e-45a8-a2c9-461baaba4f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:11.055237 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3524ca8-f30e-45a8-a2c9-461baaba4f2d None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:11.055963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3524ca8-f30e-45a8-a2c9-461baaba4f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:11.056271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3524ca8-f30e-45a8-a2c9-461baaba4f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:11.057663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3524ca8-f30e-45a8-a2c9-461baaba4f2d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:11.069721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 626/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:11.075818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73457721-a032-4181-ae3b-0c96955a337e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:11.178336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73457721-a032-4181-ae3b-0c96955a337e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:11.212823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d1d5c-253f-4200-b1e9-3cf6d567e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:11.213657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d1d5c-253f-4200-b1e9-3cf6d567e575 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:11.213989 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d1d5c-253f-4200-b1e9-3cf6d567e575 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:11.214272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d1d5c-253f-4200-b1e9-3cf6d567e575 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:11.217175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:11.223763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d1d5c-253f-4200-b1e9-3cf6d567e575 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:11.226084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d1d5c-253f-4200-b1e9-3cf6d567e575 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9c4d1d5c-253f-4200-b1e9-3cf6d567e575 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:55:11.244083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:11.245689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:11.246877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:11.246877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:11.246877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:55:11.246877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:55:11.246877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:55:11.246877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:55:11.246877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:55:11.246877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:55:11.246877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:11.246877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:11.246877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 613/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:55:11.251800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3524ca8-f30e-45a8-a2c9-461baaba4f2d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:11.373278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3524ca8-f30e-45a8-a2c9-461baaba4f2d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:11.409845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4f47f-e392-496a-b7b0-df945735391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:11.410920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4f47f-e392-496a-b7b0-df945735391b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:11.411232 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4f47f-e392-496a-b7b0-df945735391b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:11.411508 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4f47f-e392-496a-b7b0-df945735391b None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:11.412380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4f47f-e392-496a-b7b0-df945735391b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:11.412686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4f47f-e392-496a-b7b0-df945735391b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:11.414221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4f47f-e392-496a-b7b0-df945735391b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:11.431979 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 627/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Jun 26 02:55:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:11.437810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d1d5c-253f-4200-b1e9-3cf6d567e575 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:11.541059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d1d5c-253f-4200-b1e9-3cf6d567e575 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:11.574266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e61232-4f9d-4a87-84e0-18b77161f730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:11.574856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e61232-4f9d-4a87-84e0-18b77161f730 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:11.575170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e61232-4f9d-4a87-84e0-18b77161f730 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:11.575449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e61232-4f9d-4a87-84e0-18b77161f730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:11.638302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:11.646296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e61232-4f9d-4a87-84e0-18b77161f730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:11.647811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e61232-4f9d-4a87-84e0-18b77161f730 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:11.764316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 614/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:55:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:55:11.770255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4f47f-e392-496a-b7b0-df945735391b None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:11.800460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:11.881793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4f47f-e392-496a-b7b0-df945735391b None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:11.920735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8f0d7-6a14-4496-afc5-c3fb6386c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:11.921475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8f0d7-6a14-4496-afc5-c3fb6386c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:11.921805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8f0d7-6a14-4496-afc5-c3fb6386c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:11.922083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8f0d7-6a14-4496-afc5-c3fb6386c4a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:11.932737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8f0d7-6a14-4496-afc5-c3fb6386c4a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:11.934200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8f0d7-6a14-4496-afc5-c3fb6386c4a6 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-f0d8f0d7-6a14-4496-afc5-c3fb6386c4a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:11.951856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:11.952921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:11.953876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:11.953876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:11.953876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:11.953876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:11.953876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 628/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:11.959146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e61232-4f9d-4a87-84e0-18b77161f730 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:12.058691 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:12.064862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e61232-4f9d-4a87-84e0-18b77161f730 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:12.101408 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c502d7-dd63-4a94-9314-613bc9e3b22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:12.102079 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c502d7-dd63-4a94-9314-613bc9e3b22f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:12.102358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c502d7-dd63-4a94-9314-613bc9e3b22f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:12.102630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c502d7-dd63-4a94-9314-613bc9e3b22f None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:12.103516 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c502d7-dd63-4a94-9314-613bc9e3b22f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:12.103933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c502d7-dd63-4a94-9314-613bc9e3b22f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:12.105664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c502d7-dd63-4a94-9314-613bc9e3b22f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:12.120435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 615/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:12.126323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8f0d7-6a14-4496-afc5-c3fb6386c4a6 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:12.212818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:12.235230 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8f0d7-6a14-4496-afc5-c3fb6386c4a6 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:12.274293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21113c2-f6c0-4582-b9f2-12458dfacaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:12.275371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21113c2-f6c0-4582-b9f2-12458dfacaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:12.275502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21113c2-f6c0-4582-b9f2-12458dfacaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:12.275799 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21113c2-f6c0-4582-b9f2-12458dfacaf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:12.284294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21113c2-f6c0-4582-b9f2-12458dfacaf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:12.286294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21113c2-f6c0-4582-b9f2-12458dfacaf0 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-a21113c2-f6c0-4582-b9f2-12458dfacaf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:55:12.301833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:12.302846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:12.303962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:55:12.303962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:55:12.303962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:55:12.303962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:55:12.303962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:55:12.303962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:55:12.303962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:12.303962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:12.303962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 629/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:55:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:12.309756 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c502d7-dd63-4a94-9314-613bc9e3b22f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:12.417817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c502d7-dd63-4a94-9314-613bc9e3b22f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:12.450329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d180b63-a88d-47a1-809c-7e5255d4235c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:12.451014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d180b63-a88d-47a1-809c-7e5255d4235c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:12.451294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d180b63-a88d-47a1-809c-7e5255d4235c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:12.451568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d180b63-a88d-47a1-809c-7e5255d4235c None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:12.452347 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d180b63-a88d-47a1-809c-7e5255d4235c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:12.452651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d180b63-a88d-47a1-809c-7e5255d4235c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:12.454078 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d180b63-a88d-47a1-809c-7e5255d4235c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:12.468999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 616/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:55:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:12.475702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21113c2-f6c0-4582-b9f2-12458dfacaf0 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:12.593016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21113c2-f6c0-4582-b9f2-12458dfacaf0 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:12.628047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b6af6-0a69-4919-b9ac-f61903ec5aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:12.628734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b6af6-0a69-4919-b9ac-f61903ec5aab None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:12.629020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b6af6-0a69-4919-b9ac-f61903ec5aab None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:12.629296 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b6af6-0a69-4919-b9ac-f61903ec5aab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:12.630131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b6af6-0a69-4919-b9ac-f61903ec5aab None admin] RBAC: Adding query filter params (role.id=cd3a257aec1b4b1694563a46b1e71a03, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=5ae5f8f789424969bd575f7360847261) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:12.630461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b6af6-0a69-4919-b9ac-f61903ec5aab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:12.631971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b6af6-0a69-4919-b9ac-f61903ec5aab None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:12.638424 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 630/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:55:12 2022] GET /identity/v3/role_assignments?user.id=5ae5f8f789424969bd575f7360847261&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=cd3a257aec1b4b1694563a46b1e71a03 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:14.683925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d7ad-d1bf-4092-b562-51f4274c7f44 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:14.684534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d7ad-d1bf-4092-b562-51f4274c7f44 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:14.684534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d7ad-d1bf-4092-b562-51f4274c7f44 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:14.686011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 617/1247] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:55:14.691087 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd2074-b346-42c0-bd5a-b2f877d6cbc3 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:14.691527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd2074-b346-42c0-bd5a-b2f877d6cbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:14.691639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd2074-b346-42c0-bd5a-b2f877d6cbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:14.697307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:14.710057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4cdd2074-b346-42c0-bd5a-b2f877d6cbc3 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:55:14.711420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4cdd2074-b346-42c0-bd5a-b2f877d6cbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:55:14.781836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 631/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:55:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:55:14.807713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d7ad-d1bf-4092-b562-51f4274c7f44 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:14.829969 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:14.922066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d7ad-d1bf-4092-b562-51f4274c7f44 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:14.961035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8446d4d-1269-4b29-9db3-54cc087f49ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:14.961840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8446d4d-1269-4b29-9db3-54cc087f49ae None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:14.962121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8446d4d-1269-4b29-9db3-54cc087f49ae None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:14.962399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8446d4d-1269-4b29-9db3-54cc087f49ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:14.973470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8446d4d-1269-4b29-9db3-54cc087f49ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b8446d4d-1269-4b29-9db3-54cc087f49ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:55:14.981787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:14.982939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:14.983901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 618/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:55:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:14.989641 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd2074-b346-42c0-bd5a-b2f877d6cbc3 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:15.106191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd2074-b346-42c0-bd5a-b2f877d6cbc3 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:15.141949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:15.148979 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eb7d3-d659-426d-8876-e57e3d617d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:15.149847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb7d3-d659-426d-8876-e57e3d617d77 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:15.150195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb7d3-d659-426d-8876-e57e3d617d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:15.150541 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb7d3-d659-426d-8876-e57e3d617d77 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:15.151406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eb7d3-d659-426d-8876-e57e3d617d77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:15.151785 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eb7d3-d659-426d-8876-e57e3d617d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:15.153274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eb7d3-d659-426d-8876-e57e3d617d77 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:15.164412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 632/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:55:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:15.168809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8446d4d-1269-4b29-9db3-54cc087f49ae None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:15.255287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:15.281995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8446d4d-1269-4b29-9db3-54cc087f49ae None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:15.319988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa5b93-517a-4ef1-8d97-4b94ac60478c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:15.320870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa5b93-517a-4ef1-8d97-4b94ac60478c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:15.321152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa5b93-517a-4ef1-8d97-4b94ac60478c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:15.321426 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa5b93-517a-4ef1-8d97-4b94ac60478c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:15.333084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa5b93-517a-4ef1-8d97-4b94ac60478c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:15.334736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa5b93-517a-4ef1-8d97-4b94ac60478c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-05aa5b93-517a-4ef1-8d97-4b94ac60478c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:15.353973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:15.355112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:15.360854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:15.360854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:15.360854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:15.360854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:15.360854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 619/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:15.361242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eb7d3-d659-426d-8876-e57e3d617d77 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:15.469099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eb7d3-d659-426d-8876-e57e3d617d77 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:15.508681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b8bb5-5733-42e3-aade-fb89fdbcb94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:15.509355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b8bb5-5733-42e3-aade-fb89fdbcb94e None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:15.509642 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b8bb5-5733-42e3-aade-fb89fdbcb94e None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:15.509926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b8bb5-5733-42e3-aade-fb89fdbcb94e None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:15.510650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b8bb5-5733-42e3-aade-fb89fdbcb94e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:15.510956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b8bb5-5733-42e3-aade-fb89fdbcb94e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:15.512469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b8bb5-5733-42e3-aade-fb89fdbcb94e None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:15.527116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 633/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:15.534031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa5b93-517a-4ef1-8d97-4b94ac60478c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:15.655568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa5b93-517a-4ef1-8d97-4b94ac60478c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:15.684116 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:15.693178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a4068-6e12-4389-a443-63d57ab40716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:15.694155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a4068-6e12-4389-a443-63d57ab40716 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:15.694447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a4068-6e12-4389-a443-63d57ab40716 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:15.694729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a4068-6e12-4389-a443-63d57ab40716 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:15.703935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a4068-6e12-4389-a443-63d57ab40716 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:15.705709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a4068-6e12-4389-a443-63d57ab40716 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-795a4068-6e12-4389-a443-63d57ab40716 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:55:15.722036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:15.723328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:15.729148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:15.729148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:15.729148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:55:15.729148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:55:15.729148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:55:15.729148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:55:15.729148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:55:15.729148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:55:15.729148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:15.729148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:15.729148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 620/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:15.729741 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b8bb5-5733-42e3-aade-fb89fdbcb94e None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:15.793089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:15.843910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b8bb5-5733-42e3-aade-fb89fdbcb94e None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:15.881839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5f667-5598-4fd9-990b-dbfef7d10134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:15.882766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5f667-5598-4fd9-990b-dbfef7d10134 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:15.883123 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5f667-5598-4fd9-990b-dbfef7d10134 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:15.883454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5f667-5598-4fd9-990b-dbfef7d10134 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:15.884366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5f667-5598-4fd9-990b-dbfef7d10134 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:15.884716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5f667-5598-4fd9-990b-dbfef7d10134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:15.886419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5f667-5598-4fd9-990b-dbfef7d10134 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:15.906491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 634/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Jun 26 02:55:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:55:15.912794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a4068-6e12-4389-a443-63d57ab40716 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:16.022618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a4068-6e12-4389-a443-63d57ab40716 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:16.062950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fc627-268d-4f8c-817a-9c126833a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:16.063634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fc627-268d-4f8c-817a-9c126833a85a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:16.063921 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fc627-268d-4f8c-817a-9c126833a85a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:16.064272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fc627-268d-4f8c-817a-9c126833a85a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:16.129882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:16.143776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fc627-268d-4f8c-817a-9c126833a85a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:16.145479 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fc627-268d-4f8c-817a-9c126833a85a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:16.281595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 621/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:55:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 26 02:55:16.289294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5f667-5598-4fd9-990b-dbfef7d10134 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:16.405226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5f667-5598-4fd9-990b-dbfef7d10134 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:16.419532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:16.442036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f8c71-67e0-46a9-8cb3-02a384e91afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:16.442947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f8c71-67e0-46a9-8cb3-02a384e91afb None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:16.443316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f8c71-67e0-46a9-8cb3-02a384e91afb None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:16.443575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f8c71-67e0-46a9-8cb3-02a384e91afb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:16.455016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f8c71-67e0-46a9-8cb3-02a384e91afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:16.456833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f8c71-67e0-46a9-8cb3-02a384e91afb None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-fb5f8c71-67e0-46a9-8cb3-02a384e91afb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:16.478539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:16.479665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:16.480742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:16.480742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:16.480742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:16.480742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:16.480742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 635/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:55:16.484266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fc627-268d-4f8c-817a-9c126833a85a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:16.586484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:16.600429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fc627-268d-4f8c-817a-9c126833a85a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:16.635687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec4f9a-55bf-4493-b0ef-1278bae7eaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:16.636356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec4f9a-55bf-4493-b0ef-1278bae7eaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:16.636668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec4f9a-55bf-4493-b0ef-1278bae7eaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:16.636914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec4f9a-55bf-4493-b0ef-1278bae7eaf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:16.637636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec4f9a-55bf-4493-b0ef-1278bae7eaf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:16.637966 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec4f9a-55bf-4493-b0ef-1278bae7eaf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:16.639368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec4f9a-55bf-4493-b0ef-1278bae7eaf4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:16.652727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 622/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:16.658840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f8c71-67e0-46a9-8cb3-02a384e91afb None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:16.767736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f8c71-67e0-46a9-8cb3-02a384e91afb None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:16.805511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e77ae-2478-421d-9a4d-5274532eaac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:16.806394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e77ae-2478-421d-9a4d-5274532eaac2 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:16.806812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e77ae-2478-421d-9a4d-5274532eaac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:16.807124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e77ae-2478-421d-9a4d-5274532eaac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:16.815018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e77ae-2478-421d-9a4d-5274532eaac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:16.816687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e77ae-2478-421d-9a4d-5274532eaac2 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-d44e77ae-2478-421d-9a4d-5274532eaac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:55:16.831702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:16.832826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:16.834007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:55:16.834007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:55:16.834007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:55:16.834007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:55:16.834007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:55:16.834007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:55:16.834007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:16.834007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:16.834007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 636/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:55:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:55:16.839230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec4f9a-55bf-4493-b0ef-1278bae7eaf4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:16.945667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec4f9a-55bf-4493-b0ef-1278bae7eaf4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:16.983131 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db13e46-f70f-4ece-b2a8-fe52e8112fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:16.983872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db13e46-f70f-4ece-b2a8-fe52e8112fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:16.984225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db13e46-f70f-4ece-b2a8-fe52e8112fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:16.984507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db13e46-f70f-4ece-b2a8-fe52e8112fe7 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:16.985435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db13e46-f70f-4ece-b2a8-fe52e8112fe7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:16.985741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db13e46-f70f-4ece-b2a8-fe52e8112fe7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:16.987206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db13e46-f70f-4ece-b2a8-fe52e8112fe7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:17.006735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 623/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:55:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:17.008353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e77ae-2478-421d-9a4d-5274532eaac2 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:17.044443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:17.124738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e77ae-2478-421d-9a4d-5274532eaac2 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:17.157557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4db29-908c-43ba-af5f-06bd85c3f0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:17.158218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4db29-908c-43ba-af5f-06bd85c3f0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:17.158501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4db29-908c-43ba-af5f-06bd85c3f0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:17.158798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4db29-908c-43ba-af5f-06bd85c3f0e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:17.159667 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4db29-908c-43ba-af5f-06bd85c3f0e8 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=5ae5f8f789424969bd575f7360847261) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:17.159978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4db29-908c-43ba-af5f-06bd85c3f0e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:17.161872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4db29-908c-43ba-af5f-06bd85c3f0e8 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:17.167687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 637/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:55:17 2022] GET /identity/v3/role_assignments?user.id=5ae5f8f789424969bd575f7360847261&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:19.229131 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c399-9c55-45d5-bf9f-449aa46056ed None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:19.229697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c399-9c55-45d5-bf9f-449aa46056ed None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:19.229697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c399-9c55-45d5-bf9f-449aa46056ed None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:19.231085 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 624/1261] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:55:19.237566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8423-91a7-4498-9d62-a545dfcf2e75 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:19.238220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8423-91a7-4498-9d62-a545dfcf2e75 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:19.238373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8423-91a7-4498-9d62-a545dfcf2e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:19.263128 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6afb8423-91a7-4498-9d62-a545dfcf2e75 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:55:19.264506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6afb8423-91a7-4498-9d62-a545dfcf2e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:55:19.342542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 638/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:55:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:55:19.368269 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76c399-9c55-45d5-bf9f-449aa46056ed None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:19.380918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:19.490017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76c399-9c55-45d5-bf9f-449aa46056ed None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:19.523685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3abedd-e608-4317-9e7e-012c3400d796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:19.524476 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3abedd-e608-4317-9e7e-012c3400d796 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:19.524759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3abedd-e608-4317-9e7e-012c3400d796 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:19.525037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3abedd-e608-4317-9e7e-012c3400d796 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:19.534968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3abedd-e608-4317-9e7e-012c3400d796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5f3abedd-e608-4317-9e7e-012c3400d796 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:55:19.542908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:19.544033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:19.545029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 625/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:55:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:19.550396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8423-91a7-4498-9d62-a545dfcf2e75 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:19.570112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:19.655025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8423-91a7-4498-9d62-a545dfcf2e75 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:19.691522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e2777-4e33-4442-89e7-fb1a6637c078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:19.692174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e2777-4e33-4442-89e7-fb1a6637c078 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:19.692460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e2777-4e33-4442-89e7-fb1a6637c078 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:19.692766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e2777-4e33-4442-89e7-fb1a6637c078 None admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:19.693519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e2777-4e33-4442-89e7-fb1a6637c078 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:19.693822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e2777-4e33-4442-89e7-fb1a6637c078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:19.695226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e2777-4e33-4442-89e7-fb1a6637c078 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:19.703376 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 639/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:55:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:19.709902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3abedd-e608-4317-9e7e-012c3400d796 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:19.784043 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:19.826455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3abedd-e608-4317-9e7e-012c3400d796 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:19.861161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261af8f9-d0c3-417a-91b3-4969cb58fcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:19.861934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af8f9-d0c3-417a-91b3-4969cb58fcda None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:19.862212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af8f9-d0c3-417a-91b3-4969cb58fcda None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:19.862482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af8f9-d0c3-417a-91b3-4969cb58fcda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:19.874296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261af8f9-d0c3-417a-91b3-4969cb58fcda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:19.875843 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261af8f9-d0c3-417a-91b3-4969cb58fcda None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-261af8f9-d0c3-417a-91b3-4969cb58fcda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:19.892839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:19.893835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:19.895323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:19.895323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:19.895323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:19.895323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:19.895323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 626/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:55:19.903062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e2777-4e33-4442-89e7-fb1a6637c078 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:19.992785 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:20.012004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e2777-4e33-4442-89e7-fb1a6637c078 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:20.046649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd239417-589c-4d94-9272-c9f8a858e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:20.047258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd239417-589c-4d94-9272-c9f8a858e231 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:20.047536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd239417-589c-4d94-9272-c9f8a858e231 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:20.047808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd239417-589c-4d94-9272-c9f8a858e231 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:20.048523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd239417-589c-4d94-9272-c9f8a858e231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:20.048821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd239417-589c-4d94-9272-c9f8a858e231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:20.050190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd239417-589c-4d94-9272-c9f8a858e231 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:20.061750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 640/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:20.067716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261af8f9-d0c3-417a-91b3-4969cb58fcda None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:20.173443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261af8f9-d0c3-417a-91b3-4969cb58fcda None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:20.195796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:20.210975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab73fd-c63e-4ea9-a59f-7b7fa6818c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:20.211798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab73fd-c63e-4ea9-a59f-7b7fa6818c59 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:20.212082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab73fd-c63e-4ea9-a59f-7b7fa6818c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:20.212382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab73fd-c63e-4ea9-a59f-7b7fa6818c59 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:20.219967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab73fd-c63e-4ea9-a59f-7b7fa6818c59 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:20.221405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab73fd-c63e-4ea9-a59f-7b7fa6818c59 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-8dab73fd-c63e-4ea9-a59f-7b7fa6818c59 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:55:20.235511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:20.237018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:20.237982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:20.237982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:20.237982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:55:20.237982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:55:20.237982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:55:20.237982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:55:20.237982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:55:20.237982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:55:20.237982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:20.237982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:20.237982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 627/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:20.242421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd239417-589c-4d94-9272-c9f8a858e231 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:20.350263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd239417-589c-4d94-9272-c9f8a858e231 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:20.389345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af1c68-2d0a-483a-9f56-cafc3d2914c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:20.390008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1c68-2d0a-483a-9f56-cafc3d2914c7 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:20.390287 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1c68-2d0a-483a-9f56-cafc3d2914c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:20.390561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1c68-2d0a-483a-9f56-cafc3d2914c7 None admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:20.391414 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af1c68-2d0a-483a-9f56-cafc3d2914c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:20.391727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af1c68-2d0a-483a-9f56-cafc3d2914c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:20.393155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af1c68-2d0a-483a-9f56-cafc3d2914c7 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:20.401951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:20.411119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 641/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Jun 26 02:55:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:20.417649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab73fd-c63e-4ea9-a59f-7b7fa6818c59 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:20.528858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab73fd-c63e-4ea9-a59f-7b7fa6818c59 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:20.564185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bce72-631e-4ce4-a3c3-e77a00109fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:20.564981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bce72-631e-4ce4-a3c3-e77a00109fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:20.565263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bce72-631e-4ce4-a3c3-e77a00109fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:20.565541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bce72-631e-4ce4-a3c3-e77a00109fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:20.578855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bce72-631e-4ce4-a3c3-e77a00109fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:20.581187 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bce72-631e-4ce4-a3c3-e77a00109fa7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-560bce72-631e-4ce4-a3c3-e77a00109fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:20.599580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:20.600702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:20.601640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:20.601640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:20.601640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:20.601640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:20.601640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 628/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:20.606636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af1c68-2d0a-483a-9f56-cafc3d2914c7 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:20.713533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af1c68-2d0a-483a-9f56-cafc3d2914c7 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:20.750071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b9de3-f916-44a4-9a04-eb19bff313ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:20.750716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b9de3-f916-44a4-9a04-eb19bff313ac None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:20.751032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b9de3-f916-44a4-9a04-eb19bff313ac None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:20.751299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b9de3-f916-44a4-9a04-eb19bff313ac None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:20.752019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b9de3-f916-44a4-9a04-eb19bff313ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:20.752328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b9de3-f916-44a4-9a04-eb19bff313ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:20.753699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b9de3-f916-44a4-9a04-eb19bff313ac None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:20.764919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 642/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:20.773701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bce72-631e-4ce4-a3c3-e77a00109fa7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:20.810250 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:20.879207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bce72-631e-4ce4-a3c3-e77a00109fa7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:20.922478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5447-f18c-408c-a242-0cad3209b176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:20.923668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5447-f18c-408c-a242-0cad3209b176 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:20.924030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5447-f18c-408c-a242-0cad3209b176 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:20.924385 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5447-f18c-408c-a242-0cad3209b176 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:20.936074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5447-f18c-408c-a242-0cad3209b176 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:20.938276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5447-f18c-408c-a242-0cad3209b176 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-3e7c5447-f18c-408c-a242-0cad3209b176 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:55:20.954161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:20.955205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:20.956311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:55:20.956311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:55:20.956311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:55:20.956311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:55:20.956311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:55:20.956311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:55:20.956311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:20.956311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:20.956311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 629/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:55:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:20.961493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b9de3-f916-44a4-9a04-eb19bff313ac None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:21.021340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:21.072361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b9de3-f916-44a4-9a04-eb19bff313ac None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:21.115786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a95659-5545-4746-92b2-02d85e80fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:21.116442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95659-5545-4746-92b2-02d85e80fd7b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:21.116727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95659-5545-4746-92b2-02d85e80fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:21.117005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a95659-5545-4746-92b2-02d85e80fd7b None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:21.117795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a95659-5545-4746-92b2-02d85e80fd7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:21.118105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a95659-5545-4746-92b2-02d85e80fd7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:21.119601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a95659-5545-4746-92b2-02d85e80fd7b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:21.131881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 643/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:55:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:21.137928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5447-f18c-408c-a242-0cad3209b176 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:21.241642 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:21.253578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5447-f18c-408c-a242-0cad3209b176 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:21.292645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd36a5b-c486-4590-aaf5-4a4aeea8e765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:21.293535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd36a5b-c486-4590-aaf5-4a4aeea8e765 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:21.293818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd36a5b-c486-4590-aaf5-4a4aeea8e765 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:21.294089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd36a5b-c486-4590-aaf5-4a4aeea8e765 None admin] PATH_INFO: `/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/5ae5f8f789424969bd575f7360847261/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:21.296155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd36a5b-c486-4590-aaf5-4a4aeea8e765 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0022e70eb947cf8419191744dd7ec2, user_id=5ae5f8f789424969bd575f7360847261, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:21.297612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd36a5b-c486-4590-aaf5-4a4aeea8e765 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:21.311365 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 630/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Sun Jun 26 02:55:21 2022] PUT /identity/v3/projects/7a0022e70eb947cf8419191744dd7ec2/users/5ae5f8f789424969bd575f7360847261/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 02:55:23.291107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcecbb-5033-4eac-be8e-e286ea3a760b None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:23.291695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcecbb-5033-4eac-be8e-e286ea3a760b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:23.291695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcecbb-5033-4eac-be8e-e286ea3a760b None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:23.293030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 644/1274] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:55:23.299130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be510c00-0750-4bb0-8e52-27555f6c529e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:23.299582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be510c00-0750-4bb0-8e52-27555f6c529e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:23.299707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be510c00-0750-4bb0-8e52-27555f6c529e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:23.319672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-be510c00-0750-4bb0-8e52-27555f6c529e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:55:23.320857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-be510c00-0750-4bb0-8e52-27555f6c529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:55:23.396686 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 631/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:55:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:55:23.420656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcecbb-5033-4eac-be8e-e286ea3a760b None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:23.537468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcecbb-5033-4eac-be8e-e286ea3a760b None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:23.554933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:23.585092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbbd89-4130-4c69-badd-a1c222f17154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:23.586297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbbd89-4130-4c69-badd-a1c222f17154 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:23.586593 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbbd89-4130-4c69-badd-a1c222f17154 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:23.586866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbbd89-4130-4c69-badd-a1c222f17154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:23.598180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbbd89-4130-4c69-badd-a1c222f17154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-5fcbbd89-4130-4c69-badd-a1c222f17154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 26 02:55:23.605759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:23.606913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:23.608346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 645/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Sun Jun 26 02:55:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:23.615164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be510c00-0750-4bb0-8e52-27555f6c529e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:23.701711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:23.720720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be510c00-0750-4bb0-8e52-27555f6c529e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:23.755734 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301e797-87ac-4070-b1b4-ea2d1e513151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:23.756817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301e797-87ac-4070-b1b4-ea2d1e513151 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:23.757265 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301e797-87ac-4070-b1b4-ea2d1e513151 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:23.757715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301e797-87ac-4070-b1b4-ea2d1e513151 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:23.758735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301e797-87ac-4070-b1b4-ea2d1e513151 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:23.759042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301e797-87ac-4070-b1b4-ea2d1e513151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:23.760741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301e797-87ac-4070-b1b4-ea2d1e513151 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:23.770548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 632/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Sun Jun 26 02:55:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:23.778926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbbd89-4130-4c69-badd-a1c222f17154 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:23.885926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbbd89-4130-4c69-badd-a1c222f17154 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:23.924944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b90b7b-4e9a-4250-a137-56e57569e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:23.925724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b90b7b-4e9a-4250-a137-56e57569e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:23.926008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b90b7b-4e9a-4250-a137-56e57569e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:23.926283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b90b7b-4e9a-4250-a137-56e57569e2f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:23.937873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b90b7b-4e9a-4250-a137-56e57569e2f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:23.939380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b90b7b-4e9a-4250-a137-56e57569e2f8 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-d8b90b7b-4e9a-4250-a137-56e57569e2f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:23.956530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:23.957542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:23.958814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:23.958814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:23.958814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:23.958814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:23.958814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 646/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 26 02:55:23.966645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301e797-87ac-4070-b1b4-ea2d1e513151 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:24.079305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301e797-87ac-4070-b1b4-ea2d1e513151 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:24.118284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf853cd6-0b8f-4432-946b-dd56fc865517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:24.118933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf853cd6-0b8f-4432-946b-dd56fc865517 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:24.119249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf853cd6-0b8f-4432-946b-dd56fc865517 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:24.119526 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf853cd6-0b8f-4432-946b-dd56fc865517 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:24.120244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf853cd6-0b8f-4432-946b-dd56fc865517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:24.120550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf853cd6-0b8f-4432-946b-dd56fc865517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:24.121927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf853cd6-0b8f-4432-946b-dd56fc865517 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:24.133665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 633/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:24.142560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b90b7b-4e9a-4250-a137-56e57569e2f8 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:24.175496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:24.258213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b90b7b-4e9a-4250-a137-56e57569e2f8 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:24.299526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add689e-4706-4b99-aa67-32e092b51144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:24.300330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add689e-4706-4b99-aa67-32e092b51144 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:24.300611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add689e-4706-4b99-aa67-32e092b51144 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:24.300886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add689e-4706-4b99-aa67-32e092b51144 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:24.308587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add689e-4706-4b99-aa67-32e092b51144 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:24.310087 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add689e-4706-4b99-aa67-32e092b51144 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-3add689e-4706-4b99-aa67-32e092b51144 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 26 02:55:24.324657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:24.325801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:24.326816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:24.326816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:24.326816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 26 02:55:24.326816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 26 02:55:24.326816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 26 02:55:24.326816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 26 02:55:24.326816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 26 02:55:24.326816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 26 02:55:24.326816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 26 02:55:24.326816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:24.326816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 647/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:24.332030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf853cd6-0b8f-4432-946b-dd56fc865517 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:24.336040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:24.444354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf853cd6-0b8f-4432-946b-dd56fc865517 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:24.480339 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470a492-94e9-4a03-a21c-0619251b6dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:24.481015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470a492-94e9-4a03-a21c-0619251b6dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:24.481293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470a492-94e9-4a03-a21c-0619251b6dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:24.481568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470a492-94e9-4a03-a21c-0619251b6dd1 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:24.482414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470a492-94e9-4a03-a21c-0619251b6dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:24.482726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470a492-94e9-4a03-a21c-0619251b6dd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:24.484208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470a492-94e9-4a03-a21c-0619251b6dd1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:24.502723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 634/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Sun Jun 26 02:55:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:24.509530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add689e-4706-4b99-aa67-32e092b51144 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:24.607340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:24.618000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add689e-4706-4b99-aa67-32e092b51144 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:24.652202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d40106-7bdd-42a8-8b49-8895c3b7cbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:24.652854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d40106-7bdd-42a8-8b49-8895c3b7cbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:24.653142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d40106-7bdd-42a8-8b49-8895c3b7cbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:24.653416 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d40106-7bdd-42a8-8b49-8895c3b7cbb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:24.721455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d40106-7bdd-42a8-8b49-8895c3b7cbb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:24.722846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d40106-7bdd-42a8-8b49-8895c3b7cbb1 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:24.814663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:24.826356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 648/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Sun Jun 26 02:55:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 26 02:55:24.832608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470a492-94e9-4a03-a21c-0619251b6dd1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:24.897940 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:24.939278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470a492-94e9-4a03-a21c-0619251b6dd1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:24.977278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b54b2-29ee-4a41-b864-82552696f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:24.978002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b54b2-29ee-4a41-b864-82552696f9dd None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:24.978287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b54b2-29ee-4a41-b864-82552696f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:24.978566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b54b2-29ee-4a41-b864-82552696f9dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:24.989957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b54b2-29ee-4a41-b864-82552696f9dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:24.991440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b54b2-29ee-4a41-b864-82552696f9dd None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-d57b54b2-29ee-4a41-b864-82552696f9dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 26 02:55:25.010506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:25.011553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:25.012472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 26 02:55:25.012472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 26 02:55:25.012472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 26 02:55:25.012472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:25.012472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 635/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:25.018348 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d40106-7bdd-42a8-8b49-8895c3b7cbb1 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:25.116030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d40106-7bdd-42a8-8b49-8895c3b7cbb1 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:25.150334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2a21-bb4b-4f0d-b75c-71e386838759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:25.151014 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2a21-bb4b-4f0d-b75c-71e386838759 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:25.151286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2a21-bb4b-4f0d-b75c-71e386838759 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:25.151564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2a21-bb4b-4f0d-b75c-71e386838759 None admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:25.152282 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f2a21-bb4b-4f0d-b75c-71e386838759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:25.152591 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f2a21-bb4b-4f0d-b75c-71e386838759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:25.153982 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f2a21-bb4b-4f0d-b75c-71e386838759 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:25.165550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 649/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Sun Jun 26 02:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:25.171413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b54b2-29ee-4a41-b864-82552696f9dd None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:25.282216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b54b2-29ee-4a41-b864-82552696f9dd None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:25.298101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:25.319804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdfddc-e72b-443f-bdd9-ec501c0f0cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:25.320600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdfddc-e72b-443f-bdd9-ec501c0f0cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:25.320885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdfddc-e72b-443f-bdd9-ec501c0f0cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:25.321163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdfddc-e72b-443f-bdd9-ec501c0f0cc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:25.327752 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdfddc-e72b-443f-bdd9-ec501c0f0cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:25.329224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdfddc-e72b-443f-bdd9-ec501c0f0cc9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-04cdfddc-e72b-443f-bdd9-ec501c0f0cc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 26 02:55:25.343228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:25.344637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:25.345530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 26 02:55:25.345530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 26 02:55:25.345530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 26 02:55:25.345530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 26 02:55:25.345530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 26 02:55:25.345530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 26 02:55:25.345530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 26 02:55:25.345530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: ERROR keystone.server.flask.application Jun 26 02:55:25.345530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 636/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Sun Jun 26 02:55:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:25.351178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2a21-bb4b-4f0d-b75c-71e386838759 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:25.402321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:25.459304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2a21-bb4b-4f0d-b75c-71e386838759 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:25.496144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2b694-cc29-49b3-9b50-ff12b9d0de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:25.496947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2b694-cc29-49b3-9b50-ff12b9d0de2b None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:25.497211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2b694-cc29-49b3-9b50-ff12b9d0de2b None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:25.497482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2b694-cc29-49b3-9b50-ff12b9d0de2b None admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:25.498259 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2b694-cc29-49b3-9b50-ff12b9d0de2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:25.498591 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2b694-cc29-49b3-9b50-ff12b9d0de2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:25.500059 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2b694-cc29-49b3-9b50-ff12b9d0de2b None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:25.512880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 650/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Sun Jun 26 02:55:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:25.519274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdfddc-e72b-443f-bdd9-ec501c0f0cc9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:25.634309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdfddc-e72b-443f-bdd9-ec501c0f0cc9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:25.675112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43181e8-a65c-43ee-98ab-1497462b5149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:25.675755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43181e8-a65c-43ee-98ab-1497462b5149 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:25.676038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43181e8-a65c-43ee-98ab-1497462b5149 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:25.676317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43181e8-a65c-43ee-98ab-1497462b5149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:25.677226 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43181e8-a65c-43ee-98ab-1497462b5149 None admin] RBAC: Adding query filter params (role.id=a2abb9e58ac7444ca36727a2bc258f58, scope.project.id=7a0022e70eb947cf8419191744dd7ec2, user.id=5ae5f8f789424969bd575f7360847261) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:25.677534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43181e8-a65c-43ee-98ab-1497462b5149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:25.678977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43181e8-a65c-43ee-98ab-1497462b5149 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:25.684952 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 637/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Sun Jun 26 02:55:25 2022] GET /identity/v3/role_assignments?user.id=5ae5f8f789424969bd575f7360847261&scope.project.id=7a0022e70eb947cf8419191744dd7ec2&role.id=a2abb9e58ac7444ca36727a2bc258f58 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:55:27.719721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e33eb-8904-42dd-872b-eb2b4d54093e None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:27.720612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e33eb-8904-42dd-872b-eb2b4d54093e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:27.720612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e33eb-8904-42dd-872b-eb2b4d54093e None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:27.722812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 651/1288] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:55:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:55:27.729299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af767f91-1274-492b-90e5-9b52f0a65daa None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:27.730003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af767f91-1274-492b-90e5-9b52f0a65daa None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:27.730242 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af767f91-1274-492b-90e5-9b52f0a65daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:27.756745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-af767f91-1274-492b-90e5-9b52f0a65daa None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:55:27.757843 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-af767f91-1274-492b-90e5-9b52f0a65daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:55:27.789043 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:27.836496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 638/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:55:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:55:27.859958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e33eb-8904-42dd-872b-eb2b4d54093e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:27.971693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e33eb-8904-42dd-872b-eb2b4d54093e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:27.982103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:28.007470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cc541-5cad-49a1-af63-363a1c5d9037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:28.008216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cc541-5cad-49a1-af63-363a1c5d9037 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:28.008501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cc541-5cad-49a1-af63-363a1c5d9037 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:28.008774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cc541-5cad-49a1-af63-363a1c5d9037 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:28.009436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cc541-5cad-49a1-af63-363a1c5d9037 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:28.010828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cc541-5cad-49a1-af63-363a1c5d9037 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-cc5cc541-5cad-49a1-af63-363a1c5d9037 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:28.023825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:28.025051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:28.026096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 652/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Jun 26 02:55:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:28.031393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af767f91-1274-492b-90e5-9b52f0a65daa None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:28.137424 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af767f91-1274-492b-90e5-9b52f0a65daa None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:28.173390 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186857d-d3a9-4a46-8654-e5ebaffb5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:28.174048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186857d-d3a9-4a46-8654-e5ebaffb5a61 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:28.174330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186857d-d3a9-4a46-8654-e5ebaffb5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:28.174605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186857d-d3a9-4a46-8654-e5ebaffb5a61 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:28.175338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186857d-d3a9-4a46-8654-e5ebaffb5a61 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:28.175644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186857d-d3a9-4a46-8654-e5ebaffb5a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:28.177076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186857d-d3a9-4a46-8654-e5ebaffb5a61 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:28.182088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 639/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Sun Jun 26 02:55:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:28.191354 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cc541-5cad-49a1-af63-363a1c5d9037 None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:28.307284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cc541-5cad-49a1-af63-363a1c5d9037 None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:28.344440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9803d42-6405-4470-a0e4-610a171a097c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:28.345144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9803d42-6405-4470-a0e4-610a171a097c None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:28.345425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9803d42-6405-4470-a0e4-610a171a097c None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:28.345702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9803d42-6405-4470-a0e4-610a171a097c None admin] PATH_INFO: `/v3/services` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:28.346415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9803d42-6405-4470-a0e4-610a171a097c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:28.346718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9803d42-6405-4470-a0e4-610a171a097c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:28.348145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9803d42-6405-4470-a0e4-610a171a097c None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:28.353063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 653/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Sun Jun 26 02:55:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 02:55:30.368981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfbef-2c00-4c3c-bfb9-37decca3c835 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:30.369835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfbef-2c00-4c3c-bfb9-37decca3c835 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:30.369835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfbef-2c00-4c3c-bfb9-37decca3c835 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:30.372061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 640/1293] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:55:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:55:30.377420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f80fcf-56cf-4ea5-9581-ac3d84715938 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:30.377860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f80fcf-56cf-4ea5-9581-ac3d84715938 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:30.377953 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f80fcf-56cf-4ea5-9581-ac3d84715938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:30.396598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-78f80fcf-56cf-4ea5-9581-ac3d84715938 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:55:30.397753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-78f80fcf-56cf-4ea5-9581-ac3d84715938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:55:30.427760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:30.466328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 654/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:55:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:55:30.489330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecfbef-2c00-4c3c-bfb9-37decca3c835 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:30.525297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:30.597336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecfbef-2c00-4c3c-bfb9-37decca3c835 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:30.635893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1c2f-fe8f-463e-b208-549c7b1fbae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:30.636480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1c2f-fe8f-463e-b208-549c7b1fbae8 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:30.636758 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1c2f-fe8f-463e-b208-549c7b1fbae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:30.637030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1c2f-fe8f-463e-b208-549c7b1fbae8 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:30.637740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa1c2f-fe8f-463e-b208-549c7b1fbae8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:30.639147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa1c2f-fe8f-463e-b208-549c7b1fbae8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:30.655180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 641/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Sun Jun 26 02:55:30 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:55:32.684613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1817d-7c80-4bc3-b818-50267d432ed4 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:32.685517 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1817d-7c80-4bc3-b818-50267d432ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:32.685517 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1817d-7c80-4bc3-b818-50267d432ed4 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:32.687832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 655/1296] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:55:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:55:32.693361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fed22-c30a-4db4-95af-5e78ef55c3cf None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:32.693816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fed22-c30a-4db4-95af-5e78ef55c3cf None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:32.693916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fed22-c30a-4db4-95af-5e78ef55c3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:32.711585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-4d0fed22-c30a-4db4-95af-5e78ef55c3cf None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:55:32.712782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4d0fed22-c30a-4db4-95af-5e78ef55c3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:55:32.813806 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 642/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:55:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:55:32.850153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1817d-7c80-4bc3-b818-50267d432ed4 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:32.968344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1817d-7c80-4bc3-b818-50267d432ed4 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:33.002560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69665e84-a493-42da-8f7a-8a534e77bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:33.003367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69665e84-a493-42da-8f7a-8a534e77bd7d None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:33.003642 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69665e84-a493-42da-8f7a-8a534e77bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:33.003914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69665e84-a493-42da-8f7a-8a534e77bd7d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:33.004638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69665e84-a493-42da-8f7a-8a534e77bd7d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:33.006028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69665e84-a493-42da-8f7a-8a534e77bd7d None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-69665e84-a493-42da-8f7a-8a534e77bd7d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:33.018627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:33.020029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:33.021144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 656/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Jun 26 02:55:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:33.026687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fed22-c30a-4db4-95af-5e78ef55c3cf None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:33.048927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:33.126517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fed22-c30a-4db4-95af-5e78ef55c3cf None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:33.163767 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243b4a0-efb0-45a6-a1e4-881579086099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:33.164422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243b4a0-efb0-45a6-a1e4-881579086099 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:33.164700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243b4a0-efb0-45a6-a1e4-881579086099 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:33.164982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243b4a0-efb0-45a6-a1e4-881579086099 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:33.165678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243b4a0-efb0-45a6-a1e4-881579086099 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:33.165982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243b4a0-efb0-45a6-a1e4-881579086099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:33.167386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243b4a0-efb0-45a6-a1e4-881579086099 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:33.172513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 643/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Sun Jun 26 02:55:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:33.179945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69665e84-a493-42da-8f7a-8a534e77bd7d None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:33.211555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:33.290205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69665e84-a493-42da-8f7a-8a534e77bd7d None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:33.328978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de1573-8cbb-499b-8604-c4833ba51c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:33.329683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de1573-8cbb-499b-8604-c4833ba51c19 None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:33.329975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de1573-8cbb-499b-8604-c4833ba51c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:33.330243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de1573-8cbb-499b-8604-c4833ba51c19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:33.331057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de1573-8cbb-499b-8604-c4833ba51c19 None admin] RBAC: Adding query filter params (interface=public, service_id=e8a320ce1d044a01acf8be6d257df770, region_id=RegionOne) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:33.331415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de1573-8cbb-499b-8604-c4833ba51c19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:33.332868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de1573-8cbb-499b-8604-c4833ba51c19 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:33.338333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 657/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Sun Jun 26 02:55:33 2022] GET /identity/v3/endpoints?service_id=e8a320ce1d044a01acf8be6d257df770&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:33.344705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243b4a0-efb0-45a6-a1e4-881579086099 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:33.433743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:33.453542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243b4a0-efb0-45a6-a1e4-881579086099 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:33.493473 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a3508-44b8-4698-a52b-183bb48f0b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:33.494332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a3508-44b8-4698-a52b-183bb48f0b36 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:33.494633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a3508-44b8-4698-a52b-183bb48f0b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:33.494962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a3508-44b8-4698-a52b-183bb48f0b36 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:33.495702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a3508-44b8-4698-a52b-183bb48f0b36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:33.497101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a3508-44b8-4698-a52b-183bb48f0b36 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:33.506449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 644/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Sun Jun 26 02:55:33 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 02:55:35.497655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30676686-8e2b-4153-9c2f-28401b3ec6dc None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:35.498233 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30676686-8e2b-4153-9c2f-28401b3ec6dc None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:35.498233 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30676686-8e2b-4153-9c2f-28401b3ec6dc None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:35.500040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 658/1302] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:55:35.505344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93c2f-54f4-406e-8314-4654bcb24c88 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:35.505779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93c2f-54f4-406e-8314-4654bcb24c88 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:35.505871 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93c2f-54f4-406e-8314-4654bcb24c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:35.524035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-32f93c2f-54f4-406e-8314-4654bcb24c88 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:55:35.525203 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-32f93c2f-54f4-406e-8314-4654bcb24c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:55:35.596727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 645/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:55:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 26 02:55:35.620398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30676686-8e2b-4153-9c2f-28401b3ec6dc None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:35.728373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:35.735543 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30676686-8e2b-4153-9c2f-28401b3ec6dc None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:35.769265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6232a-7970-4db9-aa83-f4c986bfb6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:35.770077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6232a-7970-4db9-aa83-f4c986bfb6ed None admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:35.770354 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6232a-7970-4db9-aa83-f4c986bfb6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:35.770682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6232a-7970-4db9-aa83-f4c986bfb6ed None admin] PATH_INFO: `/v3/services/placement` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:35.771361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6232a-7970-4db9-aa83-f4c986bfb6ed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:35.772740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6232a-7970-4db9-aa83-f4c986bfb6ed None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application [None req-e5b6232a-7970-4db9-aa83-f4c986bfb6ed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 26 02:55:35.784919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 26 02:55:35.786046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.get_or_create( Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application with Lock( Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self._enter() Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application return self.creator() Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application created_value = creator( Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: ERROR keystone.server.flask.application Jun 26 02:55:35.786971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 659/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Sun Jun 26 02:55:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 26 02:55:35.795499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f93c2f-54f4-406e-8314-4654bcb24c88 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:35.885558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:35.912123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f93c2f-54f4-406e-8314-4654bcb24c88 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:35.946864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace2471-9899-44c4-bff8-1e4ac473d5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:35.947813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2471-9899-44c4-bff8-1e4ac473d5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:35.948264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2471-9899-44c4-bff8-1e4ac473d5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:35.948733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2471-9899-44c4-bff8-1e4ac473d5b6 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:35.949970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace2471-9899-44c4-bff8-1e4ac473d5b6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 02:55:35.950423 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace2471-9899-44c4-bff8-1e4ac473d5b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:35.952302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace2471-9899-44c4-bff8-1e4ac473d5b6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:35.957663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 646/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Sun Jun 26 02:55:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 02:55:35.967057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6232a-7970-4db9-aa83-f4c986bfb6ed None admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:55:36.074588 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6232a-7970-4db9-aa83-f4c986bfb6ed None admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:55:36.133606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15858a40-3bdc-46e5-851a-499562e65f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:55:36.134267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15858a40-3bdc-46e5-851a-499562e65f79 None admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:55:36.134560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15858a40-3bdc-46e5-851a-499562e65f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:55:36.134836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15858a40-3bdc-46e5-851a-499562e65f79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:55:36.135615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15858a40-3bdc-46e5-851a-499562e65f79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:55:36.137022 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15858a40-3bdc-46e5-851a-499562e65f79 None admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:55:36.168101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 660/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Sun Jun 26 02:55:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 02:55:45.954387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=30 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:55:46.157973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:38.696720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523750c6-da00-4e77-beed-c5c85e0eee90 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:38.697911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523750c6-da00-4e77-beed-c5c85e0eee90 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:38.698497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523750c6-da00-4e77-beed-c5c85e0eee90 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:38.701679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 647/1307] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:56:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:56:38.709772 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac7083-d4a6-42d2-8091-e9e747ca91ec None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:38.710203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac7083-d4a6-42d2-8091-e9e747ca91ec None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:38.710605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac7083-d4a6-42d2-8091-e9e747ca91ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:38.857705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-54ac7083-d4a6-42d2-8091-e9e747ca91ec None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:56:38.858979 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-54ac7083-d4a6-42d2-8091-e9e747ca91ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:39.033073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 661/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:56:39.084603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c6f1-bd8c-4d2c-94bd-f1a71513f5e2 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:39.084979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c6f1-bd8c-4d2c-94bd-f1a71513f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:39.085169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66c6f1-bd8c-4d2c-94bd-f1a71513f5e2 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:39.086848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 648/1309] 10.222.0.36 () {54 vars in 964 bytes} [Sun Jun 26 02:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:56:39.092804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7659d1-c716-49e2-988a-a0c65fc78210 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:39.093101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7659d1-c716-49e2-988a-a0c65fc78210 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:39.093431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7659d1-c716-49e2-988a-a0c65fc78210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:39.173058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-bc7659d1-c716-49e2-988a-a0c65fc78210 None None] MFA Rules not processed for user `4169682bfc5043a3a3d4c638dae2a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:56:39.174271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-bc7659d1-c716-49e2-988a-a0c65fc78210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:39.196345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:39.257183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 662/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Sun Jun 26 02:56:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:56:39.266749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66c6f1-bd8c-4d2c-94bd-f1a71513f5e2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:56:39.268525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ac66c6f1-bd8c-4d2c-94bd-f1a71513f5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:39.393635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66c6f1-bd8c-4d2c-94bd-f1a71513f5e2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:56:39.509583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf0356-7ac3-4658-b989-20d8079dfbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:56:39.510251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0356-7ac3-4658-b989-20d8079dfbaf service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:39.510529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0356-7ac3-4658-b989-20d8079dfbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:39.510805 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0356-7ac3-4658-b989-20d8079dfbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:39.512873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2baf0356-7ac3-4658-b989-20d8079dfbaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:39.575073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:39.644485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf0356-7ac3-4658-b989-20d8079dfbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:56:39.646433 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf0356-7ac3-4658-b989-20d8079dfbaf service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:56:39.680486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 649/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:56:42.009338 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d3cdd-2cd5-4d46-8189-c25dfdf5511e None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:42.009904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d3cdd-2cd5-4d46-8189-c25dfdf5511e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:42.009904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d3cdd-2cd5-4d46-8189-c25dfdf5511e None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:42.011471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 663/1312] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:56:42.016651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd870b93-6ae3-401b-bdea-797576f4b40b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:42.017077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd870b93-6ae3-401b-bdea-797576f4b40b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:42.017198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd870b93-6ae3-401b-bdea-797576f4b40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:42.099428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-bd870b93-6ae3-401b-bdea-797576f4b40b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:56:42.100666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-bd870b93-6ae3-401b-bdea-797576f4b40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:42.204075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 650/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:56:42.257259 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfbe75-3436-4008-99cd-95843f385950 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:42.257652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfbe75-3436-4008-99cd-95843f385950 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:42.258031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfbe75-3436-4008-99cd-95843f385950 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:42.259710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 664/1314] 10.222.0.36 () {54 vars in 964 bytes} [Sun Jun 26 02:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:56:42.266774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740c53-c8cf-40b6-a94b-7a283b086463 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:42.267099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740c53-c8cf-40b6-a94b-7a283b086463 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:42.267382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740c53-c8cf-40b6-a94b-7a283b086463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:42.278250 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:42.352562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1a740c53-c8cf-40b6-a94b-7a283b086463 None None] MFA Rules not processed for user `4169682bfc5043a3a3d4c638dae2a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:56:42.353804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1a740c53-c8cf-40b6-a94b-7a283b086463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:42.437034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 651/1315] 10.222.0.36 () {58 vars in 1061 bytes} [Sun Jun 26 02:56:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 02:56:42.446713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfbe75-3436-4008-99cd-95843f385950 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:56:42.448349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-64bfbe75-3436-4008-99cd-95843f385950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:42.557541 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfbe75-3436-4008-99cd-95843f385950 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:56:42.630475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:42.633427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46d5e1-5d91-4f02-801d-2771b9b1d322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:56:42.634144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d5e1-5d91-4f02-801d-2771b9b1d322 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:42.634814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d5e1-5d91-4f02-801d-2771b9b1d322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:42.635404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d5e1-5d91-4f02-801d-2771b9b1d322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:42.637225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6b46d5e1-5d91-4f02-801d-2771b9b1d322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:42.744240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46d5e1-5d91-4f02-801d-2771b9b1d322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:56:42.745716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46d5e1-5d91-4f02-801d-2771b9b1d322 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:56:42.764736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 665/1316] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:56:45.305313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eb9e1-a334-48ea-9c37-8847c9ad2e69 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:45.305885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eb9e1-a334-48ea-9c37-8847c9ad2e69 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:45.305885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eb9e1-a334-48ea-9c37-8847c9ad2e69 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:45.307312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 652/1317] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:56:45.313889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cdbc5-7e76-4f62-8616-577eb1d3b1ec None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:45.314660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cdbc5-7e76-4f62-8616-577eb1d3b1ec None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:45.314786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cdbc5-7e76-4f62-8616-577eb1d3b1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:45.390339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-917cdbc5-7e76-4f62-8616-577eb1d3b1ec None None] MFA Rules not processed for user `f058e8cc10ad4965a0a08401171a50a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:56:45.391842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-917cdbc5-7e76-4f62-8616-577eb1d3b1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:45.455468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:45.503736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 666/1318] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:56:45.559283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eb9e1-a334-48ea-9c37-8847c9ad2e69 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:56:45.560847 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-963eb9e1-a334-48ea-9c37-8847c9ad2e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:45.683680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eb9e1-a334-48ea-9c37-8847c9ad2e69 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:56:45.686474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:45.770383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcafa1b-6ace-4f19-a693-df2628599df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:56:45.771032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafa1b-6ace-4f19-a693-df2628599df9 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:45.771341 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafa1b-6ace-4f19-a693-df2628599df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:45.771618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafa1b-6ace-4f19-a693-df2628599df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:45.773267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5dcafa1b-6ace-4f19-a693-df2628599df9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:45.885516 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcafa1b-6ace-4f19-a693-df2628599df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:56:45.886889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcafa1b-6ace-4f19-a693-df2628599df9 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:56:45.906227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 653/1319] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:56:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:56:48.498266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569efe4d-a343-49cc-9069-d943fbe7c9bd None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:48.498911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569efe4d-a343-49cc-9069-d943fbe7c9bd None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:48.499038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569efe4d-a343-49cc-9069-d943fbe7c9bd None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:48.501461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 667/1320] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:56:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:56:48.509596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f3b16-f91d-4433-9c12-aeed2921374e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:48.509993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f3b16-f91d-4433-9c12-aeed2921374e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:48.510226 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f3b16-f91d-4433-9c12-aeed2921374e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:48.556500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:48.582179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-947f3b16-f91d-4433-9c12-aeed2921374e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:56:48.583415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-947f3b16-f91d-4433-9c12-aeed2921374e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:48.688179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 654/1321] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:56:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:56:48.730339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569efe4d-a343-49cc-9069-d943fbe7c9bd None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:56:48.732906 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-569efe4d-a343-49cc-9069-d943fbe7c9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:48.839664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569efe4d-a343-49cc-9069-d943fbe7c9bd None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:56:48.917174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cbeb5-61fd-4f3e-b5d4-f2ebcbff266b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:56:48.917827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cbeb5-61fd-4f3e-b5d4-f2ebcbff266b service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:48.918103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cbeb5-61fd-4f3e-b5d4-f2ebcbff266b service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:48.918377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cbeb5-61fd-4f3e-b5d4-f2ebcbff266b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:48.920033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d78cbeb5-61fd-4f3e-b5d4-f2ebcbff266b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:48.927546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:49.042255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cbeb5-61fd-4f3e-b5d4-f2ebcbff266b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:56:49.043773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cbeb5-61fd-4f3e-b5d4-f2ebcbff266b service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:56:49.062575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 668/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:56:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:56:51.725391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7af7e6-8181-47b6-887a-bb2ce5def120 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:51.725995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7af7e6-8181-47b6-887a-bb2ce5def120 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:51.725995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7af7e6-8181-47b6-887a-bb2ce5def120 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:51.727375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 655/1323] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:56:51.732858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e64c36-f097-46df-963b-0965c42f8e36 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:51.733307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e64c36-f097-46df-963b-0965c42f8e36 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:51.733561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e64c36-f097-46df-963b-0965c42f8e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:51.801864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-67e64c36-f097-46df-963b-0965c42f8e36 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:56:51.803127 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-67e64c36-f097-46df-963b-0965c42f8e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:51.863405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:51.909684 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 669/1324] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:56:51.946027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7af7e6-8181-47b6-887a-bb2ce5def120 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:56:51.947639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ce7af7e6-8181-47b6-887a-bb2ce5def120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:52.061393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7af7e6-8181-47b6-887a-bb2ce5def120 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:56:52.074217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:52.137628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ee199-4e2c-48dc-9433-2dadda052642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:56:52.138282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ee199-4e2c-48dc-9433-2dadda052642 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:52.138566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ee199-4e2c-48dc-9433-2dadda052642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:52.138844 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ee199-4e2c-48dc-9433-2dadda052642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:52.140646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ca4ee199-4e2c-48dc-9433-2dadda052642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:52.254125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ee199-4e2c-48dc-9433-2dadda052642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:56:52.255740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ee199-4e2c-48dc-9433-2dadda052642 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:56:52.274238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 656/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:56:54.331834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8b178-d1c7-47c1-ae20-e91ad3539cf4 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:54.332368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8b178-d1c7-47c1-ae20-e91ad3539cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:54.332368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8b178-d1c7-47c1-ae20-e91ad3539cf4 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:54.333639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 670/1326] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:56:54.339214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477ba59-d3bf-4718-9aba-8ea4941b492b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:54.339621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477ba59-d3bf-4718-9aba-8ea4941b492b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:54.339775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477ba59-d3bf-4718-9aba-8ea4941b492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:54.389212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:54.410312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e477ba59-d3bf-4718-9aba-8ea4941b492b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:56:54.411568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e477ba59-d3bf-4718-9aba-8ea4941b492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:54.516731 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 657/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:56:54.552770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8b178-d1c7-47c1-ae20-e91ad3539cf4 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:56:54.554318 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-83d8b178-d1c7-47c1-ae20-e91ad3539cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:54.662341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8b178-d1c7-47c1-ae20-e91ad3539cf4 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:56:54.740397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbb3a3-9cac-4320-9d97-8137d973dd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:56:54.741053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb3a3-9cac-4320-9d97-8137d973dd7b service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:54.741300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb3a3-9cac-4320-9d97-8137d973dd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:54.741593 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb3a3-9cac-4320-9d97-8137d973dd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:54.743265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-82fbb3a3-9cac-4320-9d97-8137d973dd7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:54.761072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:54.856440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbb3a3-9cac-4320-9d97-8137d973dd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:56:54.858010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbb3a3-9cac-4320-9d97-8137d973dd7b service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:56:54.884083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 671/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:56:56.968065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a533df-cd2b-47bf-bd80-ff2a4e598d52 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:56.968637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a533df-cd2b-47bf-bd80-ff2a4e598d52 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:56.968637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a533df-cd2b-47bf-bd80-ff2a4e598d52 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:56.970010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 658/1329] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:56:56.975381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4c209-e64a-4b96-a069-4bce3357fa08 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:56.975862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4c209-e64a-4b96-a069-4bce3357fa08 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:56.975968 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4c209-e64a-4b96-a069-4bce3357fa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:57.046619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-2fa4c209-e64a-4b96-a069-4bce3357fa08 None None] MFA Rules not processed for user `f058e8cc10ad4965a0a08401171a50a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:56:57.047879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2fa4c209-e64a-4b96-a069-4bce3357fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:57.118165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:57.151371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 672/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:56:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:56:57.188772 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a533df-cd2b-47bf-bd80-ff2a4e598d52 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:56:57.190331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-03a533df-cd2b-47bf-bd80-ff2a4e598d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:57.299415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a533df-cd2b-47bf-bd80-ff2a4e598d52 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:56:57.319852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:56:57.373989 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fabe25-f78e-4f62-8ff1-613a8a4dbda9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:56:57.374650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabe25-f78e-4f62-8ff1-613a8a4dbda9 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:57.374933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabe25-f78e-4f62-8ff1-613a8a4dbda9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:57.375248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabe25-f78e-4f62-8ff1-613a8a4dbda9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:57.376901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f2fabe25-f78e-4f62-8ff1-613a8a4dbda9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:56:57.505086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fabe25-f78e-4f62-8ff1-613a8a4dbda9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:56:57.506542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fabe25-f78e-4f62-8ff1-613a8a4dbda9 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:56:57.525570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 659/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:56:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:56:59.996284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72f16e-2e54-4dcf-972d-e285f595663d None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:56:59.997113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72f16e-2e54-4dcf-972d-e285f595663d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:56:59.997113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72f16e-2e54-4dcf-972d-e285f595663d None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:56:59.999008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 673/1332] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:56:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:00.004508 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98883988-21cb-45bf-92ed-ebdb1ee59838 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:00.004931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98883988-21cb-45bf-92ed-ebdb1ee59838 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:00.005026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98883988-21cb-45bf-92ed-ebdb1ee59838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:00.071519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:00.074483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-98883988-21cb-45bf-92ed-ebdb1ee59838 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:00.076316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-98883988-21cb-45bf-92ed-ebdb1ee59838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:00.178667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 660/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:00.218073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72f16e-2e54-4dcf-972d-e285f595663d None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:00.220301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3e72f16e-2e54-4dcf-972d-e285f595663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:00.343312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72f16e-2e54-4dcf-972d-e285f595663d None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:00.420003 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165b24e-49b7-41cf-a118-89405e887438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:00.420652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b24e-49b7-41cf-a118-89405e887438 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:00.420932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b24e-49b7-41cf-a118-89405e887438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:00.421206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b24e-49b7-41cf-a118-89405e887438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:00.422839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d165b24e-49b7-41cf-a118-89405e887438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:00.451301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:00.541846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165b24e-49b7-41cf-a118-89405e887438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:00.543358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165b24e-49b7-41cf-a118-89405e887438 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:00.563059 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 674/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:02.622927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34933-8249-4718-bf99-766be0aa0749 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:02.623531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34933-8249-4718-bf99-766be0aa0749 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:02.623531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34933-8249-4718-bf99-766be0aa0749 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:02.624919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 661/1335] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:02.631390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00074ee-bf19-4008-8b08-ae1873939b30 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:02.632178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00074ee-bf19-4008-8b08-ae1873939b30 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:02.632355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00074ee-bf19-4008-8b08-ae1873939b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:02.700853 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-c00074ee-bf19-4008-8b08-ae1873939b30 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:02.702064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c00074ee-bf19-4008-8b08-ae1873939b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:02.784291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:02.808519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 675/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:02.852644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34933-8249-4718-bf99-766be0aa0749 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:02.855028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c0b34933-8249-4718-bf99-766be0aa0749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:02.967278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34933-8249-4718-bf99-766be0aa0749 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:02.996754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:03.043049 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a39bed-135d-407b-a8da-f7fcc74c0abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:03.043634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a39bed-135d-407b-a8da-f7fcc74c0abd service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:03.043914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a39bed-135d-407b-a8da-f7fcc74c0abd service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:03.044191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a39bed-135d-407b-a8da-f7fcc74c0abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:03.045906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-89a39bed-135d-407b-a8da-f7fcc74c0abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:03.154725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a39bed-135d-407b-a8da-f7fcc74c0abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:03.156557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a39bed-135d-407b-a8da-f7fcc74c0abd service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:03.175217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 662/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:05.666810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f02eb-ec75-412f-afaf-89a9b20119a8 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:05.667843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f02eb-ec75-412f-afaf-89a9b20119a8 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:05.667843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f02eb-ec75-412f-afaf-89a9b20119a8 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:05.669975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 676/1338] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:05.675274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903438-6955-484d-b836-f4a51992747a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:05.675744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903438-6955-484d-b836-f4a51992747a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:05.675842 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903438-6955-484d-b836-f4a51992747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:05.739513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b3903438-6955-484d-b836-f4a51992747a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:05.740703 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b3903438-6955-484d-b836-f4a51992747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:05.749090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:05.838840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 663/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:05.874074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f02eb-ec75-412f-afaf-89a9b20119a8 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:05.875677 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b93f02eb-ec75-412f-afaf-89a9b20119a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:05.989865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f02eb-ec75-412f-afaf-89a9b20119a8 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:06.067104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e027cfc-5b9f-4701-8af2-a548837e44d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:06.067762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e027cfc-5b9f-4701-8af2-a548837e44d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:06.068046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e027cfc-5b9f-4701-8af2-a548837e44d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:06.068320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e027cfc-5b9f-4701-8af2-a548837e44d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:06.069965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-0e027cfc-5b9f-4701-8af2-a548837e44d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:06.106765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:06.182692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e027cfc-5b9f-4701-8af2-a548837e44d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:06.184192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e027cfc-5b9f-4701-8af2-a548837e44d7 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:06.203966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 677/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:10.293638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa2b7-a183-4a3e-a3a0-686ea99ddc59 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:10.294216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa2b7-a183-4a3e-a3a0-686ea99ddc59 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:10.294216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa2b7-a183-4a3e-a3a0-686ea99ddc59 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:10.295672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 664/1341] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:10.301035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3aa1-a96b-467d-87b1-302a60b34cbd None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:10.301477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3aa1-a96b-467d-87b1-302a60b34cbd None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:10.301572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3aa1-a96b-467d-87b1-302a60b34cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:10.377499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-2c6d3aa1-a96b-467d-87b1-302a60b34cbd None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:10.379043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2c6d3aa1-a96b-467d-87b1-302a60b34cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:10.475277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:10.493788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 678/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:10.534597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaa2b7-a183-4a3e-a3a0-686ea99ddc59 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:10.536879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-39aaa2b7-a183-4a3e-a3a0-686ea99ddc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:10.636165 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaa2b7-a183-4a3e-a3a0-686ea99ddc59 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:10.640016 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6edaaf-1878-4394-b255-eaa4e69dcd6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:10.640667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6edaaf-1878-4394-b255-eaa4e69dcd6d service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:10.640943 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6edaaf-1878-4394-b255-eaa4e69dcd6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:10.641217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6edaaf-1878-4394-b255-eaa4e69dcd6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:10.650815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6edaaf-1878-4394-b255-eaa4e69dcd6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:10.652308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6edaaf-1878-4394-b255-eaa4e69dcd6d service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:10.662044 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 665/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 02:57:13.273192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804390-ba3f-4418-b273-5558d1bd0056 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:13.273883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804390-ba3f-4418-b273-5558d1bd0056 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:13.273883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7804390-ba3f-4418-b273-5558d1bd0056 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:13.275181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 679/1344] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:13.280841 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924b22b-d2b6-4269-be6b-713b345763b5 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:13.281277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924b22b-d2b6-4269-be6b-713b345763b5 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:13.281441 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924b22b-d2b6-4269-be6b-713b345763b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:13.308714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a924b22b-d2b6-4269-be6b-713b345763b5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:13.309948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a924b22b-d2b6-4269-be6b-713b345763b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:13.339187 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:13.395039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 666/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:13.433557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7804390-ba3f-4418-b273-5558d1bd0056 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:13.435503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e7804390-ba3f-4418-b273-5558d1bd0056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:13.448840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7804390-ba3f-4418-b273-5558d1bd0056 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:13.452444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6475d8-9341-405a-b2ea-ab1f988b5d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:13.453143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6475d8-9341-405a-b2ea-ab1f988b5d2e service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:13.453406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6475d8-9341-405a-b2ea-ab1f988b5d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:13.453676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6475d8-9341-405a-b2ea-ab1f988b5d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:13.463984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6475d8-9341-405a-b2ea-ab1f988b5d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:13.465562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6475d8-9341-405a-b2ea-ab1f988b5d2e service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:13.476598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 680/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:17.401666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8c4d6-e712-4937-b95d-339a1e633208 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:17.402186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8c4d6-e712-4937-b95d-339a1e633208 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:17.402280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8c4d6-e712-4937-b95d-339a1e633208 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:17.403737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 667/1347] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:17.409374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcb5a-f340-4f7c-ba0e-e059c46c271f None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:17.409837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcb5a-f340-4f7c-ba0e-e059c46c271f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:17.409942 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcb5a-f340-4f7c-ba0e-e059c46c271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:17.428021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-407dcb5a-f340-4f7c-ba0e-e059c46c271f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:17.429116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-407dcb5a-f340-4f7c-ba0e-e059c46c271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:17.438312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 681/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:17.476323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8c4d6-e712-4937-b95d-339a1e633208 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:17.487794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8c4d6-e712-4937-b95d-339a1e633208 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:17.491583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a69454-9804-4ff9-886d-40e8becc5ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:17.492225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a69454-9804-4ff9-886d-40e8becc5ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:17.492500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a69454-9804-4ff9-886d-40e8becc5ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:17.492882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a69454-9804-4ff9-886d-40e8becc5ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:17.502205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a69454-9804-4ff9-886d-40e8becc5ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:17.503725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a69454-9804-4ff9-886d-40e8becc5ad1 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:17.513087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 668/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:22.437029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b637431-c332-417c-b624-f22da6d3748d None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:22.437523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b637431-c332-417c-b624-f22da6d3748d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:22.437523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b637431-c332-417c-b624-f22da6d3748d None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:22.439251 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 682/1350] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 02:57:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:22.447567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ec05-9117-41cc-b7bc-83565b3f0ad2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:22.448523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ec05-9117-41cc-b7bc-83565b3f0ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:22.448950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ec05-9117-41cc-b7bc-83565b3f0ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:22.563485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3799ec05-9117-41cc-b7bc-83565b3f0ad2 None None] MFA Rules not processed for user `5ae5f8f789424969bd575f7360847261`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:22.564960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3799ec05-9117-41cc-b7bc-83565b3f0ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:22.638144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 669/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 02:57:26.853238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7fd4-ff8a-4eb3-aa14-b809405e7743 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:26.853786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7fd4-ff8a-4eb3-aa14-b809405e7743 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:26.853786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7fd4-ff8a-4eb3-aa14-b809405e7743 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:26.855444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 683/1352] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 02:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:26.860928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3098007-dd53-4016-a3da-da9cd1d72915 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:26.861821 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3098007-dd53-4016-a3da-da9cd1d72915 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:26.862318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3098007-dd53-4016-a3da-da9cd1d72915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:26.882028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b3098007-dd53-4016-a3da-da9cd1d72915 None None] MFA Rules not processed for user `5ae5f8f789424969bd575f7360847261`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:26.883738 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b3098007-dd53-4016-a3da-da9cd1d72915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:26.893734 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 670/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 02:57:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:27.423468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=13 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:28.250875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eeda2-6ef0-4e81-9adf-5408279cae02 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:28.251535 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eeda2-6ef0-4e81-9adf-5408279cae02 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:28.251535 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eeda2-6ef0-4e81-9adf-5408279cae02 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:28.253137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 684/1354] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 02:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:28.260179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83d22-1fb0-47c0-b8e5-6fc7078954ae None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:28.261293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83d22-1fb0-47c0-b8e5-6fc7078954ae None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:28.261835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83d22-1fb0-47c0-b8e5-6fc7078954ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:28.281401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e4d83d22-1fb0-47c0-b8e5-6fc7078954ae None None] MFA Rules not processed for user `5ae5f8f789424969bd575f7360847261`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:28.282599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e4d83d22-1fb0-47c0-b8e5-6fc7078954ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:28.291438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 671/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 02:57:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:32.046638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28186b0-356c-4142-b53b-0e38f5d9945f None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:32.047654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28186b0-356c-4142-b53b-0e38f5d9945f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:32.048131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28186b0-356c-4142-b53b-0e38f5d9945f None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:32.050009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 685/1356] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:32.055629 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa7269-9eb7-4282-9675-0d8093891141 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:32.056109 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa7269-9eb7-4282-9675-0d8093891141 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:32.056191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa7269-9eb7-4282-9675-0d8093891141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:32.073840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a4aa7269-9eb7-4282-9675-0d8093891141 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:32.075041 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a4aa7269-9eb7-4282-9675-0d8093891141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:32.082888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 672/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:32.138311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f1c5f-30f4-43a8-b545-cdec3efab88d None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:32.138887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f1c5f-30f4-43a8-b545-cdec3efab88d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:32.139561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f1c5f-30f4-43a8-b545-cdec3efab88d None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:32.142137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 686/1358] 10.222.0.36 () {54 vars in 961 bytes} [Sun Jun 26 02:57:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:32.151973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0c44d-c484-4d6c-ae94-2976cf4677f6 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:32.151973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0c44d-c484-4d6c-ae94-2976cf4677f6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:32.152386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0c44d-c484-4d6c-ae94-2976cf4677f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:32.195261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:32.203565 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-bfc0c44d-c484-4d6c-ae94-2976cf4677f6 None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:32.204756 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-bfc0c44d-c484-4d6c-ae94-2976cf4677f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:32.295302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 673/1359] 10.222.0.36 () {58 vars in 1058 bytes} [Sun Jun 26 02:57:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 02:57:32.299525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f1c5f-30f4-43a8-b545-cdec3efab88d None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:32.314173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f1c5f-30f4-43a8-b545-cdec3efab88d None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:32.319801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2d98f-5957-4d0f-88dc-caf5d68de79f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:32.320668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d98f-5957-4d0f-88dc-caf5d68de79f service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:32.321168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d98f-5957-4d0f-88dc-caf5d68de79f service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:32.321634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d98f-5957-4d0f-88dc-caf5d68de79f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:32.330612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2d98f-5957-4d0f-88dc-caf5d68de79f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:32.332488 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2d98f-5957-4d0f-88dc-caf5d68de79f service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:32.342732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 687/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:34.554496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27912-b766-4375-978c-606d48593788 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:34.555283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27912-b766-4375-978c-606d48593788 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:34.555283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27912-b766-4375-978c-606d48593788 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:34.556600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 674/1361] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:34.561740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37690-f11d-4ba4-a51a-928227ae5b3a None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:34.562232 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37690-f11d-4ba4-a51a-928227ae5b3a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:34.562232 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e37690-f11d-4ba4-a51a-928227ae5b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:34.583336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d9e37690-f11d-4ba4-a51a-928227ae5b3a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:34.585769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d9e37690-f11d-4ba4-a51a-928227ae5b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:34.596755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 688/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:34.641234 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c27912-b766-4375-978c-606d48593788 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:34.657206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c27912-b766-4375-978c-606d48593788 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:34.667339 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1c1d5-2b25-43b6-a163-1757a54899b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:34.667998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c1d5-2b25-43b6-a163-1757a54899b4 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:34.668270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c1d5-2b25-43b6-a163-1757a54899b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:34.668551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c1d5-2b25-43b6-a163-1757a54899b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:34.677486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1c1d5-2b25-43b6-a163-1757a54899b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:34.679172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1c1d5-2b25-43b6-a163-1757a54899b4 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:34.689499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 675/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:37.043258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2442-88f8-4627-9655-3d17399189a4 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:37.043796 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2442-88f8-4627-9655-3d17399189a4 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:37.043796 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2442-88f8-4627-9655-3d17399189a4 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:37.045534 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 689/1364] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:37.051231 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc5fa1-9e1f-44ab-a950-6d35e409d56b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:37.052156 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc5fa1-9e1f-44ab-a950-6d35e409d56b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:37.052650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc5fa1-9e1f-44ab-a950-6d35e409d56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:37.071811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-dcfc5fa1-9e1f-44ab-a950-6d35e409d56b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:37.073463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-dcfc5fa1-9e1f-44ab-a950-6d35e409d56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:37.081623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 676/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:37.127901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe1cd-57bb-47ee-8a80-673c54e7443e None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:37.128187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe1cd-57bb-47ee-8a80-673c54e7443e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:37.128502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe1cd-57bb-47ee-8a80-673c54e7443e None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:37.129935 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 690/1366] 10.222.0.36 () {54 vars in 961 bytes} [Sun Jun 26 02:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:37.135386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25006bb9-ae5c-41d1-9af8-10b79aaa76f6 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:37.135710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25006bb9-ae5c-41d1-9af8-10b79aaa76f6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:37.136016 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25006bb9-ae5c-41d1-9af8-10b79aaa76f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:37.154509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-25006bb9-ae5c-41d1-9af8-10b79aaa76f6 None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:37.155705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-25006bb9-ae5c-41d1-9af8-10b79aaa76f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:37.165454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 677/1367] 10.222.0.36 () {58 vars in 1058 bytes} [Sun Jun 26 02:57:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 02:57:37.173390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fe1cd-57bb-47ee-8a80-673c54e7443e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:37.189237 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fe1cd-57bb-47ee-8a80-673c54e7443e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:37.195335 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74fb55-854c-40b7-aff2-c5ed785e7002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:37.195974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74fb55-854c-40b7-aff2-c5ed785e7002 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:37.196248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74fb55-854c-40b7-aff2-c5ed785e7002 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:37.196517 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74fb55-854c-40b7-aff2-c5ed785e7002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:37.205192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74fb55-854c-40b7-aff2-c5ed785e7002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:37.206798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74fb55-854c-40b7-aff2-c5ed785e7002 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:37.216234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 691/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:39.325715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cd6b9-73dc-42fa-8319-e7413e2ebaf9 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:39.326333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cd6b9-73dc-42fa-8319-e7413e2ebaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:39.326333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cd6b9-73dc-42fa-8319-e7413e2ebaf9 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:39.327656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 678/1369] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:39.333070 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7da7-e361-45b1-8253-c0f1ae509374 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:39.333471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7da7-e361-45b1-8253-c0f1ae509374 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:39.333695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7da7-e361-45b1-8253-c0f1ae509374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:39.351723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6f3b7da7-e361-45b1-8253-c0f1ae509374 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:39.352927 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6f3b7da7-e361-45b1-8253-c0f1ae509374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:39.361152 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 692/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:39.407970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cd6b9-73dc-42fa-8319-e7413e2ebaf9 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:39.423333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cd6b9-73dc-42fa-8319-e7413e2ebaf9 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:39.429367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef94df2-fc56-410c-a910-2663cae6da3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:39.430042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef94df2-fc56-410c-a910-2663cae6da3e service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:39.430308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef94df2-fc56-410c-a910-2663cae6da3e service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:39.430604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef94df2-fc56-410c-a910-2663cae6da3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:39.439657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef94df2-fc56-410c-a910-2663cae6da3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:39.441370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef94df2-fc56-410c-a910-2663cae6da3e service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:39.451558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 679/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:40.008501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26ab39-8da7-4bae-875d-d2020ea4130c None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:40.008739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26ab39-8da7-4bae-875d-d2020ea4130c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:40.009013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26ab39-8da7-4bae-875d-d2020ea4130c None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:40.010664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 693/1372] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:40.016238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac419e3-094c-477f-a81d-abd3381b8c21 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:40.016611 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac419e3-094c-477f-a81d-abd3381b8c21 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:40.017106 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac419e3-094c-477f-a81d-abd3381b8c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:40.036189 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9ac419e3-094c-477f-a81d-abd3381b8c21 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:40.037475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9ac419e3-094c-477f-a81d-abd3381b8c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:40.046244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 680/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:40.349052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ce0ee-1cdb-4b8e-9d32-05d6de61451e None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:40.349483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ce0ee-1cdb-4b8e-9d32-05d6de61451e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:40.349590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ce0ee-1cdb-4b8e-9d32-05d6de61451e None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:40.351203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 694/1374] 10.222.0.36 () {54 vars in 963 bytes} [Sun Jun 26 02:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:40.356260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967998f-dfcc-4f2e-8884-26d2be37c0c4 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:40.356649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967998f-dfcc-4f2e-8884-26d2be37c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:40.356860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967998f-dfcc-4f2e-8884-26d2be37c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:40.415473 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1967998f-dfcc-4f2e-8884-26d2be37c0c4 None None] MFA Rules not processed for user `892be7ed998840de8b325316db3fdde4`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:40.416691 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1967998f-dfcc-4f2e-8884-26d2be37c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:40.483155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 681/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Sun Jun 26 02:57:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:40.489638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ce0ee-1cdb-4b8e-9d32-05d6de61451e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:40.500989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ce0ee-1cdb-4b8e-9d32-05d6de61451e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:40.505060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce190b-814d-4138-a408-c1673c0d0472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:40.505706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce190b-814d-4138-a408-c1673c0d0472 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:40.505990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce190b-814d-4138-a408-c1673c0d0472 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:40.506251 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce190b-814d-4138-a408-c1673c0d0472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:40.524818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce190b-814d-4138-a408-c1673c0d0472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:40.526690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce190b-814d-4138-a408-c1673c0d0472 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:40.559118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 695/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:41.518244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf3614-d201-464e-9230-a3f1715bb2ed None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:41.518678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf3614-d201-464e-9230-a3f1715bb2ed None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:41.518809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf3614-d201-464e-9230-a3f1715bb2ed None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:41.520334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 682/1377] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:41.525624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dd93a-466a-437b-bb12-8bc49ebcf7ed None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:41.526120 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dd93a-466a-437b-bb12-8bc49ebcf7ed None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:41.526339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dd93a-466a-437b-bb12-8bc49ebcf7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:41.544998 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-577dd93a-466a-437b-bb12-8bc49ebcf7ed None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:41.546417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-577dd93a-466a-437b-bb12-8bc49ebcf7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:41.554863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 696/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 02:57:41.597967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf3614-d201-464e-9230-a3f1715bb2ed None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:41.613703 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf3614-d201-464e-9230-a3f1715bb2ed None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:41.619804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820003d-38ac-4e65-9566-0ed011857d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:41.620450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820003d-38ac-4e65-9566-0ed011857d55 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:41.620765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820003d-38ac-4e65-9566-0ed011857d55 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:41.621043 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820003d-38ac-4e65-9566-0ed011857d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:41.629456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820003d-38ac-4e65-9566-0ed011857d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:41.631417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820003d-38ac-4e65-9566-0ed011857d55 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:41.635214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:41.641604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 683/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:43.695825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769cc1-e3f7-4aab-b2fb-341aae099714 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:43.696367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769cc1-e3f7-4aab-b2fb-341aae099714 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:43.696367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769cc1-e3f7-4aab-b2fb-341aae099714 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:43.697692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 697/1380] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:43.703300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407df7-4d14-4f3d-bf39-de93f3a18074 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:43.703757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407df7-4d14-4f3d-bf39-de93f3a18074 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:43.703876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407df7-4d14-4f3d-bf39-de93f3a18074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:43.722290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e4407df7-4d14-4f3d-bf39-de93f3a18074 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:43.723518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e4407df7-4d14-4f3d-bf39-de93f3a18074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:43.731634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 684/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:43.775590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52769cc1-e3f7-4aab-b2fb-341aae099714 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:43.791028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52769cc1-e3f7-4aab-b2fb-341aae099714 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:43.797436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329f505-c41b-4c3d-9fb7-1c142d537388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:43.798078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329f505-c41b-4c3d-9fb7-1c142d537388 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:43.798355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329f505-c41b-4c3d-9fb7-1c142d537388 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:43.798634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329f505-c41b-4c3d-9fb7-1c142d537388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:43.807328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329f505-c41b-4c3d-9fb7-1c142d537388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:43.808936 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329f505-c41b-4c3d-9fb7-1c142d537388 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:43.818720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 698/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:45.874057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863becf-9570-441a-9631-5f00d7081763 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:45.874666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863becf-9570-441a-9631-5f00d7081763 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:45.874666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863becf-9570-441a-9631-5f00d7081763 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:45.875986 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 685/1383] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:45.881395 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c086-cbcd-41bf-85df-41854415c221 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:45.881852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c086-cbcd-41bf-85df-41854415c221 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:45.881956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c086-cbcd-41bf-85df-41854415c221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:45.901943 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-df76c086-cbcd-41bf-85df-41854415c221 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:45.903587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-df76c086-cbcd-41bf-85df-41854415c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:45.912049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 699/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:45.952878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863becf-9570-441a-9631-5f00d7081763 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:45.968184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863becf-9570-441a-9631-5f00d7081763 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:45.973888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbcfb4-12f2-420c-a435-c093941efe39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:45.974546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbcfb4-12f2-420c-a435-c093941efe39 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:45.974815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbcfb4-12f2-420c-a435-c093941efe39 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:45.975218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbcfb4-12f2-420c-a435-c093941efe39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:45.984602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbcfb4-12f2-420c-a435-c093941efe39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:45.986228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbcfb4-12f2-420c-a435-c093941efe39 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:45.996353 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 686/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:48.064857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ff70-0222-4d32-a6d2-2a549bee6189 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:48.065405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ff70-0222-4d32-a6d2-2a549bee6189 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:48.065405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2ff70-0222-4d32-a6d2-2a549bee6189 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:48.067231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 700/1386] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:48.072893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d38446-5a90-41f2-a2ea-5b270c2c66a9 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:48.073431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d38446-5a90-41f2-a2ea-5b270c2c66a9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:48.073431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d38446-5a90-41f2-a2ea-5b270c2c66a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:48.093280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-29d38446-5a90-41f2-a2ea-5b270c2c66a9 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:48.094513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-29d38446-5a90-41f2-a2ea-5b270c2c66a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:48.104829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 687/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:48.155869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2ff70-0222-4d32-a6d2-2a549bee6189 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:48.174784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2ff70-0222-4d32-a6d2-2a549bee6189 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:48.180303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023c046-da21-4d6b-8186-0b685d3b6f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:48.181006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c046-da21-4d6b-8186-0b685d3b6f11 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:48.181294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c046-da21-4d6b-8186-0b685d3b6f11 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:48.181577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023c046-da21-4d6b-8186-0b685d3b6f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:48.191773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023c046-da21-4d6b-8186-0b685d3b6f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:48.193548 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023c046-da21-4d6b-8186-0b685d3b6f11 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:48.204058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 701/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:50.368525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea9ad6-2d17-43aa-8f8a-6be8f25b0aa9 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:50.369292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea9ad6-2d17-43aa-8f8a-6be8f25b0aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:50.369292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea9ad6-2d17-43aa-8f8a-6be8f25b0aa9 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:50.370536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 688/1389] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:50.376388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6a576-b828-4c5c-86ec-6e737b56600d None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:50.376913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6a576-b828-4c5c-86ec-6e737b56600d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:50.376913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6a576-b828-4c5c-86ec-6e737b56600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:50.396912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6cb6a576-b828-4c5c-86ec-6e737b56600d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:50.398173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6cb6a576-b828-4c5c-86ec-6e737b56600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:50.407756 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 702/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:50.455824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea9ad6-2d17-43aa-8f8a-6be8f25b0aa9 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:50.471215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea9ad6-2d17-43aa-8f8a-6be8f25b0aa9 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:50.476999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97139d5-d1fb-4f97-8e27-080c363847e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:50.477698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97139d5-d1fb-4f97-8e27-080c363847e6 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:50.478004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97139d5-d1fb-4f97-8e27-080c363847e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:50.478304 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97139d5-d1fb-4f97-8e27-080c363847e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:50.487901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97139d5-d1fb-4f97-8e27-080c363847e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:50.489600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97139d5-d1fb-4f97-8e27-080c363847e6 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:50.506755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 689/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 02:57:52.663633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36808f-5c24-48ab-959f-81ccf97dd26d None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:52.664211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36808f-5c24-48ab-959f-81ccf97dd26d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:52.664211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36808f-5c24-48ab-959f-81ccf97dd26d None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:52.665674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 703/1392] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:52.671476 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a874ed-a910-4245-ba70-bc0b1a81f795 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:52.672121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a874ed-a910-4245-ba70-bc0b1a81f795 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:52.672121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a874ed-a910-4245-ba70-bc0b1a81f795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:52.690678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-88a874ed-a910-4245-ba70-bc0b1a81f795 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:52.691982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-88a874ed-a910-4245-ba70-bc0b1a81f795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:52.700272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 690/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 02:57:52.766402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36808f-5c24-48ab-959f-81ccf97dd26d None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:52.784974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36808f-5c24-48ab-959f-81ccf97dd26d None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:52.792632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacdf0b-8e31-4cae-8f9b-9f8859e14d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:52.793615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdf0b-8e31-4cae-8f9b-9f8859e14d01 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:52.793976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdf0b-8e31-4cae-8f9b-9f8859e14d01 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:52.794244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdf0b-8e31-4cae-8f9b-9f8859e14d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:52.803294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacdf0b-8e31-4cae-8f9b-9f8859e14d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:52.804943 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacdf0b-8e31-4cae-8f9b-9f8859e14d01 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:52.814627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 704/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:54.896601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a5ebc-8946-4ec8-8531-d40cbd955faa None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:54.897231 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a5ebc-8946-4ec8-8531-d40cbd955faa None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:54.897231 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a5ebc-8946-4ec8-8531-d40cbd955faa None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:54.898501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 691/1395] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:54.904594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596eb8-9573-4830-9c52-0370779d68a4 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:54.905004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596eb8-9573-4830-9c52-0370779d68a4 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:54.905152 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596eb8-9573-4830-9c52-0370779d68a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:54.923598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-81596eb8-9573-4830-9c52-0370779d68a4 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:54.924826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-81596eb8-9573-4830-9c52-0370779d68a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:54.934034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 705/1396] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:54.977858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a5ebc-8946-4ec8-8531-d40cbd955faa None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:54.993917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a5ebc-8946-4ec8-8531-d40cbd955faa None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:55.000205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dd522-64f9-4969-845f-3e634a432f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:55.000882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dd522-64f9-4969-845f-3e634a432f81 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:55.001171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dd522-64f9-4969-845f-3e634a432f81 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:55.001455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dd522-64f9-4969-845f-3e634a432f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:55.009976 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dd522-64f9-4969-845f-3e634a432f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:55.011608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dd522-64f9-4969-845f-3e634a432f81 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:55.021239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 692/1397] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:55.653269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ec8c-58c2-46f5-842f-0c7e85c218e0 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:55.653518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ec8c-58c2-46f5-842f-0c7e85c218e0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:55.653816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ec8c-58c2-46f5-842f-0c7e85c218e0 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:55.655441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 706/1398] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:55.660640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8234e-7354-4eaa-a091-43a8980921eb None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:55.660937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8234e-7354-4eaa-a091-43a8980921eb None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:55.661220 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8234e-7354-4eaa-a091-43a8980921eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:55.679852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-31e8234e-7354-4eaa-a091-43a8980921eb None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:55.681038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-31e8234e-7354-4eaa-a091-43a8980921eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:55.689685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 693/1399] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:55.745314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7170443-4102-48ee-8519-33a63ee961e5 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:55.745566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7170443-4102-48ee-8519-33a63ee961e5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:55.745874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7170443-4102-48ee-8519-33a63ee961e5 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:55.747274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 707/1400] 10.222.0.36 () {54 vars in 962 bytes} [Sun Jun 26 02:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:55.752500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c567d4-0142-4b4e-9083-fede467089a9 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:55.752735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c567d4-0142-4b4e-9083-fede467089a9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:55.753011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c567d4-0142-4b4e-9083-fede467089a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:55.803530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-96c567d4-0142-4b4e-9083-fede467089a9 None None] MFA Rules not processed for user `250c47daff26400c96a6b467d7cf5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:55.804724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-96c567d4-0142-4b4e-9083-fede467089a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:55.867510 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 694/1401] 10.222.0.36 () {58 vars in 1059 bytes} [Sun Jun 26 02:57:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:55.875306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7170443-4102-48ee-8519-33a63ee961e5 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:55.886417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7170443-4102-48ee-8519-33a63ee961e5 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:55.890279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f6391-9a5f-4083-958f-e21b984bb6e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '250c47daff26400c96a6b467d7cf5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:55.890917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6391-9a5f-4083-958f-e21b984bb6e4 service glance] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:55.891234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6391-9a5f-4083-958f-e21b984bb6e4 service glance] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:55.891511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f6391-9a5f-4083-958f-e21b984bb6e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:55.900706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f6391-9a5f-4083-958f-e21b984bb6e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:55.902512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f6391-9a5f-4083-958f-e21b984bb6e4 service glance] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:55.912177 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 708/1402] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:57:56.635044 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626f682-ec90-49e0-93e2-f83bb6d60c71 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:56.635557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626f682-ec90-49e0-93e2-f83bb6d60c71 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:56.635640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626f682-ec90-49e0-93e2-f83bb6d60c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:56.689907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2626f682-ec90-49e0-93e2-f83bb6d60c71 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:56.691145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2626f682-ec90-49e0-93e2-f83bb6d60c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:56.733720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:57:56.758786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 695/1403] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 02:57:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 02:57:56.805691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6c7cb-823d-40bc-9fe4-104a64c820f0 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:56.805977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6c7cb-823d-40bc-9fe4-104a64c820f0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:56.806380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6c7cb-823d-40bc-9fe4-104a64c820f0 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:56.807883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 709/1404] 10.222.0.36 () {54 vars in 942 bytes} [Sun Jun 26 02:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:56.814256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52bc4b-eef6-486f-a317-377bf73e386f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:56.814617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52bc4b-eef6-486f-a317-377bf73e386f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:56.814977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52bc4b-eef6-486f-a317-377bf73e386f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:56.864635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fe52bc4b-eef6-486f-a317-377bf73e386f None None] MFA Rules not processed for user `d585280109eb4773adf7d56fd722a4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:56.865839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fe52bc4b-eef6-486f-a317-377bf73e386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:56.938378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 696/1405] 10.222.0.36 () {58 vars in 1039 bytes} [Sun Jun 26 02:57:56 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:56.947770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6c7cb-823d-40bc-9fe4-104a64c820f0 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:56.961725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6c7cb-823d-40bc-9fe4-104a64c820f0 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:56.972786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22211d0a-acd5-49b5-bbbd-ecb4c16157e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:56.973907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211d0a-acd5-49b5-bbbd-ecb4c16157e9 service swift] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:56.974331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211d0a-acd5-49b5-bbbd-ecb4c16157e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:56.974614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211d0a-acd5-49b5-bbbd-ecb4c16157e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:56.985173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22211d0a-acd5-49b5-bbbd-ecb4c16157e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:56.986859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22211d0a-acd5-49b5-bbbd-ecb4c16157e9 service swift] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:56.995315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 710/1406] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 02:57:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 02:57:57.058179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7e65-0ce2-4854-98c8-6d217d09f439 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:57.058576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7e65-0ce2-4854-98c8-6d217d09f439 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:57.058745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7e65-0ce2-4854-98c8-6d217d09f439 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:57.060321 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 697/1407] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:57:57.065374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2cde-401c-4743-8eed-17a0e1ca2ab0 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:57.065662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2cde-401c-4743-8eed-17a0e1ca2ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:57.065937 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2cde-401c-4743-8eed-17a0e1ca2ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:57.083981 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-92fa2cde-401c-4743-8eed-17a0e1ca2ab0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:57:57.085401 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-92fa2cde-401c-4743-8eed-17a0e1ca2ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:57:57.104373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 711/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:57:57.143467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b7e65-0ce2-4854-98c8-6d217d09f439 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:57:57.158916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b7e65-0ce2-4854-98c8-6d217d09f439 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:57:57.164327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4af75e-f8e1-458e-be88-6c5e53830c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:57:57.165106 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4af75e-f8e1-458e-be88-6c5e53830c3c service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:57:57.165517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4af75e-f8e1-458e-be88-6c5e53830c3c service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:57:57.165744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4af75e-f8e1-458e-be88-6c5e53830c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:57:57.174241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4af75e-f8e1-458e-be88-6c5e53830c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:57:57.176012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4af75e-f8e1-458e-be88-6c5e53830c3c service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:57:57.189664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 698/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:07.078650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=69 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:58:07.183340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=59 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:58:18.955310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06052df1-e1f7-499c-8797-a77b17602018 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:18.955950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06052df1-e1f7-499c-8797-a77b17602018 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:18.955950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06052df1-e1f7-499c-8797-a77b17602018 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:18.957308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 712/1410] 10.222.0.36 () {54 vars in 918 bytes} [Sun Jun 26 02:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:18.963612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813f12-719c-4dd1-9469-cffdd519790a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:18.964087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813f12-719c-4dd1-9469-cffdd519790a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:18.964189 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813f12-719c-4dd1-9469-cffdd519790a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:18.988494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-15813f12-719c-4dd1-9469-cffdd519790a None None] MFA Rules not processed for user `5ae5f8f789424969bd575f7360847261`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:18.989692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-15813f12-719c-4dd1-9469-cffdd519790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:18.999774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 699/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Jun 26 02:58:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 02:58:19.014061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d74b-bd45-465c-8480-fb9efba5f80d None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:19.014346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d74b-bd45-465c-8480-fb9efba5f80d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:19.014651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d74b-bd45-465c-8480-fb9efba5f80d None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:19.016075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 713/1412] 10.222.0.36 () {54 vars in 918 bytes} [Sun Jun 26 02:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:19.020755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73254d-a851-407a-849d-86b421bd393a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:19.021042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73254d-a851-407a-849d-86b421bd393a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:19.021318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73254d-a851-407a-849d-86b421bd393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:19.040732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2e73254d-a851-407a-849d-86b421bd393a None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:19.042043 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2e73254d-a851-407a-849d-86b421bd393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:19.052621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 700/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Sun Jun 26 02:58:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:21.511471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354f662-7798-4fb8-9593-729191ca7aef None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:21.512000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354f662-7798-4fb8-9593-729191ca7aef None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:21.512000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354f662-7798-4fb8-9593-729191ca7aef None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:21.513404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 02:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:21.521501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9874d7-db41-4a2b-8ddd-684bf363935e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:21.522089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9874d7-db41-4a2b-8ddd-684bf363935e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:21.522089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9874d7-db41-4a2b-8ddd-684bf363935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:21.544067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5f9874d7-db41-4a2b-8ddd-684bf363935e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:21.545254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5f9874d7-db41-4a2b-8ddd-684bf363935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:21.554292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 02:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:21.613793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354f662-7798-4fb8-9593-729191ca7aef None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:21.631321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354f662-7798-4fb8-9593-729191ca7aef None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:21.637680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79f179-349d-4d8b-9677-fbf83fb93cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:21.638319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79f179-349d-4d8b-9677-fbf83fb93cbf service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:21.638596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79f179-349d-4d8b-9677-fbf83fb93cbf service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:21.638872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79f179-349d-4d8b-9677-fbf83fb93cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:21.647694 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79f179-349d-4d8b-9677-fbf83fb93cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:21.649287 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79f179-349d-4d8b-9677-fbf83fb93cbf service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:21.659662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 715/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:22.560414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fbffd-0dd9-45be-b871-ef85b7608263 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:22.560966 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fbffd-0dd9-45be-b871-ef85b7608263 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:22.560966 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fbffd-0dd9-45be-b871-ef85b7608263 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:22.563148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 02:58:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:22.571301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22b46d-54a9-4932-b307-22160b08d761 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:22.571697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22b46d-54a9-4932-b307-22160b08d761 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:22.571898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22b46d-54a9-4932-b307-22160b08d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:22.591202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6c22b46d-54a9-4932-b307-22160b08d761 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:22.592400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6c22b46d-54a9-4932-b307-22160b08d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:22.601609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 02:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:22.751964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fbffd-0dd9-45be-b871-ef85b7608263 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:22.767906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fbffd-0dd9-45be-b871-ef85b7608263 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:22.773614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c63de9-42c6-4527-bd4d-b51747c3462b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:22.774250 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63de9-42c6-4527-bd4d-b51747c3462b service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:22.774532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63de9-42c6-4527-bd4d-b51747c3462b service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:22.774806 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63de9-42c6-4527-bd4d-b51747c3462b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:22.783277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c63de9-42c6-4527-bd4d-b51747c3462b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:22.784865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c63de9-42c6-4527-bd4d-b51747c3462b service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:22.794075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 703/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:23.672304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6b835-87d6-4771-9900-8dc54d1e326c None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:23.672849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6b835-87d6-4771-9900-8dc54d1e326c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:23.672956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6b835-87d6-4771-9900-8dc54d1e326c None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:23.674301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 02:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:23.679363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e493c21-7956-4660-a678-eb8490a99346 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:23.679785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e493c21-7956-4660-a678-eb8490a99346 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:23.679899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e493c21-7956-4660-a678-eb8490a99346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:23.698428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2e493c21-7956-4660-a678-eb8490a99346 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:23.699648 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2e493c21-7956-4660-a678-eb8490a99346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:23.707965 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 02:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:23.861149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6b835-87d6-4771-9900-8dc54d1e326c None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:23.880285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6b835-87d6-4771-9900-8dc54d1e326c None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:23.885970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de25d24-3597-416b-969a-98bd0ab3796e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:23.886734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de25d24-3597-416b-969a-98bd0ab3796e service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:23.887047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de25d24-3597-416b-969a-98bd0ab3796e service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:23.887326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de25d24-3597-416b-969a-98bd0ab3796e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:23.895523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de25d24-3597-416b-969a-98bd0ab3796e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:23.897122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de25d24-3597-416b-969a-98bd0ab3796e service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:23.907121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 718/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:24.781849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455660fb-0f18-4dc4-a6f1-4dd49f654e58 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:24.782777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455660fb-0f18-4dc4-a6f1-4dd49f654e58 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:24.782777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455660fb-0f18-4dc4-a6f1-4dd49f654e58 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:24.784923 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 02:58:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:24.793013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a3bf-e672-44f2-b48f-d8c4c33b928c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:24.793459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a3bf-e672-44f2-b48f-d8c4c33b928c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:24.793554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a3bf-e672-44f2-b48f-d8c4c33b928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:24.812895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-a9a7a3bf-e672-44f2-b48f-d8c4c33b928c None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:24.814092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a9a7a3bf-e672-44f2-b48f-d8c4c33b928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:24.822626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 02:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:24.977430 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455660fb-0f18-4dc4-a6f1-4dd49f654e58 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:24.994746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455660fb-0f18-4dc4-a6f1-4dd49f654e58 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:25.000452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede009f-773a-443e-b353-144e9475d500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:25.001098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede009f-773a-443e-b353-144e9475d500 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:25.001385 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede009f-773a-443e-b353-144e9475d500 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:25.001664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede009f-773a-443e-b353-144e9475d500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:25.010488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede009f-773a-443e-b353-144e9475d500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:25.012191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede009f-773a-443e-b353-144e9475d500 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:25.022164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 706/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:25.877552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503201a-00cc-4b4b-8207-5a6af121e4e3 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:25.878150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503201a-00cc-4b4b-8207-5a6af121e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:25.878150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503201a-00cc-4b4b-8207-5a6af121e4e3 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:25.879535 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 02:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:25.885682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879fd7b-3226-4811-8bb8-bc183364fb22 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:25.886427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879fd7b-3226-4811-8bb8-bc183364fb22 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:25.886572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879fd7b-3226-4811-8bb8-bc183364fb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:25.906462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-4879fd7b-3226-4811-8bb8-bc183364fb22 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:25.907693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4879fd7b-3226-4811-8bb8-bc183364fb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:25.916578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 02:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:26.069441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503201a-00cc-4b4b-8207-5a6af121e4e3 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:26.090477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503201a-00cc-4b4b-8207-5a6af121e4e3 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:26.098741 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84aa4c2-984d-47ce-b677-bff7d7f0d511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:26.099536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aa4c2-984d-47ce-b677-bff7d7f0d511 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:26.099816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aa4c2-984d-47ce-b677-bff7d7f0d511 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:26.100087 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aa4c2-984d-47ce-b677-bff7d7f0d511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:26.109279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84aa4c2-984d-47ce-b677-bff7d7f0d511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:26.110885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84aa4c2-984d-47ce-b677-bff7d7f0d511 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:26.120865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 721/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:26.929119 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5bd5-7988-4e50-bae6-b80cded5b299 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:26.930000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5bd5-7988-4e50-bae6-b80cded5b299 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:26.930000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5bd5-7988-4e50-bae6-b80cded5b299 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:26.932256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 02:58:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:26.939482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae946d-be08-49cb-8868-50bd6da73aed None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:26.939976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae946d-be08-49cb-8868-50bd6da73aed None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:26.940080 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae946d-be08-49cb-8868-50bd6da73aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:26.969271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-72ae946d-be08-49cb-8868-50bd6da73aed None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:26.970501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-72ae946d-be08-49cb-8868-50bd6da73aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:26.979033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 02:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:27.131201 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b5bd5-7988-4e50-bae6-b80cded5b299 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:27.148626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b5bd5-7988-4e50-bae6-b80cded5b299 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:27.155098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0affd-eaf9-4ba7-bcaf-bb1339212440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:27.155736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0affd-eaf9-4ba7-bcaf-bb1339212440 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:27.156025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0affd-eaf9-4ba7-bcaf-bb1339212440 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:27.156298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0affd-eaf9-4ba7-bcaf-bb1339212440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:27.164693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0affd-eaf9-4ba7-bcaf-bb1339212440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:27.166279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0affd-eaf9-4ba7-bcaf-bb1339212440 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:27.175831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 709/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:27.977784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcadeeb-9855-4236-9566-f300c0256bb6 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:27.978665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcadeeb-9855-4236-9566-f300c0256bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:27.978665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcadeeb-9855-4236-9566-f300c0256bb6 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:27.980805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 02:58:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:27.986051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899de3-5fa7-40b6-80e7-585ae9c30cc5 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:27.986508 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899de3-5fa7-40b6-80e7-585ae9c30cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:27.986612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d899de3-5fa7-40b6-80e7-585ae9c30cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:28.006576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-4d899de3-5fa7-40b6-80e7-585ae9c30cc5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:28.007791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4d899de3-5fa7-40b6-80e7-585ae9c30cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:28.016371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 02:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:28.167523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcadeeb-9855-4236-9566-f300c0256bb6 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:28.184142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcadeeb-9855-4236-9566-f300c0256bb6 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:28.190218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6038870-b32b-43c1-9ec8-26d30f819335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:28.190849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6038870-b32b-43c1-9ec8-26d30f819335 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:28.191154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6038870-b32b-43c1-9ec8-26d30f819335 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:28.191428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6038870-b32b-43c1-9ec8-26d30f819335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:28.199836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6038870-b32b-43c1-9ec8-26d30f819335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:28.201439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6038870-b32b-43c1-9ec8-26d30f819335 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:28.211214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 724/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 02:58:29.013316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531276-fe13-487c-95c0-827dadbb566a None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:29.014184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531276-fe13-487c-95c0-827dadbb566a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:29.014184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531276-fe13-487c-95c0-827dadbb566a None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:29.016425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 02:58:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:29.024867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33c904-a6b0-4a52-830d-931465054506 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:29.025295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33c904-a6b0-4a52-830d-931465054506 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:29.025462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33c904-a6b0-4a52-830d-931465054506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:29.045847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-0f33c904-a6b0-4a52-830d-931465054506 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:29.047024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-0f33c904-a6b0-4a52-830d-931465054506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:29.056385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 02:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:29.206332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac531276-fe13-487c-95c0-827dadbb566a None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:29.224977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac531276-fe13-487c-95c0-827dadbb566a None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:29.231204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55460a-55a6-45bc-a53e-c1369206191b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:29.231828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55460a-55a6-45bc-a53e-c1369206191b service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:29.232117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55460a-55a6-45bc-a53e-c1369206191b service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:29.232383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55460a-55a6-45bc-a53e-c1369206191b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:29.240750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55460a-55a6-45bc-a53e-c1369206191b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:29.242345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55460a-55a6-45bc-a53e-c1369206191b service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:29.251828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 712/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:30.054620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c013c5-ba57-4d2b-b027-f56b141f4228 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:30.055560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c013c5-ba57-4d2b-b027-f56b141f4228 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:30.055560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c013c5-ba57-4d2b-b027-f56b141f4228 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:30.057724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 02:58:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:30.065858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f2f5-3ac2-4116-80d4-aaf51f9b7268 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:30.066296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f2f5-3ac2-4116-80d4-aaf51f9b7268 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:30.066428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030f2f5-3ac2-4116-80d4-aaf51f9b7268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:30.088720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f030f2f5-3ac2-4116-80d4-aaf51f9b7268 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:30.089938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f030f2f5-3ac2-4116-80d4-aaf51f9b7268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:30.098439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 02:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:30.244689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c013c5-ba57-4d2b-b027-f56b141f4228 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:30.267400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c013c5-ba57-4d2b-b027-f56b141f4228 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:30.274177 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e1d2-3b89-4cfb-abea-3cee36995204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:30.274826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e1d2-3b89-4cfb-abea-3cee36995204 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:30.275133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e1d2-3b89-4cfb-abea-3cee36995204 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:30.275421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e1d2-3b89-4cfb-abea-3cee36995204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:30.284199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8e1d2-3b89-4cfb-abea-3cee36995204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:30.285842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8e1d2-3b89-4cfb-abea-3cee36995204 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:30.295438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 727/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:32.228460 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48efa0-d1c2-460e-b083-4cc249b6fd8e None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:32.229477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48efa0-d1c2-460e-b083-4cc249b6fd8e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:32.229477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48efa0-d1c2-460e-b083-4cc249b6fd8e None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:32.231698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 02:58:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:32.240694 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50640a-c4cd-4017-90c4-dc8830a03e18 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:32.241168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50640a-c4cd-4017-90c4-dc8830a03e18 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:32.241276 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50640a-c4cd-4017-90c4-dc8830a03e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:32.261952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-cb50640a-c4cd-4017-90c4-dc8830a03e18 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:32.263178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-cb50640a-c4cd-4017-90c4-dc8830a03e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:32.275672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 02:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:32.321827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48efa0-d1c2-460e-b083-4cc249b6fd8e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:32.335038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48efa0-d1c2-460e-b083-4cc249b6fd8e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:32.339157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344dd5c-45b2-4858-9974-26a95dfbd9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:32.339773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344dd5c-45b2-4858-9974-26a95dfbd9fc service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:32.340057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344dd5c-45b2-4858-9974-26a95dfbd9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:32.340336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344dd5c-45b2-4858-9974-26a95dfbd9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:32.349750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344dd5c-45b2-4858-9974-26a95dfbd9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:32.351273 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344dd5c-45b2-4858-9974-26a95dfbd9fc service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:32.360918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 715/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:34.499172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced04a9-f52a-43bf-b71f-4b03159a2a03 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:34.499748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced04a9-f52a-43bf-b71f-4b03159a2a03 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:34.499748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced04a9-f52a-43bf-b71f-4b03159a2a03 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:34.501099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 02:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:34.507441 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91c783-6e24-47ca-92ab-742ef9f22341 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:34.507877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91c783-6e24-47ca-92ab-742ef9f22341 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:34.508026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91c783-6e24-47ca-92ab-742ef9f22341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:34.528253 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9b91c783-6e24-47ca-92ab-742ef9f22341 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:34.529839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9b91c783-6e24-47ca-92ab-742ef9f22341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:34.538941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 02:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:34.589157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced04a9-f52a-43bf-b71f-4b03159a2a03 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:34.603468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced04a9-f52a-43bf-b71f-4b03159a2a03 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:34.607584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4a489-ff68-4784-bb4a-43c8fd5c7bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:34.608501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4a489-ff68-4784-bb4a-43c8fd5c7bfb service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:34.608790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4a489-ff68-4784-bb4a-43c8fd5c7bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:34.609095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4a489-ff68-4784-bb4a-43c8fd5c7bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:34.618484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4a489-ff68-4784-bb4a-43c8fd5c7bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:34.619990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4a489-ff68-4784-bb4a-43c8fd5c7bfb service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:34.629612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 730/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:36.948873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4849e-af74-4847-80a1-a56a75699efd None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:36.949817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4849e-af74-4847-80a1-a56a75699efd None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:36.949817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4849e-af74-4847-80a1-a56a75699efd None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:36.951200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 02:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:36.957405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538be48-1913-4461-95fd-d70d21ba1d7b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:36.957865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538be48-1913-4461-95fd-d70d21ba1d7b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:36.958012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538be48-1913-4461-95fd-d70d21ba1d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:36.984501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-1538be48-1913-4461-95fd-d70d21ba1d7b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:36.985709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1538be48-1913-4461-95fd-d70d21ba1d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:36.994251 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 02:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:37.036170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4849e-af74-4847-80a1-a56a75699efd None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:37.052086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4849e-af74-4847-80a1-a56a75699efd None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:37.057907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60d897-8c3a-407a-8a8d-5e575d653b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:37.058925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60d897-8c3a-407a-8a8d-5e575d653b9b service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:37.059420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60d897-8c3a-407a-8a8d-5e575d653b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:37.059871 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60d897-8c3a-407a-8a8d-5e575d653b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:37.075113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60d897-8c3a-407a-8a8d-5e575d653b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:37.076555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60d897-8c3a-407a-8a8d-5e575d653b9b service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:37.086452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 718/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:39.246526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125905f-9548-4871-9924-c0ef82249c7a None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:39.247104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125905f-9548-4871-9924-c0ef82249c7a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:39.247104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125905f-9548-4871-9924-c0ef82249c7a None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:39.249244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 02:58:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:39.257993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590158d-04fa-4e66-b6ca-d418f2414eae None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:39.258407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590158d-04fa-4e66-b6ca-d418f2414eae None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:39.258594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590158d-04fa-4e66-b6ca-d418f2414eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:39.279293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9590158d-04fa-4e66-b6ca-d418f2414eae None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:39.280835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9590158d-04fa-4e66-b6ca-d418f2414eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:39.289156 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 02:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:39.327593 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125905f-9548-4871-9924-c0ef82249c7a None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:39.341190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125905f-9548-4871-9924-c0ef82249c7a None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:39.348181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e3937-82eb-466a-9c2a-1da2a4720d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:39.349094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e3937-82eb-466a-9c2a-1da2a4720d17 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:39.349502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e3937-82eb-466a-9c2a-1da2a4720d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:39.349964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e3937-82eb-466a-9c2a-1da2a4720d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:39.362616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e3937-82eb-466a-9c2a-1da2a4720d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:39.364137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e3937-82eb-466a-9c2a-1da2a4720d17 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:39.374531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 733/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:41.547885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f79d-c12c-4534-acd9-c617512ece47 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:41.548471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f79d-c12c-4534-acd9-c617512ece47 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:41.548471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f79d-c12c-4534-acd9-c617512ece47 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:41.549875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 02:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:41.556640 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b46e-9fb5-4168-83c2-44be542c6fd2 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:41.557329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b46e-9fb5-4168-83c2-44be542c6fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:41.557521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b46e-9fb5-4168-83c2-44be542c6fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:41.583711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-3ee3b46e-9fb5-4168-83c2-44be542c6fd2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:41.584919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3ee3b46e-9fb5-4168-83c2-44be542c6fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:41.593698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 02:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:41.631714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41f79d-c12c-4534-acd9-c617512ece47 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:41.643489 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41f79d-c12c-4534-acd9-c617512ece47 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:41.647824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8edc57-7cca-43c2-9733-a7e5e27eb4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:41.648463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8edc57-7cca-43c2-9733-a7e5e27eb4ce service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:41.648745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8edc57-7cca-43c2-9733-a7e5e27eb4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:41.649063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8edc57-7cca-43c2-9733-a7e5e27eb4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:41.658906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8edc57-7cca-43c2-9733-a7e5e27eb4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:41.660398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8edc57-7cca-43c2-9733-a7e5e27eb4ce service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:41.669927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 721/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:43.746243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220c5d-6e2a-4ee3-8d43-ba3039a2a9bd None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:43.747191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220c5d-6e2a-4ee3-8d43-ba3039a2a9bd None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:43.747191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220c5d-6e2a-4ee3-8d43-ba3039a2a9bd None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:43.749569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 02:58:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:43.756006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f12009-9297-4888-9274-cf198f1adf9e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:43.756427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f12009-9297-4888-9274-cf198f1adf9e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:43.756537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f12009-9297-4888-9274-cf198f1adf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:43.777606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a0f12009-9297-4888-9274-cf198f1adf9e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:43.778800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a0f12009-9297-4888-9274-cf198f1adf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:43.789996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 02:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:43.828159 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34220c5d-6e2a-4ee3-8d43-ba3039a2a9bd None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:43.845164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34220c5d-6e2a-4ee3-8d43-ba3039a2a9bd None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:43.849487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a73fc-bd93-481b-897b-6b8ea8576e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:43.850134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a73fc-bd93-481b-897b-6b8ea8576e41 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:43.850514 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a73fc-bd93-481b-897b-6b8ea8576e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:43.850796 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a73fc-bd93-481b-897b-6b8ea8576e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:43.860572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a73fc-bd93-481b-897b-6b8ea8576e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:43.862036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a73fc-bd93-481b-897b-6b8ea8576e41 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:43.872256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 736/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:45.931813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ca509-8dce-41e4-8c63-e07d62bad4af None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:45.932737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ca509-8dce-41e4-8c63-e07d62bad4af None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:45.932737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ca509-8dce-41e4-8c63-e07d62bad4af None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:45.934978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 02:58:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:45.943858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b14a85-ee38-4ba6-856f-b575e7efd6fd None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:45.944273 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b14a85-ee38-4ba6-856f-b575e7efd6fd None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:45.944471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b14a85-ee38-4ba6-856f-b575e7efd6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:45.965235 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-25b14a85-ee38-4ba6-856f-b575e7efd6fd None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:45.966443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-25b14a85-ee38-4ba6-856f-b575e7efd6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:45.974873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 02:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:46.012946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ca509-8dce-41e4-8c63-e07d62bad4af None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:46.031491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ca509-8dce-41e4-8c63-e07d62bad4af None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:46.037555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989e957-bf8b-4d40-8fe0-611bdd698760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:46.038219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989e957-bf8b-4d40-8fe0-611bdd698760 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:46.038511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989e957-bf8b-4d40-8fe0-611bdd698760 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:46.038793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989e957-bf8b-4d40-8fe0-611bdd698760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:46.048421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989e957-bf8b-4d40-8fe0-611bdd698760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:46.049870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989e957-bf8b-4d40-8fe0-611bdd698760 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:46.059644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 724/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:48.128573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e1f86-87f2-4182-9947-47399e9a8628 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:48.129617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e1f86-87f2-4182-9947-47399e9a8628 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:48.129617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e1f86-87f2-4182-9947-47399e9a8628 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:48.131788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 02:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:48.138177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd1f74-a83f-4883-bdfe-a87645023345 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:48.138617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd1f74-a83f-4883-bdfe-a87645023345 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:48.138742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd1f74-a83f-4883-bdfe-a87645023345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:48.145172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=79 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:58:48.159100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-13dd1f74-a83f-4883-bdfe-a87645023345 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:48.160328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-13dd1f74-a83f-4883-bdfe-a87645023345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:48.169007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 02:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:48.207447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e1f86-87f2-4182-9947-47399e9a8628 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:48.214846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=73 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:58:48.223368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e1f86-87f2-4182-9947-47399e9a8628 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:48.227830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a9ee0-e728-486e-9de5-14c8bf1d4fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:48.228482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a9ee0-e728-486e-9de5-14c8bf1d4fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:48.228793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a9ee0-e728-486e-9de5-14c8bf1d4fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:48.229075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a9ee0-e728-486e-9de5-14c8bf1d4fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:48.238750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a9ee0-e728-486e-9de5-14c8bf1d4fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:48.240249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a9ee0-e728-486e-9de5-14c8bf1d4fb1 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:48.249887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 739/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:58:50.323346 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18d0b4-0a4c-42b3-900d-b6d99ac8a157 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:50.323963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18d0b4-0a4c-42b3-900d-b6d99ac8a157 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:50.323963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18d0b4-0a4c-42b3-900d-b6d99ac8a157 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:50.325413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 02:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:50.330807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966bf9-cb0a-4353-8c04-a8f0aff2f7c1 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:50.331276 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966bf9-cb0a-4353-8c04-a8f0aff2f7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:50.331369 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966bf9-cb0a-4353-8c04-a8f0aff2f7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:50.351679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-c8966bf9-cb0a-4353-8c04-a8f0aff2f7c1 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:50.352861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c8966bf9-cb0a-4353-8c04-a8f0aff2f7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:50.361735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 02:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:50.400472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18d0b4-0a4c-42b3-900d-b6d99ac8a157 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:50.413051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18d0b4-0a4c-42b3-900d-b6d99ac8a157 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:50.417225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c90d8-73d2-4b93-80e2-7dac804a2fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:50.417861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c90d8-73d2-4b93-80e2-7dac804a2fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:50.418143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c90d8-73d2-4b93-80e2-7dac804a2fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:50.418416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c90d8-73d2-4b93-80e2-7dac804a2fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:50.427801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c90d8-73d2-4b93-80e2-7dac804a2fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:50.429245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c90d8-73d2-4b93-80e2-7dac804a2fcd service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:50.438697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 727/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 02:58:52.446434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5e2fc-a8d7-47ab-b5da-2cd74e30bbe8 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:52.447068 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5e2fc-a8d7-47ab-b5da-2cd74e30bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:52.447068 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5e2fc-a8d7-47ab-b5da-2cd74e30bbe8 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:52.448471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 02:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:58:52.453930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e32d3c-28e0-49fe-ac7a-07c648bb9cdf None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:52.454373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e32d3c-28e0-49fe-ac7a-07c648bb9cdf None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:52.454499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e32d3c-28e0-49fe-ac7a-07c648bb9cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:52.472682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c0e32d3c-28e0-49fe-ac7a-07c648bb9cdf None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:58:52.473853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c0e32d3c-28e0-49fe-ac7a-07c648bb9cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:58:52.483407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 02:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:58:52.519550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5e2fc-a8d7-47ab-b5da-2cd74e30bbe8 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:58:52.531848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5e2fc-a8d7-47ab-b5da-2cd74e30bbe8 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:58:52.536273 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d94b2-a67a-439b-82b4-cfdca3163a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:58:52.536920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d94b2-a67a-439b-82b4-cfdca3163a8f service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:58:52.537207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d94b2-a67a-439b-82b4-cfdca3163a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:58:52.537479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d94b2-a67a-439b-82b4-cfdca3163a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:58:52.547092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d94b2-a67a-439b-82b4-cfdca3163a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:58:52.548531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d94b2-a67a-439b-82b4-cfdca3163a8f service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:58:52.558252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 742/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:59:02.467432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=11 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:59:02.553803 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=14 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:59:12.175269 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bde71-def9-42b1-b3a3-d12c4e2b4203 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:12.175920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bde71-def9-42b1-b3a3-d12c4e2b4203 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:12.175920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bde71-def9-42b1-b3a3-d12c4e2b4203 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:12.177211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 729/1471] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:59:12.183980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24244d9-62ae-49b0-8794-065aa67ed9da None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:12.184721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24244d9-62ae-49b0-8794-065aa67ed9da None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:12.184861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24244d9-62ae-49b0-8794-065aa67ed9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:12.209736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f24244d9-62ae-49b0-8794-065aa67ed9da None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:59:12.210915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f24244d9-62ae-49b0-8794-065aa67ed9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:59:12.219409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 743/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:59:12.266242 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f35877-adb4-4303-8211-6cb16f6ebc6a None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:12.266535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f35877-adb4-4303-8211-6cb16f6ebc6a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:12.266806 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f35877-adb4-4303-8211-6cb16f6ebc6a None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:12.268216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 730/1473] 10.222.0.36 () {54 vars in 962 bytes} [Sun Jun 26 02:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 26 02:59:12.273484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9d06c-6a18-415b-8043-96ec04b9f22c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:12.273769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9d06c-6a18-415b-8043-96ec04b9f22c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:12.274044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9d06c-6a18-415b-8043-96ec04b9f22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:12.293176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-abc9d06c-6a18-415b-8043-96ec04b9f22c None None] MFA Rules not processed for user `250c47daff26400c96a6b467d7cf5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:59:12.294343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-abc9d06c-6a18-415b-8043-96ec04b9f22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:59:12.301041 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 744/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Sun Jun 26 02:59:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:59:12.308331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f35877-adb4-4303-8211-6cb16f6ebc6a None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:59:12.319855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f35877-adb4-4303-8211-6cb16f6ebc6a None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:59:12.323891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73928f-4e65-4776-9004-25b2834a5ca7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '250c47daff26400c96a6b467d7cf5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:59:12.324537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73928f-4e65-4776-9004-25b2834a5ca7 service glance] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:12.324819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73928f-4e65-4776-9004-25b2834a5ca7 service glance] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:12.325093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73928f-4e65-4776-9004-25b2834a5ca7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:12.335818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73928f-4e65-4776-9004-25b2834a5ca7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:59:12.337319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73928f-4e65-4776-9004-25b2834a5ca7 service glance] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:59:12.348519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 731/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:59:14.449889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f59844-405d-412f-bd29-2fdc0bd89bd2 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:14.450786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f59844-405d-412f-bd29-2fdc0bd89bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:14.450786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f59844-405d-412f-bd29-2fdc0bd89bd2 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:14.452690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 745/1476] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:59:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:59:14.458275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d139-537d-4da5-9f07-7bfb7f8c9d30 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:14.458715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d139-537d-4da5-9f07-7bfb7f8c9d30 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:14.458806 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d139-537d-4da5-9f07-7bfb7f8c9d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:14.476918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-bec3d139-537d-4da5-9f07-7bfb7f8c9d30 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:59:14.478114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-bec3d139-537d-4da5-9f07-7bfb7f8c9d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:59:14.487474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 732/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:59:14.510885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f59844-405d-412f-bd29-2fdc0bd89bd2 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:59:14.525239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f59844-405d-412f-bd29-2fdc0bd89bd2 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:59:14.530271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530495e-7e9f-42eb-91c1-b13ce5c986ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:59:14.530919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530495e-7e9f-42eb-91c1-b13ce5c986ee admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:14.531242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530495e-7e9f-42eb-91c1-b13ce5c986ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:14.531517 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530495e-7e9f-42eb-91c1-b13ce5c986ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:14.532249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530495e-7e9f-42eb-91c1-b13ce5c986ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:59:14.534421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: WARNING py.warnings [None req-2530495e-7e9f-42eb-91c1-b13ce5c986ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 26 02:59:14.534421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: warnings.warn(msg) Jun 26 02:59:14.534421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: Jun 26 02:59:14.535603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530495e-7e9f-42eb-91c1-b13ce5c986ee admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:59:14.554559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 746/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Sun Jun 26 02:59:14 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 02:59:16.584732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46db7ab-7119-4ff1-ad66-c03f215c91be None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:16.585308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46db7ab-7119-4ff1-ad66-c03f215c91be None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:16.585308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46db7ab-7119-4ff1-ad66-c03f215c91be None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:16.586688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 733/1479] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:59:16.593042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837daa0-7469-4626-87ce-e56408a06310 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:16.593584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837daa0-7469-4626-87ce-e56408a06310 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:16.593741 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837daa0-7469-4626-87ce-e56408a06310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:16.617683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-7837daa0-7469-4626-87ce-e56408a06310 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:59:16.618865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7837daa0-7469-4626-87ce-e56408a06310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:59:16.627320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 747/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:59:16.671099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46db7ab-7119-4ff1-ad66-c03f215c91be None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:59:16.686213 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46db7ab-7119-4ff1-ad66-c03f215c91be None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:59:16.691973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d7905-c427-4410-be98-efe23c23b5d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:59:16.692609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7905-c427-4410-be98-efe23c23b5d4 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:16.692892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7905-c427-4410-be98-efe23c23b5d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:16.693172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7905-c427-4410-be98-efe23c23b5d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:16.701708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d7905-c427-4410-be98-efe23c23b5d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:59:16.703368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d7905-c427-4410-be98-efe23c23b5d4 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:59:16.713136 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 734/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:59:18.908980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dc92c-226c-4db0-a547-e725b65e6a5c None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:18.909583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dc92c-226c-4db0-a547-e725b65e6a5c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:18.909583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dc92c-226c-4db0-a547-e725b65e6a5c None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:18.910936 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 748/1482] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:59:18.919905 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae98a-98fa-4408-962c-c5b71aceebf1 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:18.920665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae98a-98fa-4408-962c-c5b71aceebf1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:18.920817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae98a-98fa-4408-962c-c5b71aceebf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:18.939656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-202ae98a-98fa-4408-962c-c5b71aceebf1 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:59:18.940851 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-202ae98a-98fa-4408-962c-c5b71aceebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:59:18.953233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 735/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:59:18.998515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dc92c-226c-4db0-a547-e725b65e6a5c None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:59:19.015593 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dc92c-226c-4db0-a547-e725b65e6a5c None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:59:19.019950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3f670-4238-4487-b0d1-465d1576c090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:59:19.020589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f670-4238-4487-b0d1-465d1576c090 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:19.020867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f670-4238-4487-b0d1-465d1576c090 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:19.021127 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3f670-4238-4487-b0d1-465d1576c090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:19.030513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3f670-4238-4487-b0d1-465d1576c090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:59:19.031999 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3f670-4238-4487-b0d1-465d1576c090 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:59:19.042148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 749/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:59:21.091443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946b1cb-4853-4c10-93f8-9c07fb10ecea None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:21.091999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946b1cb-4853-4c10-93f8-9c07fb10ecea None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:21.091999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946b1cb-4853-4c10-93f8-9c07fb10ecea None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:21.093351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 736/1485] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:59:21.098891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1ff7a-9ad9-4468-bda3-5485f16d210a None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:21.099340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1ff7a-9ad9-4468-bda3-5485f16d210a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:21.099478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1ff7a-9ad9-4468-bda3-5485f16d210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:21.118192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4db1ff7a-9ad9-4468-bda3-5485f16d210a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:59:21.119402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4db1ff7a-9ad9-4468-bda3-5485f16d210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:59:21.127584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 750/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:59:21.166194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946b1cb-4853-4c10-93f8-9c07fb10ecea None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:59:21.180134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946b1cb-4853-4c10-93f8-9c07fb10ecea None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:59:21.184430 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d50c3-ef68-4e1a-bae3-f0742e57a8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:59:21.185081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d50c3-ef68-4e1a-bae3-f0742e57a8df service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:21.185391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d50c3-ef68-4e1a-bae3-f0742e57a8df service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:21.185648 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d50c3-ef68-4e1a-bae3-f0742e57a8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:21.195515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d50c3-ef68-4e1a-bae3-f0742e57a8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:59:21.196964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d50c3-ef68-4e1a-bae3-f0742e57a8df service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:59:21.206609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 737/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:59:23.382039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f66c4e-2741-43a7-ae12-23c1cb7a9425 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:23.382892 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f66c4e-2741-43a7-ae12-23c1cb7a9425 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:23.382892 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f66c4e-2741-43a7-ae12-23c1cb7a9425 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:23.385160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 751/1488] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:59:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:59:23.392620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707c94-39b2-4705-83e1-5ca576ef6d5e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:23.393073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707c94-39b2-4705-83e1-5ca576ef6d5e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:23.393182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707c94-39b2-4705-83e1-5ca576ef6d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:23.412852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fb707c94-39b2-4705-83e1-5ca576ef6d5e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:59:23.414060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fb707c94-39b2-4705-83e1-5ca576ef6d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:59:23.424011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 738/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:59:23.467950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f66c4e-2741-43a7-ae12-23c1cb7a9425 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:59:23.484562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f66c4e-2741-43a7-ae12-23c1cb7a9425 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:59:23.488955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be52d9-60a2-4918-8969-8f9fd9301348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:59:23.489600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be52d9-60a2-4918-8969-8f9fd9301348 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:23.489892 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be52d9-60a2-4918-8969-8f9fd9301348 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:23.490155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be52d9-60a2-4918-8969-8f9fd9301348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:23.500494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be52d9-60a2-4918-8969-8f9fd9301348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:59:23.501889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be52d9-60a2-4918-8969-8f9fd9301348 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:59:23.511947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 752/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:59:25.757993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb0b8d-e921-4826-b02f-b19f6e407577 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:25.758852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb0b8d-e921-4826-b02f-b19f6e407577 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:25.758852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb0b8d-e921-4826-b02f-b19f6e407577 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:25.761016 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 739/1491] 10.222.0.36 () {54 vars in 926 bytes} [Sun Jun 26 02:59:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 02:59:25.766394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9bb19-8d81-44a7-b181-b2eeb9e76f0e None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:25.766818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9bb19-8d81-44a7-b181-b2eeb9e76f0e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:25.766911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9bb19-8d81-44a7-b181-b2eeb9e76f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:25.786510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-18e9bb19-8d81-44a7-b181-b2eeb9e76f0e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 02:59:25.787831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-18e9bb19-8d81-44a7-b181-b2eeb9e76f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 02:59:25.797165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 753/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Sun Jun 26 02:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 02:59:25.839039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb0b8d-e921-4826-b02f-b19f6e407577 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 02:59:25.862110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb0b8d-e921-4826-b02f-b19f6e407577 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 02:59:25.866829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998a19a-1b85-448a-ab37-7371c266c898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 02:59:25.867551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998a19a-1b85-448a-ab37-7371c266c898 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 02:59:25.867833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998a19a-1b85-448a-ab37-7371c266c898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 02:59:25.868110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998a19a-1b85-448a-ab37-7371c266c898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 02:59:25.878948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998a19a-1b85-448a-ab37-7371c266c898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 02:59:25.880436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998a19a-1b85-448a-ab37-7371c266c898 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 02:59:25.891257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 740/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 02:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 02:59:35.780550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=33 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 02:59:35.886068 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=33 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:00:56.452480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048aae3-8926-4538-a2bf-d217b37e6446 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:56.453492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048aae3-8926-4538-a2bf-d217b37e6446 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:56.453492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048aae3-8926-4538-a2bf-d217b37e6446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:56.474914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-c048aae3-8926-4538-a2bf-d217b37e6446 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:00:56.476150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c048aae3-8926-4538-a2bf-d217b37e6446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:00:56.485325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 754/1494] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:00:56.493477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c33b66-2567-4ce7-aafd-bdccf0f560ee None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:56.493998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c33b66-2567-4ce7-aafd-bdccf0f560ee None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:56.493998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c33b66-2567-4ce7-aafd-bdccf0f560ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:56.513882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b9c33b66-2567-4ce7-aafd-bdccf0f560ee None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:00:56.515116 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b9c33b66-2567-4ce7-aafd-bdccf0f560ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:00:56.524269 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 741/1495] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:00:56.529200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048aae3-8926-4538-a2bf-d217b37e6446 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:00:56.539766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048aae3-8926-4538-a2bf-d217b37e6446 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:00:56.545375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b187aa-ef61-4e7f-b51b-f9937fb104d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:00:56.546033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b187aa-ef61-4e7f-b51b-f9937fb104d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:56.546338 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b187aa-ef61-4e7f-b51b-f9937fb104d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:56.546592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b187aa-ef61-4e7f-b51b-f9937fb104d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:56.547437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b187aa-ef61-4e7f-b51b-f9937fb104d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:00:56.547739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b187aa-ef61-4e7f-b51b-f9937fb104d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:00:56.548781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: WARNING py.warnings [None req-c2b187aa-ef61-4e7f-b51b-f9937fb104d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:00:56.548781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: warnings.warn(msg) Jun 26 03:00:56.548781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: Jun 26 03:00:56.549665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b187aa-ef61-4e7f-b51b-f9937fb104d0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:00:56.561861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 755/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:00:56.570710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c33b66-2567-4ce7-aafd-bdccf0f560ee None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:00:56.585006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c33b66-2567-4ce7-aafd-bdccf0f560ee None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:00:56.593390 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87263781-f2df-4d53-91f5-528d2a4c3e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:00:56.594331 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87263781-f2df-4d53-91f5-528d2a4c3e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:56.594698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87263781-f2df-4d53-91f5-528d2a4c3e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:56.595065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87263781-f2df-4d53-91f5-528d2a4c3e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:56.596115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87263781-f2df-4d53-91f5-528d2a4c3e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:00:56.598869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: WARNING py.warnings [None req-87263781-f2df-4d53-91f5-528d2a4c3e52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:00:56.598869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: warnings.warn(msg) Jun 26 03:00:56.598869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: Jun 26 03:00:56.600710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87263781-f2df-4d53-91f5-528d2a4c3e52 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:00:56.644540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 742/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:00:56 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:00:56.649002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b187aa-ef61-4e7f-b51b-f9937fb104d0 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:00:56.659399 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b187aa-ef61-4e7f-b51b-f9937fb104d0 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:00:56.717825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fd112-8ed6-46b8-a1f7-36a7c3fac971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:00:56.718434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fd112-8ed6-46b8-a1f7-36a7c3fac971 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:56.718701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fd112-8ed6-46b8-a1f7-36a7c3fac971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:56.719015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fd112-8ed6-46b8-a1f7-36a7c3fac971 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:56.719713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fd112-8ed6-46b8-a1f7-36a7c3fac971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:00:56.720762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: WARNING py.warnings [None req-df8fd112-8ed6-46b8-a1f7-36a7c3fac971 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:00:56.720762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: warnings.warn(msg) Jun 26 03:00:56.720762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: Jun 26 03:00:56.722019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fd112-8ed6-46b8-a1f7-36a7c3fac971 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:00:56.742980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 756/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:00:56 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:00:56.747145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87263781-f2df-4d53-91f5-528d2a4c3e52 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:00:56.757438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87263781-f2df-4d53-91f5-528d2a4c3e52 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:00:56.762184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d105f-8e3e-44d5-a41e-88bc30e5710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:00:56.762837 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d105f-8e3e-44d5-a41e-88bc30e5710b admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:56.763158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d105f-8e3e-44d5-a41e-88bc30e5710b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:56.763438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d105f-8e3e-44d5-a41e-88bc30e5710b admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:56.764161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d105f-8e3e-44d5-a41e-88bc30e5710b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:00:56.765184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: WARNING py.warnings [None req-5d8d105f-8e3e-44d5-a41e-88bc30e5710b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:00:56.765184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: warnings.warn(msg) Jun 26 03:00:56.765184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: Jun 26 03:00:56.766059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d105f-8e3e-44d5-a41e-88bc30e5710b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:00:56.778883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 743/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:00:56.782739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fd112-8ed6-46b8-a1f7-36a7c3fac971 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:00:56.793217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fd112-8ed6-46b8-a1f7-36a7c3fac971 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:00:56.797840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7ca6a-b10f-4825-80b4-15cee0f9e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:00:56.798496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7ca6a-b10f-4825-80b4-15cee0f9e320 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:56.798779 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7ca6a-b10f-4825-80b4-15cee0f9e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:56.799087 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7ca6a-b10f-4825-80b4-15cee0f9e320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:56.799843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7ca6a-b10f-4825-80b4-15cee0f9e320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:00:56.800872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: WARNING py.warnings [None req-d9f7ca6a-b10f-4825-80b4-15cee0f9e320 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:00:56.800872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: warnings.warn(msg) Jun 26 03:00:56.800872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: Jun 26 03:00:56.801740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7ca6a-b10f-4825-80b4-15cee0f9e320 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:00:56.815434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 757/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:00:56.819928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d105f-8e3e-44d5-a41e-88bc30e5710b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:00:56.830270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d105f-8e3e-44d5-a41e-88bc30e5710b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:00:56.835470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddc640-2370-4df0-b683-92e4d64f8456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:00:56.836356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddc640-2370-4df0-b683-92e4d64f8456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:56.836634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddc640-2370-4df0-b683-92e4d64f8456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:56.836908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddc640-2370-4df0-b683-92e4d64f8456 admin admin] PATH_INFO: `/v3/projects/3d8a60ea7d5147ef8fdbd78429fd637f/users/bdc94df5aa664b2383e8b9e64cdf790b/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:56.852260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddc640-2370-4df0-b683-92e4d64f8456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8a60ea7d5147ef8fdbd78429fd637f, user_id=bdc94df5aa664b2383e8b9e64cdf790b, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:00:56.853290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: WARNING py.warnings [None req-6eddc640-2370-4df0-b683-92e4d64f8456 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:00:56.853290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: warnings.warn(msg) Jun 26 03:00:56.853290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: Jun 26 03:00:56.855274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddc640-2370-4df0-b683-92e4d64f8456 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:00:56.870214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 744/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:00:56 2022] PUT /identity/v3/projects/3d8a60ea7d5147ef8fdbd78429fd637f/users/bdc94df5aa664b2383e8b9e64cdf790b/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:00:56.881673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1f431-34f5-411e-8b8a-351cae074679 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:56.881961 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1f431-34f5-411e-8b8a-351cae074679 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:56.882238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1f431-34f5-411e-8b8a-351cae074679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:56.909071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6fb1f431-34f5-411e-8b8a-351cae074679 None None] MFA Rules not processed for user `bdc94df5aa664b2383e8b9e64cdf790b`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:00:56.910258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6fb1f431-34f5-411e-8b8a-351cae074679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:00:56.979604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 758/1502] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:00:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:00:56.996441 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd096010-bf21-4f5f-8e60-8a4f2a5e6608 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:56.996725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd096010-bf21-4f5f-8e60-8a4f2a5e6608 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:56.997013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd096010-bf21-4f5f-8e60-8a4f2a5e6608 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:56.998381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 745/1503] 10.222.0.36 () {54 vars in 963 bytes} [Sun Jun 26 03:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:00:57.003376 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe6a3e-611d-407b-9164-9b1bdcbe18c1 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:57.003668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe6a3e-611d-407b-9164-9b1bdcbe18c1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:57.003947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe6a3e-611d-407b-9164-9b1bdcbe18c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:57.026719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4efe6a3e-611d-407b-9164-9b1bdcbe18c1 None None] MFA Rules not processed for user `892be7ed998840de8b325316db3fdde4`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:00:57.027989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4efe6a3e-611d-407b-9164-9b1bdcbe18c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:00:57.074739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:00:57.084277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 759/1504] 10.222.0.36 () {58 vars in 1060 bytes} [Sun Jun 26 03:00:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:00:57.091993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd096010-bf21-4f5f-8e60-8a4f2a5e6608 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:00:57.103336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd096010-bf21-4f5f-8e60-8a4f2a5e6608 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:00:57.107659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c28e-915e-447a-842b-38a5c47b46c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:00:57.108297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c28e-915e-447a-842b-38a5c47b46c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:57.108559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c28e-915e-447a-842b-38a5c47b46c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:57.108834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c28e-915e-447a-842b-38a5c47b46c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:57.117278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2c28e-915e-447a-842b-38a5c47b46c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:00:57.118725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2c28e-915e-447a-842b-38a5c47b46c2 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:00:57.127429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 746/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:00:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:00:57.169703 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb37ca3-a115-4993-af59-08117bf681a2 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:57.170000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb37ca3-a115-4993-af59-08117bf681a2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:57.170276 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb37ca3-a115-4993-af59-08117bf681a2 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:57.171670 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 760/1506] 10.222.0.36 () {52 vars in 829 bytes} [Sun Jun 26 03:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:00:57.175675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c28e-915e-447a-842b-38a5c47b46c2 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:00:57.240731 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c28e-915e-447a-842b-38a5c47b46c2 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:00:57.245586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:00:57.246458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:57.246744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:57.247020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] PATH_INFO: `/v3/users/bdc94df5aa664b2383e8b9e64cdf790b` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:57.248265 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc94df5aa664b2383e8b9e64cdf790b)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:00:57.249285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: WARNING py.warnings [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:00:57.249285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: warnings.warn(msg) Jun 26 03:00:57.249285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: Jun 26 03:00:57.250484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:00:57.323209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc94df5aa664b2383e8b9e64cdf790b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:00:57.341815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc94df5aa664b2383e8b9e64cdf790b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:00:57.342616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc94df5aa664b2383e8b9e64cdf790b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:00:57.355270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc94df5aa664b2383e8b9e64cdf790b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:00:57.355993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc94df5aa664b2383e8b9e64cdf790b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:00:57.360066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:00:57.373842 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 747/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:00:57 2022] DELETE /identity/v3/users/bdc94df5aa664b2383e8b9e64cdf790b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:00:57.378626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91f21f-eb29-414c-a479-62ed8003272d None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:57.378922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91f21f-eb29-414c-a479-62ed8003272d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:57.379229 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91f21f-eb29-414c-a479-62ed8003272d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:57.398055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-3f91f21f-eb29-414c-a479-62ed8003272d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:00:57.400162 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3f91f21f-eb29-414c-a479-62ed8003272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:00:57.475894 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 761/1508] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:00:57.487255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:00:57.490037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:00:57.559778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aebed0-cd37-4418-a9ee-e80ead135ea9 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:00:57.565629 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afae650-9976-4dc6-b3b7-bd8188b6aeb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:00:57.566300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afae650-9976-4dc6-b3b7-bd8188b6aeb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:57.566600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afae650-9976-4dc6-b3b7-bd8188b6aeb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:57.566877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afae650-9976-4dc6-b3b7-bd8188b6aeb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:57.577442 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afae650-9976-4dc6-b3b7-bd8188b6aeb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:00:57.578907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afae650-9976-4dc6-b3b7-bd8188b6aeb5 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:00:57.588654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 748/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:00:57.947100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91f21f-eb29-414c-a479-62ed8003272d None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:00:57.948636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3f91f21f-eb29-414c-a479-62ed8003272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:00:57.960557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91f21f-eb29-414c-a479-62ed8003272d None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:00:57.965249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:00:57.966113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:00:57.966394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:00:57.966700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] PATH_INFO: `/v3/projects/3d8a60ea7d5147ef8fdbd78429fd637f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:00:57.967964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8a60ea7d5147ef8fdbd78429fd637f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:00:57.969024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: WARNING py.warnings [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:00:57.969024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: warnings.warn(msg) Jun 26 03:00:57.969024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: Jun 26 03:00:57.970171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:00:58.029707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8a60ea7d5147ef8fdbd78429fd637f', 'request_id': 'req-dff66a50-6759-42bf-8251-d484788e0b8b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:00:58.043062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8a60ea7d5147ef8fdbd78429fd637f', 'request_id': 'req-dff66a50-6759-42bf-8251-d484788e0b8b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:00:58.052608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8a60ea7d5147ef8fdbd78429fd637f', 'request_id': 'req-dff66a50-6759-42bf-8251-d484788e0b8b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:00:58.063465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] The token cache is being invalidate because project 3d8a60ea7d5147ef8fdbd78429fd637f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:00:58.063746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:00:58.064435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-dff66a50-6759-42bf-8251-d484788e0b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:00:58.065982 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 762/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:00:57 2022] DELETE /identity/v3/projects/3d8a60ea7d5147ef8fdbd78429fd637f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:01:07.584217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:01:08.060494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:02:39.255129 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3640-85c5-4b9d-b1e6-d081ed238d27 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:39.255739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3640-85c5-4b9d-b1e6-d081ed238d27 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:39.255739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3640-85c5-4b9d-b1e6-d081ed238d27 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:39.257319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 03:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:02:39.264486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbad79-ed35-4a71-9da2-73d016875430 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:39.264960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbad79-ed35-4a71-9da2-73d016875430 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:39.265061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbad79-ed35-4a71-9da2-73d016875430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:39.284062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8fdbad79-ed35-4a71-9da2-73d016875430 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:02:39.285256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8fdbad79-ed35-4a71-9da2-73d016875430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:02:39.344086 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 03:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:02:39.499157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3640-85c5-4b9d-b1e6-d081ed238d27 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:02:39.501196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6caa3640-85c5-4b9d-b1e6-d081ed238d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:02:39.583717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3640-85c5-4b9d-b1e6-d081ed238d27 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:02:39.593823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d2e9e-9922-4719-bed8-6b6b6eec62b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:02:39.594730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d2e9e-9922-4719-bed8-6b6b6eec62b4 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:39.595121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d2e9e-9922-4719-bed8-6b6b6eec62b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:39.595409 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d2e9e-9922-4719-bed8-6b6b6eec62b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:39.604211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d2e9e-9922-4719-bed8-6b6b6eec62b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:02:39.605879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d2e9e-9922-4719-bed8-6b6b6eec62b4 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:02:39.615619 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 750/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:02:40.432459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a5d00-a1f0-446a-9d8f-ce30c2b96eed None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:40.433367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a5d00-a1f0-446a-9d8f-ce30c2b96eed None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:40.433367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a5d00-a1f0-446a-9d8f-ce30c2b96eed None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:40.435624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 03:02:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:02:40.441943 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477803e-74ac-4abd-98df-625d4f812ecf None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:40.442374 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477803e-74ac-4abd-98df-625d4f812ecf None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:40.442488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477803e-74ac-4abd-98df-625d4f812ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:40.462207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5477803e-74ac-4abd-98df-625d4f812ecf None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:02:40.463463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5477803e-74ac-4abd-98df-625d4f812ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:02:40.472148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 03:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:02:40.626807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a5d00-a1f0-446a-9d8f-ce30c2b96eed None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:02:40.651039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a5d00-a1f0-446a-9d8f-ce30c2b96eed None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:02:40.657859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fed25-4198-43fb-a427-cd41d774c196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:02:40.658521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fed25-4198-43fb-a427-cd41d774c196 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:40.658803 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fed25-4198-43fb-a427-cd41d774c196 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:40.659121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fed25-4198-43fb-a427-cd41d774c196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:40.668924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fed25-4198-43fb-a427-cd41d774c196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:02:40.670564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fed25-4198-43fb-a427-cd41d774c196 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:02:40.680553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 765/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:02:41.065064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92787e-be94-4c97-998f-79115ef15312 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:41.065306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92787e-be94-4c97-998f-79115ef15312 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:41.065686 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92787e-be94-4c97-998f-79115ef15312 None None] PATH_INFO: `/v3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:41.067046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 752/1517] 10.222.0.23 () {54 vars in 925 bytes} [Sun Jun 26 03:02:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:02:41.077192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28fa7-a74f-406d-9df8-1ee366048376 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:41.077483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28fa7-a74f-406d-9df8-1ee366048376 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:41.077761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28fa7-a74f-406d-9df8-1ee366048376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:41.097095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-eed28fa7-a74f-406d-9df8-1ee366048376 None None] MFA Rules not processed for user `5ae5f8f789424969bd575f7360847261`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:02:41.098324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-eed28fa7-a74f-406d-9df8-1ee366048376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:02:41.160861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 766/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Jun 26 03:02:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:02:50.223617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9f604-ebdf-440f-968f-3d2695d386d3 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:50.224289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9f604-ebdf-440f-968f-3d2695d386d3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:50.224289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9f604-ebdf-440f-968f-3d2695d386d3 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:50.225463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 753/1519] 10.222.0.36 () {54 vars in 960 bytes} [Sun Jun 26 03:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:02:50.231583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de9c56-ef9b-49d1-8255-4a3ea9feb833 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:50.232255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de9c56-ef9b-49d1-8255-4a3ea9feb833 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:50.232435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de9c56-ef9b-49d1-8255-4a3ea9feb833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:50.258494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-27de9c56-ef9b-49d1-8255-4a3ea9feb833 None None] MFA Rules not processed for user `5ae5f8f789424969bd575f7360847261`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:02:50.259732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-27de9c56-ef9b-49d1-8255-4a3ea9feb833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:02:50.269426 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 767/1520] 10.222.0.36 () {58 vars in 1057 bytes} [Sun Jun 26 03:02:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:02:50.277148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9f604-ebdf-440f-968f-3d2695d386d3 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:02:50.293009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9f604-ebdf-440f-968f-3d2695d386d3 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:02:50.300249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf62fd-6372-49a0-8482-71534861eb6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:02:50.300968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf62fd-6372-49a0-8482-71534861eb6f service placement] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:50.301263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf62fd-6372-49a0-8482-71534861eb6f service placement] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:50.301579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf62fd-6372-49a0-8482-71534861eb6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:50.310097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf62fd-6372-49a0-8482-71534861eb6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:02:50.311716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf62fd-6372-49a0-8482-71534861eb6f service placement] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:02:50.321826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 754/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:02:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:02:51.936565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776618da-6608-4f6d-8f42-4a2aeabf1269 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:51.937155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776618da-6608-4f6d-8f42-4a2aeabf1269 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:51.937155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776618da-6608-4f6d-8f42-4a2aeabf1269 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:51.939266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 03:02:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:02:51.946639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203a70-bc4f-4dd2-9bfe-6bb183d6d6d3 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:51.947466 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203a70-bc4f-4dd2-9bfe-6bb183d6d6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:51.948280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203a70-bc4f-4dd2-9bfe-6bb183d6d6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:51.970746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c9203a70-bc4f-4dd2-9bfe-6bb183d6d6d3 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:02:51.972071 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c9203a70-bc4f-4dd2-9bfe-6bb183d6d6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:02:51.982290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 03:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:02:52.145475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776618da-6608-4f6d-8f42-4a2aeabf1269 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:02:52.162533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776618da-6608-4f6d-8f42-4a2aeabf1269 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:02:52.169400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495d374-aece-4232-9b91-de526be58ee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:02:52.170039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495d374-aece-4232-9b91-de526be58ee1 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:52.170311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495d374-aece-4232-9b91-de526be58ee1 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:52.170575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495d374-aece-4232-9b91-de526be58ee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:52.179473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495d374-aece-4232-9b91-de526be58ee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:02:52.181201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495d374-aece-4232-9b91-de526be58ee1 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:02:52.191390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 769/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:02:53.018011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e440bf-9977-4ba0-bfe1-0159a8b657a9 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:53.018975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e440bf-9977-4ba0-bfe1-0159a8b657a9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:53.018975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e440bf-9977-4ba0-bfe1-0159a8b657a9 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:53.021212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jun 26 03:02:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:02:53.026200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d9f9d-f62a-443c-88fb-5f6fb12f385d None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:53.026625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d9f9d-f62a-443c-88fb-5f6fb12f385d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:53.026746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d9f9d-f62a-443c-88fb-5f6fb12f385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:53.047563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6a2d9f9d-f62a-443c-88fb-5f6fb12f385d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:02:53.048748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6a2d9f9d-f62a-443c-88fb-5f6fb12f385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:02:53.057870 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jun 26 03:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:02:53.212080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e440bf-9977-4ba0-bfe1-0159a8b657a9 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:02:53.231845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e440bf-9977-4ba0-bfe1-0159a8b657a9 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:02:53.238649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139454d-e296-4cd8-8747-c6d96a5502d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:02:53.239330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139454d-e296-4cd8-8747-c6d96a5502d1 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:53.239617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139454d-e296-4cd8-8747-c6d96a5502d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:53.239895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139454d-e296-4cd8-8747-c6d96a5502d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:53.248690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139454d-e296-4cd8-8747-c6d96a5502d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:02:53.250329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139454d-e296-4cd8-8747-c6d96a5502d1 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:02:53.260327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 757/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:02:57.400805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa7725-a851-4ed6-a50b-95ded2e2f115 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:57.401439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa7725-a851-4ed6-a50b-95ded2e2f115 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:57.401439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa7725-a851-4ed6-a50b-95ded2e2f115 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:57.402755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 03:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:02:57.409204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f189-05f1-4fcb-8bc0-3c34cf85e2a5 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:57.409643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f189-05f1-4fcb-8bc0-3c34cf85e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:57.409775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f189-05f1-4fcb-8bc0-3c34cf85e2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:57.430452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c5c9f189-05f1-4fcb-8bc0-3c34cf85e2a5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:02:57.431682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c5c9f189-05f1-4fcb-8bc0-3c34cf85e2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:02:57.441653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 03:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:02:57.479061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa7725-a851-4ed6-a50b-95ded2e2f115 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:02:57.482128 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3daa7725-a851-4ed6-a50b-95ded2e2f115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:02:57.560822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa7725-a851-4ed6-a50b-95ded2e2f115 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:02:57.565030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789efaab-5b6f-4eb1-9f9c-6fff9c847607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:02:57.565680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789efaab-5b6f-4eb1-9f9c-6fff9c847607 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:57.565959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789efaab-5b6f-4eb1-9f9c-6fff9c847607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:57.566236 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789efaab-5b6f-4eb1-9f9c-6fff9c847607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:57.575695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789efaab-5b6f-4eb1-9f9c-6fff9c847607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:02:57.577149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789efaab-5b6f-4eb1-9f9c-6fff9c847607 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:02:57.582057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:02:57.587050 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 772/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:02:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:02:59.630772 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271c0f0-fa82-4033-b6a2-8bc1c8d565ee None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:59.631739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271c0f0-fa82-4033-b6a2-8bc1c8d565ee None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:59.631739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271c0f0-fa82-4033-b6a2-8bc1c8d565ee None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:59.633970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 03:02:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:02:59.642748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fa3a1-6694-4f24-a3da-f56e7d1db1d5 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:59.643200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fa3a1-6694-4f24-a3da-f56e7d1db1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:59.643380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fa3a1-6694-4f24-a3da-f56e7d1db1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:59.663989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ed7fa3a1-6694-4f24-a3da-f56e7d1db1d5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:02:59.665567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ed7fa3a1-6694-4f24-a3da-f56e7d1db1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:02:59.674640 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 03:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:02:59.710808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271c0f0-fa82-4033-b6a2-8bc1c8d565ee None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:02:59.725738 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271c0f0-fa82-4033-b6a2-8bc1c8d565ee None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:02:59.730594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a1c71-d277-4cc7-a04d-ae5948f7ed04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:02:59.731280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a1c71-d277-4cc7-a04d-ae5948f7ed04 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:02:59.731544 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a1c71-d277-4cc7-a04d-ae5948f7ed04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:02:59.731819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a1c71-d277-4cc7-a04d-ae5948f7ed04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:02:59.741612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a1c71-d277-4cc7-a04d-ae5948f7ed04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:02:59.743086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a1c71-d277-4cc7-a04d-ae5948f7ed04 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:02:59.752557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 760/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:03:03.340852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb334-87d6-44c5-8590-e550704fc5aa None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:03:03.341683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb334-87d6-44c5-8590-e550704fc5aa None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:03:03.341683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb334-87d6-44c5-8590-e550704fc5aa None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:03:03.344059 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 03:03:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:03:03.352649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dc24d-b1b3-44b3-9c87-13bd20584170 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:03:03.353087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dc24d-b1b3-44b3-9c87-13bd20584170 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:03:03.353234 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dc24d-b1b3-44b3-9c87-13bd20584170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:03:03.376279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-278dc24d-b1b3-44b3-9c87-13bd20584170 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:03:03.377501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-278dc24d-b1b3-44b3-9c87-13bd20584170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:03:03.386751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 03:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:03:03.688600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb334-87d6-44c5-8590-e550704fc5aa None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:03:03.691740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-648fb334-87d6-44c5-8590-e550704fc5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:03:03.750170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb334-87d6-44c5-8590-e550704fc5aa None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:03:03.753966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17c0e3-f50c-4db8-bf5e-fbceb6dfc778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:03:03.754607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17c0e3-f50c-4db8-bf5e-fbceb6dfc778 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:03:03.754964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17c0e3-f50c-4db8-bf5e-fbceb6dfc778 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:03:03.755269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17c0e3-f50c-4db8-bf5e-fbceb6dfc778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:03:03.764668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17c0e3-f50c-4db8-bf5e-fbceb6dfc778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:03:03.766124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17c0e3-f50c-4db8-bf5e-fbceb6dfc778 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:03:03.775744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 775/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:03:05.835244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94cae9-8c86-49dc-8c3e-69220c525c1b None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:03:05.835832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94cae9-8c86-49dc-8c3e-69220c525c1b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:03:05.835832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94cae9-8c86-49dc-8c3e-69220c525c1b None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:03:05.837185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jun 26 03:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:03:05.842531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36b93-190f-4750-81fb-263433fc6e87 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:03:05.842965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36b93-190f-4750-81fb-263433fc6e87 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:03:05.843098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36b93-190f-4750-81fb-263433fc6e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:03:05.863022 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-85b36b93-190f-4750-81fb-263433fc6e87 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:03:05.864245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-85b36b93-190f-4750-81fb-263433fc6e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:03:05.873002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jun 26 03:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:03:06.171263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94cae9-8c86-49dc-8c3e-69220c525c1b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:03:06.173367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7f94cae9-8c86-49dc-8c3e-69220c525c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:03:06.189077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94cae9-8c86-49dc-8c3e-69220c525c1b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:03:06.193080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76099887-2a95-4d01-96fe-bd738b9f2d0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:03:06.193720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099887-2a95-4d01-96fe-bd738b9f2d0b service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:03:06.193979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099887-2a95-4d01-96fe-bd738b9f2d0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:03:06.194257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099887-2a95-4d01-96fe-bd738b9f2d0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:03:06.203377 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76099887-2a95-4d01-96fe-bd738b9f2d0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:03:06.204803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76099887-2a95-4d01-96fe-bd738b9f2d0b service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:03:06.214193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 763/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:03:15.857955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=32 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:03:16.210476 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=70 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:43.461466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8105225-ebdd-4e15-a78d-45d9b03e9ef2 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:43.463379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8105225-ebdd-4e15-a78d-45d9b03e9ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:43.463379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8105225-ebdd-4e15-a78d-45d9b03e9ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:43.485577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-e8105225-ebdd-4e15-a78d-45d9b03e9ef2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:43.486760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e8105225-ebdd-4e15-a78d-45d9b03e9ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:43.503007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 777/1540] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:04:43.514000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ab35d-56cf-4ccb-9b2b-2b7c1b67bb68 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:43.514581 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ab35d-56cf-4ccb-9b2b-2b7c1b67bb68 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:43.514789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ab35d-56cf-4ccb-9b2b-2b7c1b67bb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:43.545128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b95ab35d-56cf-4ccb-9b2b-2b7c1b67bb68 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:43.546338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b95ab35d-56cf-4ccb-9b2b-2b7c1b67bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:43.562788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 764/1541] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:43.567817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8105225-ebdd-4e15-a78d-45d9b03e9ef2 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:43.585110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8105225-ebdd-4e15-a78d-45d9b03e9ef2 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:43.593692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fee2e-6264-41e1-bb23-337b8d09d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:43.594375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fee2e-6264-41e1-bb23-337b8d09d0be admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:43.594658 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fee2e-6264-41e1-bb23-337b8d09d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:43.594949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fee2e-6264-41e1-bb23-337b8d09d0be admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:43.595734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fee2e-6264-41e1-bb23-337b8d09d0be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:04:43.596604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fee2e-6264-41e1-bb23-337b8d09d0be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:43.598971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fee2e-6264-41e1-bb23-337b8d09d0be admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:43.616241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 778/1542] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:04:43.624516 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ab35d-56cf-4ccb-9b2b-2b7c1b67bb68 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:43.635328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ab35d-56cf-4ccb-9b2b-2b7c1b67bb68 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:43.645773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cb737-3032-4c70-8a6f-c6acbab8508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:43.646480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cb737-3032-4c70-8a6f-c6acbab8508e admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:43.646760 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cb737-3032-4c70-8a6f-c6acbab8508e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:43.647133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cb737-3032-4c70-8a6f-c6acbab8508e admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:43.647857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cb737-3032-4c70-8a6f-c6acbab8508e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:43.649856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cb737-3032-4c70-8a6f-c6acbab8508e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:43.708701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 765/1543] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:43 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:43.716376 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fee2e-6264-41e1-bb23-337b8d09d0be admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:43.735285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fee2e-6264-41e1-bb23-337b8d09d0be admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:43.813225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b223c-9192-4cf2-9677-592d0c8e8b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:43.813986 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b223c-9192-4cf2-9677-592d0c8e8b46 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:43.814422 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b223c-9192-4cf2-9677-592d0c8e8b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:43.814705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b223c-9192-4cf2-9677-592d0c8e8b46 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:43.815769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b223c-9192-4cf2-9677-592d0c8e8b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:43.818136 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b223c-9192-4cf2-9677-592d0c8e8b46 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:43.856030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 779/1544] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:43 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:43.860628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cb737-3032-4c70-8a6f-c6acbab8508e admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:43.876101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cb737-3032-4c70-8a6f-c6acbab8508e admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:43.885351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ffbff-63b3-48bb-8864-aa275954d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:43.886174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ffbff-63b3-48bb-8864-aa275954d60d admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:43.886578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ffbff-63b3-48bb-8864-aa275954d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:43.886868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ffbff-63b3-48bb-8864-aa275954d60d admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:43.887657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ffbff-63b3-48bb-8864-aa275954d60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:43.889467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ffbff-63b3-48bb-8864-aa275954d60d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:43.906645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 766/1545] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:43.911332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b223c-9192-4cf2-9677-592d0c8e8b46 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:43.927717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b223c-9192-4cf2-9677-592d0c8e8b46 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:43.939108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ede26-ed59-4907-a2cc-54fd9d2139ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:43.939789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ede26-ed59-4907-a2cc-54fd9d2139ee admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:43.940063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ede26-ed59-4907-a2cc-54fd9d2139ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:43.940336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ede26-ed59-4907-a2cc-54fd9d2139ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:43.941066 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ede26-ed59-4907-a2cc-54fd9d2139ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:43.942842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ede26-ed59-4907-a2cc-54fd9d2139ee admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:43.959719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 780/1546] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:43.963602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ffbff-63b3-48bb-8864-aa275954d60d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:43.976726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ffbff-63b3-48bb-8864-aa275954d60d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:43.988745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11a3ab-c606-4bc2-90dc-69f900bae613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:43.989668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11a3ab-c606-4bc2-90dc-69f900bae613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:43.989947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11a3ab-c606-4bc2-90dc-69f900bae613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:43.990226 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11a3ab-c606-4bc2-90dc-69f900bae613 admin admin] PATH_INFO: `/v3/projects/a18b13001739495b89d456fb0907e7e4/users/62ab5722db4e4fbd9f33d36c0c35188a/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.014978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11a3ab-c606-4bc2-90dc-69f900bae613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18b13001739495b89d456fb0907e7e4, user_id=62ab5722db4e4fbd9f33d36c0c35188a, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.017679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11a3ab-c606-4bc2-90dc-69f900bae613 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.020638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad0a16-9409-4850-a86c-efa12b5d9321 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.020925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad0a16-9409-4850-a86c-efa12b5d9321 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.021207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad0a16-9409-4850-a86c-efa12b5d9321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.046177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 767/1547] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:43 2022] PUT /identity/v3/projects/a18b13001739495b89d456fb0907e7e4/users/62ab5722db4e4fbd9f33d36c0c35188a/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:44.047620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04c9ed-8696-434d-8717-f28f1729248d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.047905 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04c9ed-8696-434d-8717-f28f1729248d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.048188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04c9ed-8696-434d-8717-f28f1729248d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.059436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-81ad0a16-9409-4850-a86c-efa12b5d9321 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.060939 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-81ad0a16-9409-4850-a86c-efa12b5d9321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.084074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1c04c9ed-8696-434d-8717-f28f1729248d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.085464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1c04c9ed-8696-434d-8717-f28f1729248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.174414 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 781/1548] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:04:44.175743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138fce2-fd03-4cb7-b429-9dbb238122ac None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.176028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138fce2-fd03-4cb7-b429-9dbb238122ac None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.176306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138fce2-fd03-4cb7-b429-9dbb238122ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.191975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 768/1549] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.193729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d864-39f9-42f7-aad9-7784ea70c50f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.193939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d864-39f9-42f7-aad9-7784ea70c50f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.194219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d864-39f9-42f7-aad9-7784ea70c50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.206061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f138fce2-fd03-4cb7-b429-9dbb238122ac None None] MFA Rules not processed for user `62ab5722db4e4fbd9f33d36c0c35188a`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.207370 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f138fce2-fd03-4cb7-b429-9dbb238122ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.213149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-98e1d864-39f9-42f7-aad9-7784ea70c50f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.214475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-98e1d864-39f9-42f7-aad9-7784ea70c50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.229893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 769/1550] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.229893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7909ab-55ad-4957-a176-80d2b0649a76 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.229893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7909ab-55ad-4957-a176-80d2b0649a76 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.229893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7909ab-55ad-4957-a176-80d2b0649a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.243216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-bf7909ab-55ad-4957-a176-80d2b0649a76 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.245766 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-bf7909ab-55ad-4957-a176-80d2b0649a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.252701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 770/1551] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.254003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d93fe5-44d0-4a29-9baa-4bd1c47894c7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.254287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d93fe5-44d0-4a29-9baa-4bd1c47894c7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.254562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d93fe5-44d0-4a29-9baa-4bd1c47894c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.265364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:44.272881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c2d93fe5-44d0-4a29-9baa-4bd1c47894c7 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.274066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c2d93fe5-44d0-4a29-9baa-4bd1c47894c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.281795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 771/1552] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.283002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b917b8-6d78-4ad0-94d8-266af329480a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.283312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b917b8-6d78-4ad0-94d8-266af329480a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.283557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 782/1553] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.283681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b917b8-6d78-4ad0-94d8-266af329480a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.284811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e27a3-eddd-4322-855d-bcf20d1870e6 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.285124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e27a3-eddd-4322-855d-bcf20d1870e6 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.285363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e27a3-eddd-4322-855d-bcf20d1870e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.302846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-27b917b8-6d78-4ad0-94d8-266af329480a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.304157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-27b917b8-6d78-4ad0-94d8-266af329480a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.307159 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-e25e27a3-eddd-4322-855d-bcf20d1870e6 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.308377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e25e27a3-eddd-4322-855d-bcf20d1870e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.312429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 772/1554] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.316246 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 783/1555] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.317742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b9ade-7277-426e-a89a-88490e299c75 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.318026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b9ade-7277-426e-a89a-88490e299c75 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.318298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b9ade-7277-426e-a89a-88490e299c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.320728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802863fe-60f7-48ec-b7af-14ae56ad3e43 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.321332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802863fe-60f7-48ec-b7af-14ae56ad3e43 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.322035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802863fe-60f7-48ec-b7af-14ae56ad3e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.338207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-0f4b9ade-7277-426e-a89a-88490e299c75 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.339503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-0f4b9ade-7277-426e-a89a-88490e299c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.342043 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-802863fe-60f7-48ec-b7af-14ae56ad3e43 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.343304 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-802863fe-60f7-48ec-b7af-14ae56ad3e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.347378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 784/1556] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.348364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66495d-ce07-4e40-aa1d-991a6c1e35e4 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.348659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66495d-ce07-4e40-aa1d-991a6c1e35e4 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.348922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66495d-ce07-4e40-aa1d-991a6c1e35e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.353164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 773/1557] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.354472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a24c73-bfa0-462b-89d7-176dcec4f7db None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.354758 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a24c73-bfa0-462b-89d7-176dcec4f7db None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.355063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a24c73-bfa0-462b-89d7-176dcec4f7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.369094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-1d66495d-ce07-4e40-aa1d-991a6c1e35e4 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.370396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1d66495d-ce07-4e40-aa1d-991a6c1e35e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.372544 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e5a24c73-bfa0-462b-89d7-176dcec4f7db None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.373697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e5a24c73-bfa0-462b-89d7-176dcec4f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.378102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 785/1558] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.379330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ed292-669d-42de-a79a-6bf53c09e668 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.379610 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ed292-669d-42de-a79a-6bf53c09e668 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.379886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ed292-669d-42de-a79a-6bf53c09e668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.386533 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 774/1559] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.388063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a24c73-bfa0-462b-89d7-176dcec4f7db None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.397676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a24c73-bfa0-462b-89d7-176dcec4f7db None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.399588 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6a2ed292-669d-42de-a79a-6bf53c09e668 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.400763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6a2ed292-669d-42de-a79a-6bf53c09e668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.402303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df696b9-cfc8-48f8-9da4-799e3ebd72ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.402944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df696b9-cfc8-48f8-9da4-799e3ebd72ec admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.403293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df696b9-cfc8-48f8-9da4-799e3ebd72ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.403562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df696b9-cfc8-48f8-9da4-799e3ebd72ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.404281 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df696b9-cfc8-48f8-9da4-799e3ebd72ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:04:44.404548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df696b9-cfc8-48f8-9da4-799e3ebd72ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.405586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: WARNING py.warnings [None req-7df696b9-cfc8-48f8-9da4-799e3ebd72ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:04:44.405586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: warnings.warn(msg) Jun 26 03:04:44.405586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: Jun 26 03:04:44.406527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df696b9-cfc8-48f8-9da4-799e3ebd72ec admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.408856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 786/1560] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.410075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f358f-40ca-4a46-b276-627fc7061244 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.410315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f358f-40ca-4a46-b276-627fc7061244 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.410596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f358f-40ca-4a46-b276-627fc7061244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.426690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 775/1561] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:04:44.426690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88f5d4-b9e1-4c14-8e4c-20a36356f45b None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.426690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88f5d4-b9e1-4c14-8e4c-20a36356f45b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.426690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88f5d4-b9e1-4c14-8e4c-20a36356f45b None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.426690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 776/1562] 10.222.0.36 () {54 vars in 961 bytes} [Sun Jun 26 03:04:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:04:44.426690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88f5d4-b9e1-4c14-8e4c-20a36356f45b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.433299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-e63f358f-40ca-4a46-b276-627fc7061244 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.434454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e63f358f-40ca-4a46-b276-627fc7061244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.438648 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88f5d4-b9e1-4c14-8e4c-20a36356f45b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.442439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 787/1563] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.443063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f358f-40ca-4a46-b276-627fc7061244 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.443236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05310df-7e0f-40f0-8215-3ae4a6e723c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.443984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05310df-7e0f-40f0-8215-3ae4a6e723c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.444269 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05310df-7e0f-40f0-8215-3ae4a6e723c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.444547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05310df-7e0f-40f0-8215-3ae4a6e723c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.445264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05310df-7e0f-40f0-8215-3ae4a6e723c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:04:44.445570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05310df-7e0f-40f0-8215-3ae4a6e723c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.447917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05310df-7e0f-40f0-8215-3ae4a6e723c9 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.452210 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f358f-40ca-4a46-b276-627fc7061244 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.457014 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb0a2b-bf98-4228-ab4e-537799ade8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.457334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb0a2b-bf98-4228-ab4e-537799ade8ba admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.457612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb0a2b-bf98-4228-ab4e-537799ade8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.457886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb0a2b-bf98-4228-ab4e-537799ade8ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.458591 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb0a2b-bf98-4228-ab4e-537799ade8ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:04:44.458896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb0a2b-bf98-4228-ab4e-537799ade8ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.459908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 777/1564] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:04:44.460514 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb0a2b-bf98-4228-ab4e-537799ade8ba admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.461126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f4273-9f70-4a4e-8ae5-85d78ed573ca None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.461413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f4273-9f70-4a4e-8ae5-85d78ed573ca None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.461692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f4273-9f70-4a4e-8ae5-85d78ed573ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.472074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 788/1565] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:04:44.472873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb0a2b-bf98-4228-ab4e-537799ade8ba admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.481666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-350f4273-9f70-4a4e-8ae5-85d78ed573ca None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.482892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-350f4273-9f70-4a4e-8ae5-85d78ed573ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.484275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb0a2b-bf98-4228-ab4e-537799ade8ba admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.488830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c29ab-26c4-4465-addb-80b042b2cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.489480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c29ab-26c4-4465-addb-80b042b2cc0a admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.489755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c29ab-26c4-4465-addb-80b042b2cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.490027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c29ab-26c4-4465-addb-80b042b2cc0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.490738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c29ab-26c4-4465-addb-80b042b2cc0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:04:44.491068 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c29ab-26c4-4465-addb-80b042b2cc0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.491297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 778/1566] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.492084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f4273-9f70-4a4e-8ae5-85d78ed573ca None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.492669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c29ab-26c4-4465-addb-80b042b2cc0a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.502158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f4273-9f70-4a4e-8ae5-85d78ed573ca None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.507280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e0b82-4eb8-4b5e-846e-055d01df112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.508086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e0b82-4eb8-4b5e-846e-055d01df112b admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.508374 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e0b82-4eb8-4b5e-846e-055d01df112b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.508832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e0b82-4eb8-4b5e-846e-055d01df112b admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.508949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 789/1567] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:04:44.509503 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e0b82-4eb8-4b5e-846e-055d01df112b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:04:44.509816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e0b82-4eb8-4b5e-846e-055d01df112b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.510080 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c3e63-e7f4-4d07-bb82-6ebc0157188c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.510372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c3e63-e7f4-4d07-bb82-6ebc0157188c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.510725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c3e63-e7f4-4d07-bb82-6ebc0157188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.511565 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e0b82-4eb8-4b5e-846e-055d01df112b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.526343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 779/1568] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:04:44.527507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-e70c3e63-e7f4-4d07-bb82-6ebc0157188c None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:44.527806 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e0b82-4eb8-4b5e-846e-055d01df112b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.528804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e70c3e63-e7f4-4d07-bb82-6ebc0157188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:44.540861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e0b82-4eb8-4b5e-846e-055d01df112b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.546053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264336d-850f-4ccc-8649-6ba4929863a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.546723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264336d-850f-4ccc-8649-6ba4929863a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.547022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264336d-850f-4ccc-8649-6ba4929863a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.547296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264336d-850f-4ccc-8649-6ba4929863a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.548013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264336d-850f-4ccc-8649-6ba4929863a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.549951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264336d-850f-4ccc-8649-6ba4929863a7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.558004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:44.576704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 780/1569] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:44.577834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264336d-850f-4ccc-8649-6ba4929863a7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.597522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 790/1570] 10.222.0.36 () {58 vars in 1058 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:44.599868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c3e63-e7f4-4d07-bb82-6ebc0157188c None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.609806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c3e63-e7f4-4d07-bb82-6ebc0157188c None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.642367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264336d-850f-4ccc-8649-6ba4929863a7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.647436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea565778-7ae5-4cdb-875b-1ca17074916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.648107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea565778-7ae5-4cdb-875b-1ca17074916d admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.648395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea565778-7ae5-4cdb-875b-1ca17074916d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.648978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea565778-7ae5-4cdb-875b-1ca17074916d admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.649395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea565778-7ae5-4cdb-875b-1ca17074916d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:04:44.649709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea565778-7ae5-4cdb-875b-1ca17074916d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.651388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea565778-7ae5-4cdb-875b-1ca17074916d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.671287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 781/1571] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:04:44.671287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea565778-7ae5-4cdb-875b-1ca17074916d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.671589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7756-73c4-4e97-941f-609d09c51b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.671589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7756-73c4-4e97-941f-609d09c51b7e admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.671589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7756-73c4-4e97-941f-609d09c51b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.671589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7756-73c4-4e97-941f-609d09c51b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.671905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba7756-73c4-4e97-941f-609d09c51b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.671905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: WARNING py.warnings [None req-ccba7756-73c4-4e97-941f-609d09c51b7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:04:44.671905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: warnings.warn(msg) Jun 26 03:04:44.671905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: Jun 26 03:04:44.671905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba7756-73c4-4e97-941f-609d09c51b7e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.675004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea565778-7ae5-4cdb-875b-1ca17074916d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.680129 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27390c-78a2-4289-99cc-0d2cc79b96b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.680773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27390c-78a2-4289-99cc-0d2cc79b96b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.681335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27390c-78a2-4289-99cc-0d2cc79b96b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.681335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27390c-78a2-4289-99cc-0d2cc79b96b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.681985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27390c-78a2-4289-99cc-0d2cc79b96b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.683917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27390c-78a2-4289-99cc-0d2cc79b96b6 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.697412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 791/1572] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:44.698298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7756-73c4-4e97-941f-609d09c51b7e admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.709242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:44.711467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 782/1573] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:44.712229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27390c-78a2-4289-99cc-0d2cc79b96b6 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.766958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7756-73c4-4e97-941f-609d09c51b7e admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.772247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27390c-78a2-4289-99cc-0d2cc79b96b6 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.772707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9c3d5-bcde-4292-aca2-7e6f0ec8fc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.773418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9c3d5-bcde-4292-aca2-7e6f0ec8fc68 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.773700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9c3d5-bcde-4292-aca2-7e6f0ec8fc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.773972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9c3d5-bcde-4292-aca2-7e6f0ec8fc68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.774953 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9c3d5-bcde-4292-aca2-7e6f0ec8fc68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:04:44.775296 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9c3d5-bcde-4292-aca2-7e6f0ec8fc68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.776942 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9c3d5-bcde-4292-aca2-7e6f0ec8fc68 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.777057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283f013-bfab-4665-9bfb-0d8f5f61e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.777694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283f013-bfab-4665-9bfb-0d8f5f61e030 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.777975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283f013-bfab-4665-9bfb-0d8f5f61e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.778252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283f013-bfab-4665-9bfb-0d8f5f61e030 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.778941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283f013-bfab-4665-9bfb-0d8f5f61e030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.780859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283f013-bfab-4665-9bfb-0d8f5f61e030 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.788864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 792/1574] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:04:44.790089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9c3d5-bcde-4292-aca2-7e6f0ec8fc68 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.800116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9c3d5-bcde-4292-aca2-7e6f0ec8fc68 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.805315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb65c3-c2e6-4560-80b4-7c7a6a378cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.805957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb65c3-c2e6-4560-80b4-7c7a6a378cea admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.806264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb65c3-c2e6-4560-80b4-7c7a6a378cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.806595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb65c3-c2e6-4560-80b4-7c7a6a378cea admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.807399 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb65c3-c2e6-4560-80b4-7c7a6a378cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.809525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb65c3-c2e6-4560-80b4-7c7a6a378cea admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.817366 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 783/1575] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:44.817366 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283f013-bfab-4665-9bfb-0d8f5f61e030 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.835396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 793/1576] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:44.836582 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb65c3-c2e6-4560-80b4-7c7a6a378cea admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.870763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:44.888571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283f013-bfab-4665-9bfb-0d8f5f61e030 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.909404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb65c3-c2e6-4560-80b4-7c7a6a378cea admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.916007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e36d-42d1-45d2-91ab-a294828adfb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.916670 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e36d-42d1-45d2-91ab-a294828adfb6 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.916951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e36d-42d1-45d2-91ab-a294828adfb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.917259 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e36d-42d1-45d2-91ab-a294828adfb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.944201 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a99fc-ff88-465d-84dc-c9c6ba3b5a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.944885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a99fc-ff88-465d-84dc-c9c6ba3b5a53 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.945169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a99fc-ff88-465d-84dc-c9c6ba3b5a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.945451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a99fc-ff88-465d-84dc-c9c6ba3b5a53 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.946146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a99fc-ff88-465d-84dc-c9c6ba3b5a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.947247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: WARNING py.warnings [None req-5a1a99fc-ff88-465d-84dc-c9c6ba3b5a53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:04:44.947247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: warnings.warn(msg) Jun 26 03:04:44.947247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: Jun 26 03:04:44.948443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a99fc-ff88-465d-84dc-c9c6ba3b5a53 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.968826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 784/1577] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:44.969626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a99fc-ff88-465d-84dc-c9c6ba3b5a53 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.976001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3e36d-42d1-45d2-91ab-a294828adfb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.977641 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3e36d-42d1-45d2-91ab-a294828adfb6 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.979469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a99fc-ff88-465d-84dc-c9c6ba3b5a53 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:44.984500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb28f0a-9766-400b-82f9-334be7af5f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:44.985147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb28f0a-9766-400b-82f9-334be7af5f83 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:44.985433 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb28f0a-9766-400b-82f9-334be7af5f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:44.985713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb28f0a-9766-400b-82f9-334be7af5f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:44.986391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb28f0a-9766-400b-82f9-334be7af5f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:44.987372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 794/1578] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:44.987954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e36d-42d1-45d2-91ab-a294828adfb6 service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:44.988414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb28f0a-9766-400b-82f9-334be7af5f83 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:44.997891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e36d-42d1-45d2-91ab-a294828adfb6 service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.003298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3179d-f8d8-4aeb-8e99-79421668f0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.003953 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3179d-f8d8-4aeb-8e99-79421668f0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.004231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3179d-f8d8-4aeb-8e99-79421668f0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.004563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3179d-f8d8-4aeb-8e99-79421668f0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.005174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3179d-f8d8-4aeb-8e99-79421668f0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.007509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3179d-f8d8-4aeb-8e99-79421668f0c8 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.017680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 785/1579] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:45.018922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb28f0a-9766-400b-82f9-334be7af5f83 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.027440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:45.033946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 795/1580] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:44 2022] POST /identity/v3/users => generated 283 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:45.035337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3179d-f8d8-4aeb-8e99-79421668f0c8 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.045751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3179d-f8d8-4aeb-8e99-79421668f0c8 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.086869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb28f0a-9766-400b-82f9-334be7af5f83 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.091600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d4d55-8a81-4b8f-aa60-10383d1718a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.092289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d4d55-8a81-4b8f-aa60-10383d1718a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.092560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d4d55-8a81-4b8f-aa60-10383d1718a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.092841 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d4d55-8a81-4b8f-aa60-10383d1718a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.093538 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d4d55-8a81-4b8f-aa60-10383d1718a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.095542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d4d55-8a81-4b8f-aa60-10383d1718a7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.106214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a43a80-9d71-4726-a603-d90ba5b17c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.106925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a43a80-9d71-4726-a603-d90ba5b17c01 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.107269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a43a80-9d71-4726-a603-d90ba5b17c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.107522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a43a80-9d71-4726-a603-d90ba5b17c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.108257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a43a80-9d71-4726-a603-d90ba5b17c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.110199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a43a80-9d71-4726-a603-d90ba5b17c01 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.120388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 786/1581] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:45 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:45.120388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d4d55-8a81-4b8f-aa60-10383d1718a7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.128067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d4d55-8a81-4b8f-aa60-10383d1718a7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.133322 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bd763-22ae-43a5-8a84-8595931049e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.134106 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bd763-22ae-43a5-8a84-8595931049e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.134351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bd763-22ae-43a5-8a84-8595931049e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.134629 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bd763-22ae-43a5-8a84-8595931049e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.135354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bd763-22ae-43a5-8a84-8595931049e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.137598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bd763-22ae-43a5-8a84-8595931049e5 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.143640 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 796/1582] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:45 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:45.148278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a43a80-9d71-4726-a603-d90ba5b17c01 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.167482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 787/1583] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:45 2022] POST /identity/v3/users => generated 302 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:45.167482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bd763-22ae-43a5-8a84-8595931049e5 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.175412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bd763-22ae-43a5-8a84-8595931049e5 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.207550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:45.222328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a43a80-9d71-4726-a603-d90ba5b17c01 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.226750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53474813-6b33-4341-ac9d-5f47bb4ed6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.227468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474813-6b33-4341-ac9d-5f47bb4ed6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.227747 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474813-6b33-4341-ac9d-5f47bb4ed6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.228050 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474813-6b33-4341-ac9d-5f47bb4ed6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.228829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53474813-6b33-4341-ac9d-5f47bb4ed6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.232752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53474813-6b33-4341-ac9d-5f47bb4ed6b7 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.250950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f6dbf-a900-4391-b998-6292b24792d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.251855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6dbf-a900-4391-b998-6292b24792d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.255000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6dbf-a900-4391-b998-6292b24792d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.255374 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6dbf-a900-4391-b998-6292b24792d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.257245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 797/1584] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:45 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:45.258101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53474813-6b33-4341-ac9d-5f47bb4ed6b7 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.258514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f6dbf-a900-4391-b998-6292b24792d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.262592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f6dbf-a900-4391-b998-6292b24792d6 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.268545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53474813-6b33-4341-ac9d-5f47bb4ed6b7 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.273132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe739ec-2207-4c79-ba25-13d16f2e1175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.273421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 788/1585] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.274240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe739ec-2207-4c79-ba25-13d16f2e1175 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.274525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe739ec-2207-4c79-ba25-13d16f2e1175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.274912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe739ec-2207-4c79-ba25-13d16f2e1175 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.275632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe739ec-2207-4c79-ba25-13d16f2e1175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.277363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f6dbf-a900-4391-b998-6292b24792d6 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.277718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe739ec-2207-4c79-ba25-13d16f2e1175 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.287760 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f6dbf-a900-4391-b998-6292b24792d6 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.293722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03e86-21b7-4528-a363-8c2a240db9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.294434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03e86-21b7-4528-a363-8c2a240db9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.294901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03e86-21b7-4528-a363-8c2a240db9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.295073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03e86-21b7-4528-a363-8c2a240db9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.295783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff03e86-21b7-4528-a363-8c2a240db9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.297643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff03e86-21b7-4528-a363-8c2a240db9e5 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.299891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 798/1586] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:45 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:45.300683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe739ec-2207-4c79-ba25-13d16f2e1175 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.310744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe739ec-2207-4c79-ba25-13d16f2e1175 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.313033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 789/1587] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.315583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dd7d4-9983-4f65-9eaf-caf4d71446f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.316238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dd7d4-9983-4f65-9eaf-caf4d71446f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.316516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dd7d4-9983-4f65-9eaf-caf4d71446f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.316789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dd7d4-9983-4f65-9eaf-caf4d71446f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.317359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03e86-21b7-4528-a363-8c2a240db9e5 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.317510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dd7d4-9983-4f65-9eaf-caf4d71446f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.319157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dd7d4-9983-4f65-9eaf-caf4d71446f7 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.327726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03e86-21b7-4528-a363-8c2a240db9e5 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.332664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990007f-b7d9-4a89-8353-933fca83dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.332967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 799/1588] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.333465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990007f-b7d9-4a89-8353-933fca83dc51 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.333753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990007f-b7d9-4a89-8353-933fca83dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.333858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dd7d4-9983-4f65-9eaf-caf4d71446f7 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.334032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990007f-b7d9-4a89-8353-933fca83dc51 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.334722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990007f-b7d9-4a89-8353-933fca83dc51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.336811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990007f-b7d9-4a89-8353-933fca83dc51 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.343468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dd7d4-9983-4f65-9eaf-caf4d71446f7 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.349343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca6f5f-94f2-4257-90de-5e75e3e2a0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.350057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca6f5f-94f2-4257-90de-5e75e3e2a0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.350325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca6f5f-94f2-4257-90de-5e75e3e2a0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.350599 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca6f5f-94f2-4257-90de-5e75e3e2a0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.351369 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca6f5f-94f2-4257-90de-5e75e3e2a0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.353199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca6f5f-94f2-4257-90de-5e75e3e2a0e9 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.359611 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 790/1589] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:45 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:45.360527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990007f-b7d9-4a89-8353-933fca83dc51 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.367151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 800/1590] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.367985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca6f5f-94f2-4257-90de-5e75e3e2a0e9 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.373443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990007f-b7d9-4a89-8353-933fca83dc51 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.377681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca6f5f-94f2-4257-90de-5e75e3e2a0e9 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.378532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c537836-5f31-47f9-ad69-e6e319535e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.379246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c537836-5f31-47f9-ad69-e6e319535e67 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.379538 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c537836-5f31-47f9-ad69-e6e319535e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.379868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c537836-5f31-47f9-ad69-e6e319535e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.380601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c537836-5f31-47f9-ad69-e6e319535e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.382210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c537836-5f31-47f9-ad69-e6e319535e67 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.382315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e144-1a83-43d4-bff2-bfab52b2bd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.382947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e144-1a83-43d4-bff2-bfab52b2bd96 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.383257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e144-1a83-43d4-bff2-bfab52b2bd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.383534 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1e144-1a83-43d4-bff2-bfab52b2bd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.384238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1e144-1a83-43d4-bff2-bfab52b2bd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.385898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1e144-1a83-43d4-bff2-bfab52b2bd96 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.393429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 791/1591] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.394117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c537836-5f31-47f9-ad69-e6e319535e67 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.402214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 801/1592] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.402214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e144-1a83-43d4-bff2-bfab52b2bd96 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.406465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c537836-5f31-47f9-ad69-e6e319535e67 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.410498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1e144-1a83-43d4-bff2-bfab52b2bd96 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.412314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e293b2d-de32-4d78-9e1e-4fd395952cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.413226 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e293b2d-de32-4d78-9e1e-4fd395952cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.413578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e293b2d-de32-4d78-9e1e-4fd395952cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.413925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e293b2d-de32-4d78-9e1e-4fd395952cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.415127 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e293b2d-de32-4d78-9e1e-4fd395952cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.416498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35211a-dd57-47e9-b4ea-cb0665f558d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.417287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e293b2d-de32-4d78-9e1e-4fd395952cd4 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.417409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35211a-dd57-47e9-b4ea-cb0665f558d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.417728 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35211a-dd57-47e9-b4ea-cb0665f558d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.418112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35211a-dd57-47e9-b4ea-cb0665f558d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.419022 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35211a-dd57-47e9-b4ea-cb0665f558d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.420814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35211a-dd57-47e9-b4ea-cb0665f558d6 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.429523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 792/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.430259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e293b2d-de32-4d78-9e1e-4fd395952cd4 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.434531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 802/1594] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.434531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35211a-dd57-47e9-b4ea-cb0665f558d6 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.441010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e293b2d-de32-4d78-9e1e-4fd395952cd4 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.444175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35211a-dd57-47e9-b4ea-cb0665f558d6 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.445737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a907f-a009-46a3-b6c2-89e0839e639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.446440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a907f-a009-46a3-b6c2-89e0839e639c admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.446673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a907f-a009-46a3-b6c2-89e0839e639c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.447038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a907f-a009-46a3-b6c2-89e0839e639c admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.447710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a907f-a009-46a3-b6c2-89e0839e639c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.449371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a907f-a009-46a3-b6c2-89e0839e639c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.449788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889a8b5-ca89-4ebe-a037-4ea442222be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.450596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889a8b5-ca89-4ebe-a037-4ea442222be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.450847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889a8b5-ca89-4ebe-a037-4ea442222be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.451210 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889a8b5-ca89-4ebe-a037-4ea442222be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.451990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889a8b5-ca89-4ebe-a037-4ea442222be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.453616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889a8b5-ca89-4ebe-a037-4ea442222be3 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.459960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:45.463152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 793/1595] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.464656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a907f-a009-46a3-b6c2-89e0839e639c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.472450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 803/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.472450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889a8b5-ca89-4ebe-a037-4ea442222be3 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.482217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889a8b5-ca89-4ebe-a037-4ea442222be3 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.491959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fbd57-92e5-4bb2-8963-8521a81e9b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.492653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fbd57-92e5-4bb2-8963-8521a81e9b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.492941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fbd57-92e5-4bb2-8963-8521a81e9b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.493220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fbd57-92e5-4bb2-8963-8521a81e9b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.493963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fbd57-92e5-4bb2-8963-8521a81e9b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.495695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fbd57-92e5-4bb2-8963-8521a81e9b6d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.501614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a907f-a009-46a3-b6c2-89e0839e639c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.506737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b5c9c-3a4b-47c2-9c06-5f3870943633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.507641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b5c9c-3a4b-47c2-9c06-5f3870943633 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.507756 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 804/1597] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.508172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b5c9c-3a4b-47c2-9c06-5f3870943633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.508692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fbd57-92e5-4bb2-8963-8521a81e9b6d admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.508972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b5c9c-3a4b-47c2-9c06-5f3870943633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.509982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b5c9c-3a4b-47c2-9c06-5f3870943633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.511980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b5c9c-3a4b-47c2-9c06-5f3870943633 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.521736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fbd57-92e5-4bb2-8963-8521a81e9b6d admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.523606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 794/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.524567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b5c9c-3a4b-47c2-9c06-5f3870943633 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.527510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13103cc6-dc87-46b7-bc2b-fe3a5abc0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.528561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103cc6-dc87-46b7-bc2b-fe3a5abc0ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.528982 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103cc6-dc87-46b7-bc2b-fe3a5abc0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.529368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103cc6-dc87-46b7-bc2b-fe3a5abc0ee3 admin admin] PATH_INFO: `/v3/projects/01e7203b8d4541f892946bfed752c8f8/users/c65b499c56ed4e4a8e46222def726bb7/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.534797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b5c9c-3a4b-47c2-9c06-5f3870943633 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.540429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa3217-cde6-47b3-a047-45c2ab1bc967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.541104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3217-cde6-47b3-a047-45c2ab1bc967 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.541429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3217-cde6-47b3-a047-45c2ab1bc967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.541767 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3217-cde6-47b3-a047-45c2ab1bc967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.542490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa3217-cde6-47b3-a047-45c2ab1bc967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.544131 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa3217-cde6-47b3-a047-45c2ab1bc967 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.550424 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13103cc6-dc87-46b7-bc2b-fe3a5abc0ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e7203b8d4541f892946bfed752c8f8, user_id=c65b499c56ed4e4a8e46222def726bb7, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.551854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: WARNING py.warnings [None req-13103cc6-dc87-46b7-bc2b-fe3a5abc0ee3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:04:45.551854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: warnings.warn(msg) Jun 26 03:04:45.551854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: Jun 26 03:04:45.554446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13103cc6-dc87-46b7-bc2b-fe3a5abc0ee3 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.555646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 795/1599] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.556460 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa3217-cde6-47b3-a047-45c2ab1bc967 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.567163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa3217-cde6-47b3-a047-45c2ab1bc967 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.569334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 805/1600] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:45 2022] PUT /identity/v3/projects/01e7203b8d4541f892946bfed752c8f8/users/c65b499c56ed4e4a8e46222def726bb7/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:45.570019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13103cc6-dc87-46b7-bc2b-fe3a5abc0ee3 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.622253 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9014701-435d-42d7-86dc-7e27347aeb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.623579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9014701-435d-42d7-86dc-7e27347aeb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.623883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9014701-435d-42d7-86dc-7e27347aeb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.624144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9014701-435d-42d7-86dc-7e27347aeb03 admin admin] PATH_INFO: `/v3/projects/94b6a37bb6d0430fae8c367370803894/users/28e1b6aae87e4c398ce214e6311ba075/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.634895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13103cc6-dc87-46b7-bc2b-fe3a5abc0ee3 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.637940 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9014701-435d-42d7-86dc-7e27347aeb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b6a37bb6d0430fae8c367370803894, user_id=28e1b6aae87e4c398ce214e6311ba075, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.639637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182eb68a-f709-4b45-a0d5-198fce5f8be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.640537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eb68a-f709-4b45-a0d5-198fce5f8be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.640673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9014701-435d-42d7-86dc-7e27347aeb03 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.640833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eb68a-f709-4b45-a0d5-198fce5f8be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.641086 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eb68a-f709-4b45-a0d5-198fce5f8be9 admin admin] PATH_INFO: `/v3/projects/237e1337256d4be6a5994a1cad1678ab/users/f13949f5f15b4424982f48d4240068ad/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.654632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 796/1601] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:45 2022] PUT /identity/v3/projects/94b6a37bb6d0430fae8c367370803894/users/28e1b6aae87e4c398ce214e6311ba075/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:45.655364 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9014701-435d-42d7-86dc-7e27347aeb03 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.655828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182eb68a-f709-4b45-a0d5-198fce5f8be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237e1337256d4be6a5994a1cad1678ab, user_id=f13949f5f15b4424982f48d4240068ad, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.658623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182eb68a-f709-4b45-a0d5-198fce5f8be9 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.673669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 806/1602] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:45 2022] PUT /identity/v3/projects/237e1337256d4be6a5994a1cad1678ab/users/f13949f5f15b4424982f48d4240068ad/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:45.674518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182eb68a-f709-4b45-a0d5-198fce5f8be9 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.692741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:45.726893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9014701-435d-42d7-86dc-7e27347aeb03 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.750012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182eb68a-f709-4b45-a0d5-198fce5f8be9 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.755156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe40dfd-f032-42f6-bbaf-1e6ef2a8917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.756056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe40dfd-f032-42f6-bbaf-1e6ef2a8917a admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.756322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe40dfd-f032-42f6-bbaf-1e6ef2a8917a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.756586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe40dfd-f032-42f6-bbaf-1e6ef2a8917a admin admin] PATH_INFO: `/v3/projects/474e42e34ddb40eb8666eab99bd95a4b/users/9d47131516614ef9adae65e8db11e650/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.770691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe40dfd-f032-42f6-bbaf-1e6ef2a8917a admin admin] RBAC: Authorizing `identity:create_grant(project_id=474e42e34ddb40eb8666eab99bd95a4b, user_id=9d47131516614ef9adae65e8db11e650, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.773512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe40dfd-f032-42f6-bbaf-1e6ef2a8917a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.783639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e54db-4059-4dd6-9563-af8c7949afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.784323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e54db-4059-4dd6-9563-af8c7949afbf admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.784609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e54db-4059-4dd6-9563-af8c7949afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.784887 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e54db-4059-4dd6-9563-af8c7949afbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.785643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e54db-4059-4dd6-9563-af8c7949afbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.787328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e54db-4059-4dd6-9563-af8c7949afbf admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.787963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 807/1603] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:45 2022] PUT /identity/v3/projects/474e42e34ddb40eb8666eab99bd95a4b/users/9d47131516614ef9adae65e8db11e650/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:45.788747 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe40dfd-f032-42f6-bbaf-1e6ef2a8917a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.798103 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 797/1604] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:45.799827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c624f-ad7c-4cb6-a8e2-3778cf8ac7f6 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.800118 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c624f-ad7c-4cb6-a8e2-3778cf8ac7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.800436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c624f-ad7c-4cb6-a8e2-3778cf8ac7f6 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.802104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 798/1605] 10.222.0.36 () {54 vars in 961 bytes} [Sun Jun 26 03:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:04:45.802841 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c624f-ad7c-4cb6-a8e2-3778cf8ac7f6 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:45.822285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:45.852060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe40dfd-f032-42f6-bbaf-1e6ef2a8917a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.857322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7863d-e7b2-4cce-a3a4-022aa904d29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.858222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7863d-e7b2-4cce-a3a4-022aa904d29a admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.858501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7863d-e7b2-4cce-a3a4-022aa904d29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.858776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7863d-e7b2-4cce-a3a4-022aa904d29a admin admin] PATH_INFO: `/v3/projects/2c7f10bb194d491db929f41715e900b0/users/3f0996a2b88842a7953d1eef9713ef9f/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.867828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c624f-ad7c-4cb6-a8e2-3778cf8ac7f6 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:45.872468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f55ff2-67a9-4145-936b-268279350c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:45.872753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7863d-e7b2-4cce-a3a4-022aa904d29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7f10bb194d491db929f41715e900b0, user_id=3f0996a2b88842a7953d1eef9713ef9f, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.873356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55ff2-67a9-4145-936b-268279350c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.873632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55ff2-67a9-4145-936b-268279350c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.873903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55ff2-67a9-4145-936b-268279350c1f admin admin] PATH_INFO: `/v3/projects/b83cf0bff2f74b9ca8596218774e323c/users/62f614b02ced4c4fae0fc0853ed66431/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.875466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7863d-e7b2-4cce-a3a4-022aa904d29a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.888893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 808/1606] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:45 2022] PUT /identity/v3/projects/2c7f10bb194d491db929f41715e900b0/users/3f0996a2b88842a7953d1eef9713ef9f/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:45.889634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f55ff2-67a9-4145-936b-268279350c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83cf0bff2f74b9ca8596218774e323c, user_id=62f614b02ced4c4fae0fc0853ed66431, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:45.890409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f0bf-233d-4776-a5f1-c6955beea611 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.890784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f0bf-233d-4776-a5f1-c6955beea611 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.891184 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f0bf-233d-4776-a5f1-c6955beea611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.892481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f55ff2-67a9-4145-936b-268279350c1f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:45.909437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 799/1607] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:45 2022] PUT /identity/v3/projects/b83cf0bff2f74b9ca8596218774e323c/users/62f614b02ced4c4fae0fc0853ed66431/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:45.910548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d765c-e7e3-4d40-9a5d-eb165a3b230c None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.911506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d765c-e7e3-4d40-9a5d-eb165a3b230c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.911785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d765c-e7e3-4d40-9a5d-eb165a3b230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:45.923125 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5a11f0bf-233d-4776-a5f1-c6955beea611 None None] MFA Rules not processed for user `c65b499c56ed4e4a8e46222def726bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:45.924378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5a11f0bf-233d-4776-a5f1-c6955beea611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:45.938908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-202d765c-e7e3-4d40-9a5d-eb165a3b230c None None] MFA Rules not processed for user `28e1b6aae87e4c398ce214e6311ba075`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:45.940155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-202d765c-e7e3-4d40-9a5d-eb165a3b230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:45.983586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:45.988992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 809/1608] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:45.990372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2ab2-9245-47ef-9928-16e887e2306e None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:45.990655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2ab2-9245-47ef-9928-16e887e2306e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:45.990930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2ab2-9245-47ef-9928-16e887e2306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.008650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 800/1609] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:46.012744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517b93-4402-4570-b040-265507178b47 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.012744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517b93-4402-4570-b040-265507178b47 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.012990 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517b93-4402-4570-b040-265507178b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.018027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-382c2ab2-9245-47ef-9928-16e887e2306e None None] MFA Rules not processed for user `f13949f5f15b4424982f48d4240068ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:46.019421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-382c2ab2-9245-47ef-9928-16e887e2306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:46.030978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5b517b93-4402-4570-b040-265507178b47 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:46.032132 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5b517b93-4402-4570-b040-265507178b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:46.082310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 810/1610] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:46.083168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c2ab2-9245-47ef-9928-16e887e2306e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.095304 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 801/1611] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:46.096968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718793-f9b6-45ef-a9e8-f454409d2c4e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.097457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718793-f9b6-45ef-a9e8-f454409d2c4e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.097743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718793-f9b6-45ef-a9e8-f454409d2c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.117069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3f718793-f9b6-45ef-a9e8-f454409d2c4e None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:46.118282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3f718793-f9b6-45ef-a9e8-f454409d2c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:46.127964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:46.157371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c2ab2-9245-47ef-9928-16e887e2306e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.162113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622334cc-7ba1-449f-b9c9-d6a58581dbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.163040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622334cc-7ba1-449f-b9c9-d6a58581dbd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.163323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622334cc-7ba1-449f-b9c9-d6a58581dbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.163599 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622334cc-7ba1-449f-b9c9-d6a58581dbd7 admin admin] PATH_INFO: `/v3/projects/d807f48dee60483680b007e0be286979/users/3e291616a6574581af9e778d5849ccca/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.178034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622334cc-7ba1-449f-b9c9-d6a58581dbd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d807f48dee60483680b007e0be286979, user_id=3e291616a6574581af9e778d5849ccca, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:46.180734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622334cc-7ba1-449f-b9c9-d6a58581dbd7 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:46.183722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 802/1612] 10.222.0.36 () {58 vars in 1058 bytes} [Sun Jun 26 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:46.184842 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1ed04-e1e1-4f39-9e45-bd851e13b51c None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.185122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1ed04-e1e1-4f39-9e45-bd851e13b51c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.185470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1ed04-e1e1-4f39-9e45-bd851e13b51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.195875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 811/1613] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:46 2022] PUT /identity/v3/projects/d807f48dee60483680b007e0be286979/users/3e291616a6574581af9e778d5849ccca/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:46.197075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16f26-47ad-4793-9105-f0f9ab278454 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.197447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16f26-47ad-4793-9105-f0f9ab278454 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.197729 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16f26-47ad-4793-9105-f0f9ab278454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.212592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-22f1ed04-e1e1-4f39-9e45-bd851e13b51c None None] MFA Rules not processed for user `3f0996a2b88842a7953d1eef9713ef9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:46.213795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-22f1ed04-e1e1-4f39-9e45-bd851e13b51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:46.214791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-78e16f26-47ad-4793-9105-f0f9ab278454 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:46.215985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-78e16f26-47ad-4793-9105-f0f9ab278454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:46.273173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 812/1614] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:46.276798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 803/1615] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:46.277280 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16f26-47ad-4793-9105-f0f9ab278454 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.278099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1ed04-e1e1-4f39-9e45-bd851e13b51c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.286875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:46.290441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16f26-47ad-4793-9105-f0f9ab278454 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.295220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be414684-151e-4add-b575-0b9ff2fe32c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.295881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be414684-151e-4add-b575-0b9ff2fe32c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.296162 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be414684-151e-4add-b575-0b9ff2fe32c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.296440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be414684-151e-4add-b575-0b9ff2fe32c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.297111 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be414684-151e-4add-b575-0b9ff2fe32c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:46.299065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be414684-151e-4add-b575-0b9ff2fe32c3 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:46.325959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 813/1616] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:46 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:46.327017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be414684-151e-4add-b575-0b9ff2fe32c3 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.335933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1ed04-e1e1-4f39-9e45-bd851e13b51c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.382849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc850b2-b733-48ad-b4c1-f3000ef2c156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.383550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc850b2-b733-48ad-b4c1-f3000ef2c156 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.383832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc850b2-b733-48ad-b4c1-f3000ef2c156 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.384111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc850b2-b733-48ad-b4c1-f3000ef2c156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.396063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be414684-151e-4add-b575-0b9ff2fe32c3 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.401689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8599c90-0c58-446d-b889-ad418a201370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.402342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599c90-0c58-446d-b889-ad418a201370 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.402627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599c90-0c58-446d-b889-ad418a201370 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.402909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8599c90-0c58-446d-b889-ad418a201370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.434243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:46.441088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc850b2-b733-48ad-b4c1-f3000ef2c156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:46.442564 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc850b2-b733-48ad-b4c1-f3000ef2c156 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:46.451770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 804/1617] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:46.452609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc850b2-b733-48ad-b4c1-f3000ef2c156 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.460168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8599c90-0c58-446d-b889-ad418a201370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:46.462408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8599c90-0c58-446d-b889-ad418a201370 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:46.472025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 814/1618] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:46.473433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5c27-9bb2-4a9c-9357-02926404f121 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.474058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5c27-9bb2-4a9c-9357-02926404f121 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.474058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa5c27-9bb2-4a9c-9357-02926404f121 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.475571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 815/1619] 10.222.0.36 () {54 vars in 912 bytes} [Sun Jun 26 03:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:04:46.477113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef262a-9973-4f52-aa04-0d99e5c71ee0 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.477397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef262a-9973-4f52-aa04-0d99e5c71ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.477674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef262a-9973-4f52-aa04-0d99e5c71ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.497637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-e2ef262a-9973-4f52-aa04-0d99e5c71ee0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:46.498903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e2ef262a-9973-4f52-aa04-0d99e5c71ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:46.531998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc850b2-b733-48ad-b4c1-f3000ef2c156 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.535723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0b128-af07-4c26-a012-feb2df98229c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.536446 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0b128-af07-4c26-a012-feb2df98229c service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.536794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0b128-af07-4c26-a012-feb2df98229c service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.537211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0b128-af07-4c26-a012-feb2df98229c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.559688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 816/1620] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:46.560955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef262a-9973-4f52-aa04-0d99e5c71ee0 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.570840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:46.571099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef262a-9973-4f52-aa04-0d99e5c71ee0 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.576900 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ea81b-e8f7-4bb0-9ef9-326920a17718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.577626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ea81b-e8f7-4bb0-9ef9-326920a17718 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.577908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ea81b-e8f7-4bb0-9ef9-326920a17718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.578187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ea81b-e8f7-4bb0-9ef9-326920a17718 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.578879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ea81b-e8f7-4bb0-9ef9-326920a17718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:46.580898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ea81b-e8f7-4bb0-9ef9-326920a17718 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:46.604218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0b128-af07-4c26-a012-feb2df98229c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:46.605688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0b128-af07-4c26-a012-feb2df98229c service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:46.609083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 817/1621] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:46 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:46.610083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ea81b-e8f7-4bb0-9ef9-326920a17718 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.617326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 805/1622] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:46.619189 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0b128-af07-4c26-a012-feb2df98229c service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.630006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0b128-af07-4c26-a012-feb2df98229c service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.691783 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ea81b-e8f7-4bb0-9ef9-326920a17718 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.696884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ed2f0-1d01-4f29-b57c-1a3edbf28b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.697548 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ed2f0-1d01-4f29-b57c-1a3edbf28b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.697845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ed2f0-1d01-4f29-b57c-1a3edbf28b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.698233 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ed2f0-1d01-4f29-b57c-1a3edbf28b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.708465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb15847-1a2c-4cc1-8335-07092c7a25e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.709290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15847-1a2c-4cc1-8335-07092c7a25e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.709586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15847-1a2c-4cc1-8335-07092c7a25e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.710117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15847-1a2c-4cc1-8335-07092c7a25e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.710925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb15847-1a2c-4cc1-8335-07092c7a25e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:46.713092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb15847-1a2c-4cc1-8335-07092c7a25e7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:46.737675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 806/1623] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:46 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:46.742512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b577a-26f6-4760-b305-b0f8d26f9c0c None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.742820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b577a-26f6-4760-b305-b0f8d26f9c0c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.743191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b577a-26f6-4760-b305-b0f8d26f9c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.780989 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ba9b577a-26f6-4760-b305-b0f8d26f9c0c None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:46.782742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ba9b577a-26f6-4760-b305-b0f8d26f9c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:46.792368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ed2f0-1d01-4f29-b57c-1a3edbf28b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:46.795860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ed2f0-1d01-4f29-b57c-1a3edbf28b21 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:46.805584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:46.813553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 818/1624] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:46.816294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68951fbd-42b9-4e8c-842a-09c075e9ec70 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.816587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68951fbd-42b9-4e8c-842a-09c075e9ec70 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.816884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68951fbd-42b9-4e8c-842a-09c075e9ec70 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.821929 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 819/1625] 10.222.0.36 () {54 vars in 912 bytes} [Sun Jun 26 03:04:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:04:46.821929 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68951fbd-42b9-4e8c-842a-09c075e9ec70 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.837676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68951fbd-42b9-4e8c-842a-09c075e9ec70 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.842163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ffd52-35e7-4c4c-8d9b-d52744bd035a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.843526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ffd52-35e7-4c4c-8d9b-d52744bd035a service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.844303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ffd52-35e7-4c4c-8d9b-d52744bd035a service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.844892 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ffd52-35e7-4c4c-8d9b-d52744bd035a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.861195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ffd52-35e7-4c4c-8d9b-d52744bd035a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:46.863578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ffd52-35e7-4c4c-8d9b-d52744bd035a service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:46.872141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 807/1626] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:46.873137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b577a-26f6-4760-b305-b0f8d26f9c0c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.875662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 820/1627] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:46.876771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ffd52-35e7-4c4c-8d9b-d52744bd035a service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.887782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b577a-26f6-4760-b305-b0f8d26f9c0c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.891249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ffd52-35e7-4c4c-8d9b-d52744bd035a service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.893688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9ef21-03f5-4dd7-939a-45902fdfa1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.894643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9ef21-03f5-4dd7-939a-45902fdfa1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.895170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9ef21-03f5-4dd7-939a-45902fdfa1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.895620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9ef21-03f5-4dd7-939a-45902fdfa1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.896518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9ef21-03f5-4dd7-939a-45902fdfa1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:46.896636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57752bf0-b4cc-457e-b550-38c037861ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.898866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9ef21-03f5-4dd7-939a-45902fdfa1d4 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:46.899617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57752bf0-b4cc-457e-b550-38c037861ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.900488 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57752bf0-b4cc-457e-b550-38c037861ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.900488 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57752bf0-b4cc-457e-b550-38c037861ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.901138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57752bf0-b4cc-457e-b550-38c037861ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:46.903256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57752bf0-b4cc-457e-b550-38c037861ef0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:46.917216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 821/1628] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:46.919150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a1cc9-0d6f-426c-9a87-9f26dfd83e31 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.919504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a1cc9-0d6f-426c-9a87-9f26dfd83e31 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.919793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a1cc9-0d6f-426c-9a87-9f26dfd83e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.931934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 808/1629] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:46 2022] POST /identity/v3/users => generated 308 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:46.931934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9ef21-03f5-4dd7-939a-45902fdfa1d4 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.943688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f07a1cc9-0d6f-426c-9a87-9f26dfd83e31 None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:46.945131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f07a1cc9-0d6f-426c-9a87-9f26dfd83e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:46.957446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 822/1630] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:46.958845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a1cc9-0d6f-426c-9a87-9f26dfd83e31 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:46.976858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a1cc9-0d6f-426c-9a87-9f26dfd83e31 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:46.982650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315e044-84af-4a84-9c94-906586e350c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:46.984693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315e044-84af-4a84-9c94-906586e350c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:46.986423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315e044-84af-4a84-9c94-906586e350c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:46.987280 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315e044-84af-4a84-9c94-906586e350c9 admin admin] PATH_INFO: `/v3/projects/dd03095f36754c059f6febea0e8af65e/users/0e1a803fc46b4b7cb7134926fbf5ea5d/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:46.990470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:47.008475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315e044-84af-4a84-9c94-906586e350c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd03095f36754c059f6febea0e8af65e, user_id=0e1a803fc46b4b7cb7134926fbf5ea5d, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.011686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315e044-84af-4a84-9c94-906586e350c9 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.027681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9ef21-03f5-4dd7-939a-45902fdfa1d4 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:47.038705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 823/1631] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:46 2022] PUT /identity/v3/projects/dd03095f36754c059f6febea0e8af65e/users/0e1a803fc46b4b7cb7134926fbf5ea5d/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:47.038705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315e044-84af-4a84-9c94-906586e350c9 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:47.101261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e945e-37a3-4e8d-a0c8-6e13b6443533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:47.102017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e945e-37a3-4e8d-a0c8-6e13b6443533 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.102352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e945e-37a3-4e8d-a0c8-6e13b6443533 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.102639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e945e-37a3-4e8d-a0c8-6e13b6443533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.129738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315e044-84af-4a84-9c94-906586e350c9 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:47.137835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fff95-de45-4f16-8f47-780063d74998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:47.138711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fff95-de45-4f16-8f47-780063d74998 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.139117 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fff95-de45-4f16-8f47-780063d74998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.139860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fff95-de45-4f16-8f47-780063d74998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.140798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fff95-de45-4f16-8f47-780063d74998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.143262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fff95-de45-4f16-8f47-780063d74998 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.159513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 824/1632] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:47.159513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fff95-de45-4f16-8f47-780063d74998 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:47.172796 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fff95-de45-4f16-8f47-780063d74998 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:47.179308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439c2a4-b26a-4197-b12d-79f83f358cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:47.180051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439c2a4-b26a-4197-b12d-79f83f358cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.180303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439c2a4-b26a-4197-b12d-79f83f358cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.180584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439c2a4-b26a-4197-b12d-79f83f358cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.181511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439c2a4-b26a-4197-b12d-79f83f358cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.183720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439c2a4-b26a-4197-b12d-79f83f358cc2 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.192329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e945e-37a3-4e8d-a0c8-6e13b6443533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.194425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e945e-37a3-4e8d-a0c8-6e13b6443533 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.201404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 825/1633] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:47.201404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439c2a4-b26a-4197-b12d-79f83f358cc2 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:47.209359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 809/1634] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:47.210357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e945e-37a3-4e8d-a0c8-6e13b6443533 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:47.219800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439c2a4-b26a-4197-b12d-79f83f358cc2 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:47.224878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f97c-f6a1-4e0e-a822-91034bc4a235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:47.225732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f97c-f6a1-4e0e-a822-91034bc4a235 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.226122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f97c-f6a1-4e0e-a822-91034bc4a235 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.226402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e945e-37a3-4e8d-a0c8-6e13b6443533 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:47.226576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f97c-f6a1-4e0e-a822-91034bc4a235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.231646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7db580-c75f-4304-b9ec-22a91ffb9233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:47.232834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7db580-c75f-4304-b9ec-22a91ffb9233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.233618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7db580-c75f-4304-b9ec-22a91ffb9233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.233911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7db580-c75f-4304-b9ec-22a91ffb9233 admin admin] PATH_INFO: `/v3/projects/fdeabf35c8224a79b93befe978394c79/users/431c93d82b564b16bcfd8ad87ea40dc6/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.240431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300f97c-f6a1-4e0e-a822-91034bc4a235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.242047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300f97c-f6a1-4e0e-a822-91034bc4a235 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.254081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7db580-c75f-4304-b9ec-22a91ffb9233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdeabf35c8224a79b93befe978394c79, user_id=431c93d82b564b16bcfd8ad87ea40dc6, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.258040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7db580-c75f-4304-b9ec-22a91ffb9233 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.269290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 826/1635] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:47.270545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f97c-f6a1-4e0e-a822-91034bc4a235 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:47.279414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 810/1636] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:47 2022] PUT /identity/v3/projects/fdeabf35c8224a79b93befe978394c79/users/431c93d82b564b16bcfd8ad87ea40dc6/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:47.283725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7db580-c75f-4304-b9ec-22a91ffb9233 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:47.300948 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f97c-f6a1-4e0e-a822-91034bc4a235 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:47.374727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7db580-c75f-4304-b9ec-22a91ffb9233 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:47.382824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c556951-460c-4629-96ab-033ccf1c85aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:47.383640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556951-460c-4629-96ab-033ccf1c85aa admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.384219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556951-460c-4629-96ab-033ccf1c85aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.384573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556951-460c-4629-96ab-033ccf1c85aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.385562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c556951-460c-4629-96ab-033ccf1c85aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.388660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c556951-460c-4629-96ab-033ccf1c85aa admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.398625 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:47.418503 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 811/1637] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:47.419497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c556951-460c-4629-96ab-033ccf1c85aa admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:47.424170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb15a99-8427-47f8-a070-bd18e561068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:47.426816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb15a99-8427-47f8-a070-bd18e561068a admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.427115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb15a99-8427-47f8-a070-bd18e561068a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.427402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb15a99-8427-47f8-a070-bd18e561068a admin admin] PATH_INFO: `/v3/projects/dd03095f36754c059f6febea0e8af65e/users/0e1a803fc46b4b7cb7134926fbf5ea5d/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.433959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb15a99-8427-47f8-a070-bd18e561068a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd03095f36754c059f6febea0e8af65e, user_id=0e1a803fc46b4b7cb7134926fbf5ea5d, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.439476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb15a99-8427-47f8-a070-bd18e561068a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.440890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c556951-460c-4629-96ab-033ccf1c85aa admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:47.449525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa51bd-2f90-494d-8291-db144e70fd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:47.451330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa51bd-2f90-494d-8291-db144e70fd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.452099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa51bd-2f90-494d-8291-db144e70fd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.452382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa51bd-2f90-494d-8291-db144e70fd27 admin admin] PATH_INFO: `/v3/projects/fdeabf35c8224a79b93befe978394c79/users/431c93d82b564b16bcfd8ad87ea40dc6/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.455771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa51bd-2f90-494d-8291-db144e70fd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdeabf35c8224a79b93befe978394c79, user_id=431c93d82b564b16bcfd8ad87ea40dc6, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.459903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa51bd-2f90-494d-8291-db144e70fd27 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.471042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 827/1638] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:47 2022] PUT /identity/v3/projects/dd03095f36754c059f6febea0e8af65e/users/0e1a803fc46b4b7cb7134926fbf5ea5d/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:47.485016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf2bd4-356d-4051-8a69-802596ec5811 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.485653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf2bd4-356d-4051-8a69-802596ec5811 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.485653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf2bd4-356d-4051-8a69-802596ec5811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.502913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 812/1639] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:47 2022] PUT /identity/v3/projects/fdeabf35c8224a79b93befe978394c79/users/431c93d82b564b16bcfd8ad87ea40dc6/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:47.516904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fe856-07c7-4472-b400-3ccfccd01960 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.517618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fe856-07c7-4472-b400-3ccfccd01960 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.518001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fe856-07c7-4472-b400-3ccfccd01960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.531466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:47.555273 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6ecf2bd4-356d-4051-8a69-802596ec5811 None None] MFA Rules not processed for user `0e1a803fc46b4b7cb7134926fbf5ea5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:47.556271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6ecf2bd4-356d-4051-8a69-802596ec5811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:47.560770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-814fe856-07c7-4472-b400-3ccfccd01960 None None] MFA Rules not processed for user `431c93d82b564b16bcfd8ad87ea40dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:47.562227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-814fe856-07c7-4472-b400-3ccfccd01960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:47.691731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 828/1640] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:47.694864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf2bd4-356d-4051-8a69-802596ec5811 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:47.740586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 813/1641] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:47.741954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fe856-07c7-4472-b400-3ccfccd01960 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:47.841845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf2bd4-356d-4051-8a69-802596ec5811 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:47.847358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:47.848316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.849152 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.849448 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] PATH_INFO: `/v3/users/62ab5722db4e4fbd9f33d36c0c35188a` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.850763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ab5722db4e4fbd9f33d36c0c35188a)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.852540 dv-cinder-846842-4-smb devstack@keystone.service[80129]: WARNING py.warnings [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:04:47.852540 dv-cinder-846842-4-smb devstack@keystone.service[80129]: warnings.warn(msg) Jun 26 03:04:47.852540 dv-cinder-846842-4-smb devstack@keystone.service[80129]: Jun 26 03:04:47.853770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.887801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fe856-07c7-4472-b400-3ccfccd01960 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:47.897298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b22a5-554c-4f6a-b37b-4bc9f456d549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:47.899202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b22a5-554c-4f6a-b37b-4bc9f456d549 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.899489 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b22a5-554c-4f6a-b37b-4bc9f456d549 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.899770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b22a5-554c-4f6a-b37b-4bc9f456d549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.920499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b22a5-554c-4f6a-b37b-4bc9f456d549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.922000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b22a5-554c-4f6a-b37b-4bc9f456d549 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.938939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 814/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:47.944374 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b22a5-554c-4f6a-b37b-4bc9f456d549 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:47.967607 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b22a5-554c-4f6a-b37b-4bc9f456d549 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:47.972700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6914b99-2d51-42a2-a4eb-261c75ce44ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:47.973364 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914b99-2d51-42a2-a4eb-261c75ce44ca service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:47.973651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914b99-2d51-42a2-a4eb-261c75ce44ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:47.973929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914b99-2d51-42a2-a4eb-261c75ce44ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:47.987686 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6914b99-2d51-42a2-a4eb-261c75ce44ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:47.989608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6914b99-2d51-42a2-a4eb-261c75ce44ca service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:47.989915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ab5722db4e4fbd9f33d36c0c35188a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:48.005573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 815/1643] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:47 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:48.037681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ab5722db4e4fbd9f33d36c0c35188a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:48.052518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ab5722db4e4fbd9f33d36c0c35188a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:48.070378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ab5722db4e4fbd9f33d36c0c35188a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:48.071780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ab5722db4e4fbd9f33d36c0c35188a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:48.083230 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 829/1644] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:04:47 2022] DELETE /identity/v3/users/62ab5722db4e4fbd9f33d36c0c35188a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:48.088633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e183b5b-52f2-476e-81e1-cef1b35b66a7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:48.089027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e183b5b-52f2-476e-81e1-cef1b35b66a7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:48.089445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e183b5b-52f2-476e-81e1-cef1b35b66a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:48.123381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5e183b5b-52f2-476e-81e1-cef1b35b66a7 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:48.124706 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5e183b5b-52f2-476e-81e1-cef1b35b66a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:48.237180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 816/1645] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:48.259746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:48.261534 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:48.272653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e183b5b-52f2-476e-81e1-cef1b35b66a7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:48.278378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5e183b5b-52f2-476e-81e1-cef1b35b66a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:48.287140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:48.328248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:48.365343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e183b5b-52f2-476e-81e1-cef1b35b66a7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:48.373141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b25bfe-33b6-4e88-9ec2-eeccf260c998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:48.373867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b25bfe-33b6-4e88-9ec2-eeccf260c998 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:48.374148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b25bfe-33b6-4e88-9ec2-eeccf260c998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:48.374896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b25bfe-33b6-4e88-9ec2-eeccf260c998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:48.377837 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-18b25bfe-33b6-4e88-9ec2-eeccf260c998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:48.406432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f65ba0-ce64-4e8d-a377-73662c15803a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:48.411893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26442ba8-9e9c-4832-ab78-4bb21b44cca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:48.413475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26442ba8-9e9c-4832-ab78-4bb21b44cca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:48.413795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26442ba8-9e9c-4832-ab78-4bb21b44cca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:48.414205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26442ba8-9e9c-4832-ab78-4bb21b44cca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:48.430389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26442ba8-9e9c-4832-ab78-4bb21b44cca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:48.432205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26442ba8-9e9c-4832-ab78-4bb21b44cca7 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:48.449443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 830/1646] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:48.484218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26442ba8-9e9c-4832-ab78-4bb21b44cca7 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:48.488444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-26442ba8-9e9c-4832-ab78-4bb21b44cca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:48.503771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b25bfe-33b6-4e88-9ec2-eeccf260c998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:48.509867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b25bfe-33b6-4e88-9ec2-eeccf260c998 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:48.535123 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26442ba8-9e9c-4832-ab78-4bb21b44cca7 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:48.542461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 817/1647] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:48.556025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:48.557075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:48.560158 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:48.560573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] PATH_INFO: `/v3/users/3f0996a2b88842a7953d1eef9713ef9f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:48.562138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f0996a2b88842a7953d1eef9713ef9f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:48.567338 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:48.703836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f0996a2b88842a7953d1eef9713ef9f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:48.732597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f0996a2b88842a7953d1eef9713ef9f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:48.754689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f0996a2b88842a7953d1eef9713ef9f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:48.784972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f0996a2b88842a7953d1eef9713ef9f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:48.788769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f0996a2b88842a7953d1eef9713ef9f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:48.810970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 831/1648] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:04:48 2022] DELETE /identity/v3/users/3f0996a2b88842a7953d1eef9713ef9f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:48.816719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08677238-616a-4576-ae60-901719cd4313 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:48.817261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08677238-616a-4576-ae60-901719cd4313 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:48.817449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08677238-616a-4576-ae60-901719cd4313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:48.852616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-08677238-616a-4576-ae60-901719cd4313 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:48.855950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-08677238-616a-4576-ae60-901719cd4313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:48.998237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 818/1649] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:49.069429 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:49.071721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:49.180829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd493e8-915f-49de-9ef2-22f0b305cf29 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:49.184964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa1561-7d54-439d-822a-c4a81fd233c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:49.185633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1561-7d54-439d-822a-c4a81fd233c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:49.185931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1561-7d54-439d-822a-c4a81fd233c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:49.186173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1561-7d54-439d-822a-c4a81fd233c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:49.209299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa1561-7d54-439d-822a-c4a81fd233c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:49.211071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa1561-7d54-439d-822a-c4a81fd233c7 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:49.226138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 832/1650] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:49.670715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08677238-616a-4576-ae60-901719cd4313 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:49.672491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-08677238-616a-4576-ae60-901719cd4313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:49.688818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08677238-616a-4576-ae60-901719cd4313 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:49.694487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:49.695652 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:49.696158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:49.696725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] PATH_INFO: `/v3/projects/a18b13001739495b89d456fb0907e7e4` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:49.698244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18b13001739495b89d456fb0907e7e4)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:49.699759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: WARNING py.warnings [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 26 03:04:49.699759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: warnings.warn(msg) Jun 26 03:04:49.699759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: Jun 26 03:04:49.701602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:49.848558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18b13001739495b89d456fb0907e7e4', 'request_id': 'req-90c4ff60-9149-46c7-8276-e583b418dd60'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:49.871371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:49.883192 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18b13001739495b89d456fb0907e7e4', 'request_id': 'req-90c4ff60-9149-46c7-8276-e583b418dd60'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:49.897781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18b13001739495b89d456fb0907e7e4', 'request_id': 'req-90c4ff60-9149-46c7-8276-e583b418dd60'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:49.925280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] The token cache is being invalidate because project a18b13001739495b89d456fb0907e7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:04:49.925636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:49.928983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-90c4ff60-9149-46c7-8276-e583b418dd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:49.935125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 819/1651] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:04:49 2022] DELETE /identity/v3/projects/a18b13001739495b89d456fb0907e7e4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:49.936829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba6ff-539b-4bcb-89f3-35038f0a1b72 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:49.937303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba6ff-539b-4bcb-89f3-35038f0a1b72 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:49.937413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba6ff-539b-4bcb-89f3-35038f0a1b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:49.963958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-721ba6ff-539b-4bcb-89f3-35038f0a1b72 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:49.965480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-721ba6ff-539b-4bcb-89f3-35038f0a1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:50.002004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:50.041984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 833/1652] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:50.052983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c242ad-b099-44c4-9731-fa64221cab95 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:50.053330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c242ad-b099-44c4-9731-fa64221cab95 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:50.054207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c242ad-b099-44c4-9731-fa64221cab95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:50.091447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-84c242ad-b099-44c4-9731-fa64221cab95 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:50.094318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-84c242ad-b099-44c4-9731-fa64221cab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:50.118077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 820/1653] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:50.123389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ba6ff-539b-4bcb-89f3-35038f0a1b72 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:50.138314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ba6ff-539b-4bcb-89f3-35038f0a1b72 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:50.144849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ef29b-b915-4673-b32a-c730b650673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:50.146139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ef29b-b915-4673-b32a-c730b650673a admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:50.146439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ef29b-b915-4673-b32a-c730b650673a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:50.147784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ef29b-b915-4673-b32a-c730b650673a admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:50.148721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ef29b-b915-4673-b32a-c730b650673a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:04:50.149096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ef29b-b915-4673-b32a-c730b650673a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:50.150919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ef29b-b915-4673-b32a-c730b650673a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:50.171603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 834/1654] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:04:50.176477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c242ad-b099-44c4-9731-fa64221cab95 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:50.189028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c242ad-b099-44c4-9731-fa64221cab95 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:50.196774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d94977-cd5d-4010-8100-f4a00e5bb83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:50.198527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d94977-cd5d-4010-8100-f4a00e5bb83b admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:50.198822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d94977-cd5d-4010-8100-f4a00e5bb83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:50.199159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d94977-cd5d-4010-8100-f4a00e5bb83b admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:50.199881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d94977-cd5d-4010-8100-f4a00e5bb83b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:50.203132 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d94977-cd5d-4010-8100-f4a00e5bb83b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:50.244188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 821/1655] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:50 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:50.247826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ef29b-b915-4673-b32a-c730b650673a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:50.260887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ef29b-b915-4673-b32a-c730b650673a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:50.324788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d94977-cd5d-4010-8100-f4a00e5bb83b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:50.327140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e3d94977-cd5d-4010-8100-f4a00e5bb83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:50.435348 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d94977-cd5d-4010-8100-f4a00e5bb83b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:50.443401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:50.444956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:50.445192 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:50.501172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] PATH_INFO: `/v3/projects/2c7f10bb194d491db929f41715e900b0` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:50.501172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7f10bb194d491db929f41715e900b0)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:50.501172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:50.511567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec237a63-f38a-445e-b689-1c528110baa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:50.511567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec237a63-f38a-445e-b689-1c528110baa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:50.511567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec237a63-f38a-445e-b689-1c528110baa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:50.511567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec237a63-f38a-445e-b689-1c528110baa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:50.518375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec237a63-f38a-445e-b689-1c528110baa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:50.518375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec237a63-f38a-445e-b689-1c528110baa3 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:50.550755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 835/1656] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:50 2022] POST /identity/v3/users => generated 282 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:04:50.550921 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7f10bb194d491db929f41715e900b0', 'request_id': 'req-6a417909-455a-4c81-9398-326df1d0e27b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:50.555454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec237a63-f38a-445e-b689-1c528110baa3 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:50.561301 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7f10bb194d491db929f41715e900b0', 'request_id': 'req-6a417909-455a-4c81-9398-326df1d0e27b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:50.575801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec237a63-f38a-445e-b689-1c528110baa3 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:50.580633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7f10bb194d491db929f41715e900b0', 'request_id': 'req-6a417909-455a-4c81-9398-326df1d0e27b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:50.604249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] The token cache is being invalidate because project 2c7f10bb194d491db929f41715e900b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:04:50.606527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:50.607510 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:50.611662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 822/1657] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:04:50 2022] DELETE /identity/v3/projects/2c7f10bb194d491db929f41715e900b0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:50.615729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:50.618699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:50.762202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ebadf-49bd-4ea1-999b-ce6e6fb37d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:50.763628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebadf-49bd-4ea1-999b-ce6e6fb37d51 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:50.763914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebadf-49bd-4ea1-999b-ce6e6fb37d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:50.764191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebadf-49bd-4ea1-999b-ce6e6fb37d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:50.765064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ebadf-49bd-4ea1-999b-ce6e6fb37d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:50.769742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ebadf-49bd-4ea1-999b-ce6e6fb37d51 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:50.781899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:50.802665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 836/1658] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:50.805152 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ebadf-49bd-4ea1-999b-ce6e6fb37d51 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:50.808860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-602ebadf-49bd-4ea1-999b-ce6e6fb37d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:50.837956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ebadf-49bd-4ea1-999b-ce6e6fb37d51 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:50.843747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a417909-455a-4c81-9398-326df1d0e27b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:50.848768 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cd087-444e-44d3-a700-c167d7671786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:50.849476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd087-444e-44d3-a700-c167d7671786 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:50.849753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd087-444e-44d3-a700-c167d7671786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:50.850031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cd087-444e-44d3-a700-c167d7671786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:50.850780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cd087-444e-44d3-a700-c167d7671786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:50.852497 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cd087-444e-44d3-a700-c167d7671786 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:50.862162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faffbf-9c08-4275-94bb-40efcf6581e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:50.863145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faffbf-9c08-4275-94bb-40efcf6581e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:50.863437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faffbf-9c08-4275-94bb-40efcf6581e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:50.864314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faffbf-9c08-4275-94bb-40efcf6581e5 admin admin] PATH_INFO: `/v3/users/431c93d82b564b16bcfd8ad87ea40dc6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:50.869515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faffbf-9c08-4275-94bb-40efcf6581e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431c93d82b564b16bcfd8ad87ea40dc6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:50.871743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faffbf-9c08-4275-94bb-40efcf6581e5 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:50.905477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 837/1659] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:04:50.919096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cd087-444e-44d3-a700-c167d7671786 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:50.987637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cd087-444e-44d3-a700-c167d7671786 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:51.001347 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c2faffbf-9c08-4275-94bb-40efcf6581e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431c93d82b564b16bcfd8ad87ea40dc6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:51.002457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c9182-75a4-4b62-a48c-f9d6d9a462df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:51.004026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c9182-75a4-4b62-a48c-f9d6d9a462df admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:51.004571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c9182-75a4-4b62-a48c-f9d6d9a462df admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:51.005032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c9182-75a4-4b62-a48c-f9d6d9a462df admin admin] PATH_INFO: `/v3/projects/24ab9724a74c43e1b0b12a3a8d63cd3b/users/0db61cfe69cb4db5a89039b4662e314c/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:51.035008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c2faffbf-9c08-4275-94bb-40efcf6581e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431c93d82b564b16bcfd8ad87ea40dc6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:51.047492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c2faffbf-9c08-4275-94bb-40efcf6581e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431c93d82b564b16bcfd8ad87ea40dc6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:51.054934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c9182-75a4-4b62-a48c-f9d6d9a462df admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ab9724a74c43e1b0b12a3a8d63cd3b, user_id=0db61cfe69cb4db5a89039b4662e314c, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:51.061816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c9182-75a4-4b62-a48c-f9d6d9a462df admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:51.062247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c2faffbf-9c08-4275-94bb-40efcf6581e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431c93d82b564b16bcfd8ad87ea40dc6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:51.063713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c2faffbf-9c08-4275-94bb-40efcf6581e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431c93d82b564b16bcfd8ad87ea40dc6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:51.096072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 823/1660] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:04:50 2022] DELETE /identity/v3/users/431c93d82b564b16bcfd8ad87ea40dc6 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:51.106148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 838/1661] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:50 2022] PUT /identity/v3/projects/24ab9724a74c43e1b0b12a3a8d63cd3b/users/0db61cfe69cb4db5a89039b4662e314c/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:51.108075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7476594-9fd3-4842-8560-a1226832c241 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:51.108371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7476594-9fd3-4842-8560-a1226832c241 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:51.108640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7476594-9fd3-4842-8560-a1226832c241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:51.173718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b7476594-9fd3-4842-8560-a1226832c241 None None] MFA Rules not processed for user `0db61cfe69cb4db5a89039b4662e314c`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:51.175203 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b7476594-9fd3-4842-8560-a1226832c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:51.308759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c9182-75a4-4b62-a48c-f9d6d9a462df admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:51.310549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-069c9182-75a4-4b62-a48c-f9d6d9a462df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:51.352750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:51.463214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c9182-75a4-4b62-a48c-f9d6d9a462df admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:51.507621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 824/1662] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:51.513458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7476594-9fd3-4842-8560-a1226832c241 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:51.516254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b7476594-9fd3-4842-8560-a1226832c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:51.557817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ed3eb-1d92-414b-a81a-03037ae98c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:51.558818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed3eb-1d92-414b-a81a-03037ae98c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:51.559225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed3eb-1d92-414b-a81a-03037ae98c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:51.559605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed3eb-1d92-414b-a81a-03037ae98c9f admin admin] PATH_INFO: `/v3/users/f13949f5f15b4424982f48d4240068ad` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:51.561108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ed3eb-1d92-414b-a81a-03037ae98c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13949f5f15b4424982f48d4240068ad)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:51.563966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ed3eb-1d92-414b-a81a-03037ae98c9f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:51.673247 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ba3ed3eb-1d92-414b-a81a-03037ae98c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13949f5f15b4424982f48d4240068ad'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:51.702622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:51.712978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ba3ed3eb-1d92-414b-a81a-03037ae98c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13949f5f15b4424982f48d4240068ad'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:51.738223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ba3ed3eb-1d92-414b-a81a-03037ae98c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13949f5f15b4424982f48d4240068ad'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:51.748647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7476594-9fd3-4842-8560-a1226832c241 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:51.754543 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ba3ed3eb-1d92-414b-a81a-03037ae98c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13949f5f15b4424982f48d4240068ad'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:51.762180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ba3ed3eb-1d92-414b-a81a-03037ae98c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13949f5f15b4424982f48d4240068ad'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:51.767463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6dd69-6d3f-434b-8811-7388f458f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:51.768158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6dd69-6d3f-434b-8811-7388f458f027 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:51.768446 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6dd69-6d3f-434b-8811-7388f458f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:51.768727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6dd69-6d3f-434b-8811-7388f458f027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:51.769437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6dd69-6d3f-434b-8811-7388f458f027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:51.773499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6dd69-6d3f-434b-8811-7388f458f027 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:51.779041 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 839/1663] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:04:51 2022] DELETE /identity/v3/users/f13949f5f15b4424982f48d4240068ad => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:51.785060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd278ed-f09c-4ac1-9e56-43e8c7d4b7ea None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:51.785394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd278ed-f09c-4ac1-9e56-43e8c7d4b7ea None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:51.785866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd278ed-f09c-4ac1-9e56-43e8c7d4b7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:51.828625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-1bd278ed-f09c-4ac1-9e56-43e8c7d4b7ea None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:51.829882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1bd278ed-f09c-4ac1-9e56-43e8c7d4b7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:51.842027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 825/1664] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:51 2022] POST /identity/v3/projects => generated 363 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:51.848038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6dd69-6d3f-434b-8811-7388f458f027 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:51.851913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a0c6dd69-6d3f-434b-8811-7388f458f027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:51.920056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:51.987924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 840/1665] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:51.995388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6dd69-6d3f-434b-8811-7388f458f027 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:52.001813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9762fe-1810-40fe-8b39-52e5f39fe469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:52.003107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9762fe-1810-40fe-8b39-52e5f39fe469 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:52.003392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9762fe-1810-40fe-8b39-52e5f39fe469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:52.003671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9762fe-1810-40fe-8b39-52e5f39fe469 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:52.004893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9762fe-1810-40fe-8b39-52e5f39fe469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:52.006920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9762fe-1810-40fe-8b39-52e5f39fe469 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:52.037858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd278ed-f09c-4ac1-9e56-43e8c7d4b7ea None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:52.039927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 826/1666] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:51 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:52.040179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1bd278ed-f09c-4ac1-9e56-43e8c7d4b7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:52.046089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9762fe-1810-40fe-8b39-52e5f39fe469 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:52.073527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9762fe-1810-40fe-8b39-52e5f39fe469 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:52.081822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96418dc9-2e25-42d0-a5db-1e0756bc5c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:52.082493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96418dc9-2e25-42d0-a5db-1e0756bc5c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:52.082849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96418dc9-2e25-42d0-a5db-1e0756bc5c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:52.083240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96418dc9-2e25-42d0-a5db-1e0756bc5c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:52.084074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96418dc9-2e25-42d0-a5db-1e0756bc5c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:52.086697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96418dc9-2e25-42d0-a5db-1e0756bc5c84 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:52.103278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 827/1667] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:52.106211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96418dc9-2e25-42d0-a5db-1e0756bc5c84 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:52.133241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96418dc9-2e25-42d0-a5db-1e0756bc5c84 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:52.144878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238074f0-ffc9-4e90-924b-75e40daa3ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:52.145805 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238074f0-ffc9-4e90-924b-75e40daa3ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:52.150225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238074f0-ffc9-4e90-924b-75e40daa3ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:52.150623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238074f0-ffc9-4e90-924b-75e40daa3ce7 admin admin] PATH_INFO: `/v3/projects/595017788ab94a9085a8de0f8616cc47/users/bba39dedc1094360a452c293b8387ac9/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:52.169932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd278ed-f09c-4ac1-9e56-43e8c7d4b7ea None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:52.179544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97599b47-2a46-4151-8076-bf1cd214a249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:52.180238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97599b47-2a46-4151-8076-bf1cd214a249 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:52.180528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97599b47-2a46-4151-8076-bf1cd214a249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:52.180807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97599b47-2a46-4151-8076-bf1cd214a249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:52.187173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238074f0-ffc9-4e90-924b-75e40daa3ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=595017788ab94a9085a8de0f8616cc47, user_id=bba39dedc1094360a452c293b8387ac9, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:52.189862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238074f0-ffc9-4e90-924b-75e40daa3ce7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:52.206504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97599b47-2a46-4151-8076-bf1cd214a249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:52.208456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97599b47-2a46-4151-8076-bf1cd214a249 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:52.217611 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 828/1668] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:52 2022] PUT /identity/v3/projects/595017788ab94a9085a8de0f8616cc47/users/bba39dedc1094360a452c293b8387ac9/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:04:52.222477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238074f0-ffc9-4e90-924b-75e40daa3ce7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:52.237816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 841/1669] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:04:52.358118 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238074f0-ffc9-4e90-924b-75e40daa3ce7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:52.373073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729aa1d-78b9-4a28-bb1d-46ac589844d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:52.376274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729aa1d-78b9-4a28-bb1d-46ac589844d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:52.376558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729aa1d-78b9-4a28-bb1d-46ac589844d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:52.376839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729aa1d-78b9-4a28-bb1d-46ac589844d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:52.377662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729aa1d-78b9-4a28-bb1d-46ac589844d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:52.383072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729aa1d-78b9-4a28-bb1d-46ac589844d2 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:52.401924 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 829/1670] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:52.406020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97599b47-2a46-4151-8076-bf1cd214a249 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:52.418343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97599b47-2a46-4151-8076-bf1cd214a249 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:52.428610 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7102b-eec8-41c4-84e9-d7bd9407bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:52.429531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7102b-eec8-41c4-84e9-d7bd9407bf17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:52.429808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7102b-eec8-41c4-84e9-d7bd9407bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:52.430907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7102b-eec8-41c4-84e9-d7bd9407bf17 admin admin] PATH_INFO: `/v3/projects/595017788ab94a9085a8de0f8616cc47/users/bba39dedc1094360a452c293b8387ac9/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:52.434218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7102b-eec8-41c4-84e9-d7bd9407bf17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=595017788ab94a9085a8de0f8616cc47, user_id=bba39dedc1094360a452c293b8387ac9, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:52.441010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7102b-eec8-41c4-84e9-d7bd9407bf17 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:52.469110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 842/1671] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:52 2022] PUT /identity/v3/projects/595017788ab94a9085a8de0f8616cc47/users/bba39dedc1094360a452c293b8387ac9/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:52.480190 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cebf4-2fee-44a7-8d3f-581847fc5d69 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:52.480726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cebf4-2fee-44a7-8d3f-581847fc5d69 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:52.480726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cebf4-2fee-44a7-8d3f-581847fc5d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:52.552023 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b87cebf4-2fee-44a7-8d3f-581847fc5d69 None None] MFA Rules not processed for user `bba39dedc1094360a452c293b8387ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:52.556535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b87cebf4-2fee-44a7-8d3f-581847fc5d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:52.640249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:52.841303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 830/1672] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:52.922442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7102b-eec8-41c4-84e9-d7bd9407bf17 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:52.925219 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-14d7102b-eec8-41c4-84e9-d7bd9407bf17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:53.174545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7102b-eec8-41c4-84e9-d7bd9407bf17 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:53.182760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a41eb-af19-4d60-8a2a-7ac73e9a7203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:53.195096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a41eb-af19-4d60-8a2a-7ac73e9a7203 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:53.195432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a41eb-af19-4d60-8a2a-7ac73e9a7203 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:53.195709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a41eb-af19-4d60-8a2a-7ac73e9a7203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:53.215790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a41eb-af19-4d60-8a2a-7ac73e9a7203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:53.217748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a41eb-af19-4d60-8a2a-7ac73e9a7203 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:53.233176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 843/1673] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:04:53.804831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cebf4-2fee-44a7-8d3f-581847fc5d69 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:53.806267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b87cebf4-2fee-44a7-8d3f-581847fc5d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:53.973096 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cebf4-2fee-44a7-8d3f-581847fc5d69 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:54.002021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:54.002946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:54.003267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:54.003543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] PATH_INFO: `/v3/projects/fdeabf35c8224a79b93befe978394c79` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:54.004949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdeabf35c8224a79b93befe978394c79)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:54.008554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:54.143919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdeabf35c8224a79b93befe978394c79', 'request_id': 'req-95ca8bde-27aa-4248-aaaf-1825c35b0cea'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.165618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a41eb-af19-4d60-8a2a-7ac73e9a7203 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:54.167603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ba7a41eb-af19-4d60-8a2a-7ac73e9a7203 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:54.171509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdeabf35c8224a79b93befe978394c79', 'request_id': 'req-95ca8bde-27aa-4248-aaaf-1825c35b0cea'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.191747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdeabf35c8224a79b93befe978394c79', 'request_id': 'req-95ca8bde-27aa-4248-aaaf-1825c35b0cea'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.193661 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a41eb-af19-4d60-8a2a-7ac73e9a7203 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:54.228815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] The token cache is being invalidate because project fdeabf35c8224a79b93befe978394c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:04:54.233195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.234115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-95ca8bde-27aa-4248-aaaf-1825c35b0cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.249567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 831/1674] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:04:53 2022] DELETE /identity/v3/projects/fdeabf35c8224a79b93befe978394c79 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:54.251642 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3e8f-8e7f-4376-85cc-ad30d0869407 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:54.251930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3e8f-8e7f-4376-85cc-ad30d0869407 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:54.252211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3e8f-8e7f-4376-85cc-ad30d0869407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:54.309748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-018f3e8f-8e7f-4376-85cc-ad30d0869407 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:54.311928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-018f3e8f-8e7f-4376-85cc-ad30d0869407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:54.347683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:54.348908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:54.349380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:54.349835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] PATH_INFO: `/v3/projects/237e1337256d4be6a5994a1cad1678ab` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:54.351376 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237e1337256d4be6a5994a1cad1678ab)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:54.353512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:54.380464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:54.451205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237e1337256d4be6a5994a1cad1678ab', 'request_id': 'req-4599e2aa-e07e-4634-b2ab-ec3677018ec3'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.458768 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:54.464409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237e1337256d4be6a5994a1cad1678ab', 'request_id': 'req-4599e2aa-e07e-4634-b2ab-ec3677018ec3'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.493388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237e1337256d4be6a5994a1cad1678ab', 'request_id': 'req-4599e2aa-e07e-4634-b2ab-ec3677018ec3'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.512251 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] The token cache is being invalidate because project 237e1337256d4be6a5994a1cad1678ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:04:54.513510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.513970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4599e2aa-e07e-4634-b2ab-ec3677018ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.518138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 844/1675] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:04:54 2022] DELETE /identity/v3/projects/237e1337256d4be6a5994a1cad1678ab => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:04:54.522740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000b25c-335a-46be-8886-c26a4e8dd95f None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:54.523158 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000b25c-335a-46be-8886-c26a4e8dd95f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:54.523536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000b25c-335a-46be-8886-c26a4e8dd95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:54.535050 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 832/1676] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:04:54.542688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b44d0-3a23-4cfe-a2fa-2cc9133e1c9e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:54.542977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b44d0-3a23-4cfe-a2fa-2cc9133e1c9e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:54.543282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b44d0-3a23-4cfe-a2fa-2cc9133e1c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:54.573491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f000b25c-335a-46be-8886-c26a4e8dd95f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:54.574409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f000b25c-335a-46be-8886-c26a4e8dd95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:54.601770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0d9b44d0-3a23-4cfe-a2fa-2cc9133e1c9e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:54.603020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0d9b44d0-3a23-4cfe-a2fa-2cc9133e1c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:54.681875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 845/1677] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:04:54.690630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5bd52-f84d-445e-b1e5-c9adb9334698 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:54.691164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5bd52-f84d-445e-b1e5-c9adb9334698 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:54.692358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5bd52-f84d-445e-b1e5-c9adb9334698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:54.750754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-acc5bd52-f84d-445e-b1e5-c9adb9334698 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:54.752094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-acc5bd52-f84d-445e-b1e5-c9adb9334698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:54.780973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 846/1678] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:04:54.781923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5bd52-f84d-445e-b1e5-c9adb9334698 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:54.784478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-acc5bd52-f84d-445e-b1e5-c9adb9334698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:54.798034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 833/1679] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:54.798804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b44d0-3a23-4cfe-a2fa-2cc9133e1c9e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:54.811586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5bd52-f84d-445e-b1e5-c9adb9334698 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:54.814413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b44d0-3a23-4cfe-a2fa-2cc9133e1c9e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:54.827082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:54.828279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:54.828957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:54.828957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] PATH_INFO: `/v3/users/0db61cfe69cb4db5a89039b4662e314c` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:54.831545 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1848663-96f9-41ea-ab4e-38f9332e1c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:54.832307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1848663-96f9-41ea-ab4e-38f9332e1c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:54.832943 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1848663-96f9-41ea-ab4e-38f9332e1c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:54.833672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db61cfe69cb4db5a89039b4662e314c)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:54.834084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1848663-96f9-41ea-ab4e-38f9332e1c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:54.835654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1848663-96f9-41ea-ab4e-38f9332e1c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:04:54.836153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1848663-96f9-41ea-ab4e-38f9332e1c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:54.836268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:54.838749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1848663-96f9-41ea-ab4e-38f9332e1c05 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:54.867685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 834/1680] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:04:54.868985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1848663-96f9-41ea-ab4e-38f9332e1c05 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:54.897469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1848663-96f9-41ea-ab4e-38f9332e1c05 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:54.904247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d54796-d585-48eb-9173-3c8489525d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:54.905400 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54796-d585-48eb-9173-3c8489525d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:54.905902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54796-d585-48eb-9173-3c8489525d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:54.907030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54796-d585-48eb-9173-3c8489525d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:54.908545 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d54796-d585-48eb-9173-3c8489525d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:04:54.909034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d54796-d585-48eb-9173-3c8489525d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:54.911661 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d54796-d585-48eb-9173-3c8489525d4c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:54.933732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 835/1681] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:04:54.935496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d54796-d585-48eb-9173-3c8489525d4c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:54.937224 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db61cfe69cb4db5a89039b4662e314c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.952379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d54796-d585-48eb-9173-3c8489525d4c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:54.959324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c4596-4bfc-4a07-8367-ad5a9696b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:54.960965 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c4596-4bfc-4a07-8367-ad5a9696b4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:54.961409 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c4596-4bfc-4a07-8367-ad5a9696b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:54.961943 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c4596-4bfc-4a07-8367-ad5a9696b4e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:54.962787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c4596-4bfc-4a07-8367-ad5a9696b4e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:54.964044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db61cfe69cb4db5a89039b4662e314c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.974727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c4596-4bfc-4a07-8367-ad5a9696b4e6 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:54.981668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db61cfe69cb4db5a89039b4662e314c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.997052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db61cfe69cb4db5a89039b4662e314c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:54.997963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db61cfe69cb4db5a89039b4662e314c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:55.012972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 847/1682] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:04:54 2022] DELETE /identity/v3/users/0db61cfe69cb4db5a89039b4662e314c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:55.014178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:55.021576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:55.041161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 836/1683] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:54 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:55.045146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f085b83-737f-4571-9419-b696cec407fc None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:55.047859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f085b83-737f-4571-9419-b696cec407fc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:55.049436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:55.051120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f085b83-737f-4571-9419-b696cec407fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:55.090070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-8f085b83-737f-4571-9419-b696cec407fc None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:55.091352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8f085b83-737f-4571-9419-b696cec407fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:55.179112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526df89-f767-461f-8279-3cd9aba514bc admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:55.214212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 837/1684] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:55.215425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f085b83-737f-4571-9419-b696cec407fc None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:55.217336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8f085b83-737f-4571-9419-b696cec407fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:55.246212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f085b83-737f-4571-9419-b696cec407fc None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:55.257019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46acf0b-e554-48a7-8514-558f0fa05840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:55.257720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46acf0b-e554-48a7-8514-558f0fa05840 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:55.258835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46acf0b-e554-48a7-8514-558f0fa05840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:55.259168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46acf0b-e554-48a7-8514-558f0fa05840 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:55.259885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46acf0b-e554-48a7-8514-558f0fa05840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:55.263929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46acf0b-e554-48a7-8514-558f0fa05840 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:55.301118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777abfac-a7aa-49d2-b4b5-a29c7d6f8f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:55.301922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777abfac-a7aa-49d2-b4b5-a29c7d6f8f5e admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:55.302096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777abfac-a7aa-49d2-b4b5-a29c7d6f8f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:55.302343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777abfac-a7aa-49d2-b4b5-a29c7d6f8f5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:55.303084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777abfac-a7aa-49d2-b4b5-a29c7d6f8f5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:55.305046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777abfac-a7aa-49d2-b4b5-a29c7d6f8f5e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:55.311477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 838/1685] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:55 2022] POST /identity/v3/users => generated 279 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:55.315232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46acf0b-e554-48a7-8514-558f0fa05840 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:55.333946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46acf0b-e554-48a7-8514-558f0fa05840 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:55.341083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bafb70-7262-4d23-84e2-4b722bcbf194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:55.342148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafb70-7262-4d23-84e2-4b722bcbf194 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:55.342481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafb70-7262-4d23-84e2-4b722bcbf194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:55.342814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafb70-7262-4d23-84e2-4b722bcbf194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:55.346894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bafb70-7262-4d23-84e2-4b722bcbf194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:55.348845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bafb70-7262-4d23-84e2-4b722bcbf194 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:55.378189 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 839/1686] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:55.379899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bafb70-7262-4d23-84e2-4b722bcbf194 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:55.381762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 848/1687] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:55 2022] POST /identity/v3/projects => generated 377 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:55.382690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777abfac-a7aa-49d2-b4b5-a29c7d6f8f5e admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:55.383648 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-12bafb70-7262-4d23-84e2-4b722bcbf194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:55.402143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:55.533612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777abfac-a7aa-49d2-b4b5-a29c7d6f8f5e admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:55.548676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c86c5-9d93-4bfb-ab76-7df1a540169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:55.549305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c86c5-9d93-4bfb-ab76-7df1a540169c admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:55.549595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c86c5-9d93-4bfb-ab76-7df1a540169c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:55.550199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c86c5-9d93-4bfb-ab76-7df1a540169c admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:55.550725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c86c5-9d93-4bfb-ab76-7df1a540169c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:55.551759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bafb70-7262-4d23-84e2-4b722bcbf194 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:55.552400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c86c5-9d93-4bfb-ab76-7df1a540169c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:55.580835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 849/1688] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:55.581157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c86c5-9d93-4bfb-ab76-7df1a540169c admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:55.621610 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c86c5-9d93-4bfb-ab76-7df1a540169c admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:55.640143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145734dc-f5fc-4d85-9f41-86b3fe278b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:55.640946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145734dc-f5fc-4d85-9f41-86b3fe278b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:55.641204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145734dc-f5fc-4d85-9f41-86b3fe278b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:55.641479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145734dc-f5fc-4d85-9f41-86b3fe278b7a admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:55.642182 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145734dc-f5fc-4d85-9f41-86b3fe278b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:55.644407 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145734dc-f5fc-4d85-9f41-86b3fe278b7a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:55.693091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea833907-5395-467d-9135-a143615d5fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:55.695548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833907-5395-467d-9135-a143615d5fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:55.696797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833907-5395-467d-9135-a143615d5fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:55.699157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833907-5395-467d-9135-a143615d5fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:55.703370 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 850/1689] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:55 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:04:55.707465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145734dc-f5fc-4d85-9f41-86b3fe278b7a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:55.726687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea833907-5395-467d-9135-a143615d5fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:55.728555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea833907-5395-467d-9135-a143615d5fb9 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:55.745340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 840/1690] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:55.746622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea833907-5395-467d-9135-a143615d5fb9 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:55.748975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145734dc-f5fc-4d85-9f41-86b3fe278b7a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:55.763459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea833907-5395-467d-9135-a143615d5fb9 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:55.771586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3488c-4da9-47df-a6bc-fbd8ee3d9351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:55.774140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3488c-4da9-47df-a6bc-fbd8ee3d9351 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:55.775164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3488c-4da9-47df-a6bc-fbd8ee3d9351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:55.775610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3488c-4da9-47df-a6bc-fbd8ee3d9351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:55.776558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3488c-4da9-47df-a6bc-fbd8ee3d9351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:55.776668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23353d-71bc-4f71-be6f-fde02c418c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:55.777594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23353d-71bc-4f71-be6f-fde02c418c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:55.777765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23353d-71bc-4f71-be6f-fde02c418c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:55.778040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23353d-71bc-4f71-be6f-fde02c418c7f admin admin] PATH_INFO: `/v3/projects/5bf2d13c960f4d3592f608d41cb2fdf1/users/0563cbd51ff146a6bdb0171ffafbce84/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:55.780487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3488c-4da9-47df-a6bc-fbd8ee3d9351 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:55.801788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 841/1691] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:55.805772 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3488c-4da9-47df-a6bc-fbd8ee3d9351 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:55.821223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3488c-4da9-47df-a6bc-fbd8ee3d9351 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:55.821771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23353d-71bc-4f71-be6f-fde02c418c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf2d13c960f4d3592f608d41cb2fdf1, user_id=0563cbd51ff146a6bdb0171ffafbce84, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:55.824334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23353d-71bc-4f71-be6f-fde02c418c7f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:55.827010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:55.827825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99eb12-4b07-4c53-bd66-e66e092b28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:55.828764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99eb12-4b07-4c53-bd66-e66e092b28d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:55.829073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99eb12-4b07-4c53-bd66-e66e092b28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:55.829545 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99eb12-4b07-4c53-bd66-e66e092b28d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:55.830392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99eb12-4b07-4c53-bd66-e66e092b28d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:55.836110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99eb12-4b07-4c53-bd66-e66e092b28d4 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:55.854800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 842/1692] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:55.864538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 851/1693] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:55 2022] PUT /identity/v3/projects/5bf2d13c960f4d3592f608d41cb2fdf1/users/0563cbd51ff146a6bdb0171ffafbce84/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:55.872035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99eb12-4b07-4c53-bd66-e66e092b28d4 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:55.879021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a642-eaf6-47aa-8522-d5a5f286022e None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:55.879480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a642-eaf6-47aa-8522-d5a5f286022e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:55.881076 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a642-eaf6-47aa-8522-d5a5f286022e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:55.894210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99eb12-4b07-4c53-bd66-e66e092b28d4 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:55.959598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-09e1a642-eaf6-47aa-8522-d5a5f286022e None None] MFA Rules not processed for user `0563cbd51ff146a6bdb0171ffafbce84`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:55.965082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-09e1a642-eaf6-47aa-8522-d5a5f286022e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:56.051177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2741-a53a-4ddf-a98b-5357bfe0bd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:56.054473 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2741-a53a-4ddf-a98b-5357bfe0bd5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:56.055008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2741-a53a-4ddf-a98b-5357bfe0bd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:56.055405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2741-a53a-4ddf-a98b-5357bfe0bd5f admin admin] PATH_INFO: `/v3/projects/7a1011e77b1f4f9da2c4b8254578ceff/users/53325323c41e4310bec02b6f8add2ee1/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:56.109784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b2741-a53a-4ddf-a98b-5357bfe0bd5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1011e77b1f4f9da2c4b8254578ceff, user_id=53325323c41e4310bec02b6f8add2ee1, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:56.115677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b2741-a53a-4ddf-a98b-5357bfe0bd5f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:56.167729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 843/1694] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:55 2022] PUT /identity/v3/projects/7a1011e77b1f4f9da2c4b8254578ceff/users/53325323c41e4310bec02b6f8add2ee1/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:56.186332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaea4d-db8f-4492-b500-957d666a3dba None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:56.189093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaea4d-db8f-4492-b500-957d666a3dba None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:56.189761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaea4d-db8f-4492-b500-957d666a3dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:56.229803 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 852/1695] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:55 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:56.230942 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a642-eaf6-47aa-8522-d5a5f286022e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:56.255797 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a642-eaf6-47aa-8522-d5a5f286022e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:56.280053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-bedaea4d-db8f-4492-b500-957d666a3dba None None] MFA Rules not processed for user `53325323c41e4310bec02b6f8add2ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:56.289287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-bedaea4d-db8f-4492-b500-957d666a3dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:56.327925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:56.335675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb2ac-1873-4724-997c-36d5a21c1998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:56.336495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb2ac-1873-4724-997c-36d5a21c1998 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:56.337017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb2ac-1873-4724-997c-36d5a21c1998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:56.337327 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bb2ac-1873-4724-997c-36d5a21c1998 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:56.339689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bb2ac-1873-4724-997c-36d5a21c1998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:56.344532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bb2ac-1873-4724-997c-36d5a21c1998 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:56.406279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 853/1696] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:56 2022] POST /identity/v3/projects => generated 355 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:04:56.410031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb2ac-1873-4724-997c-36d5a21c1998 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:56.583751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bb2ac-1873-4724-997c-36d5a21c1998 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:56.607855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f4758-006f-4a7c-a755-f7020e4500bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:56.608587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f4758-006f-4a7c-a755-f7020e4500bb admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:56.608871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f4758-006f-4a7c-a755-f7020e4500bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:56.609212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f4758-006f-4a7c-a755-f7020e4500bb admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:56.609940 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f4758-006f-4a7c-a755-f7020e4500bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:56.611984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f4758-006f-4a7c-a755-f7020e4500bb admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:56.648489 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:56.661124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 854/1697] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:56 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:04:56.670100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f4758-006f-4a7c-a755-f7020e4500bb admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:56.680619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f4758-006f-4a7c-a755-f7020e4500bb admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:56.703360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c3bfc-a98b-4f24-93f3-39def99800d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:56.704058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c3bfc-a98b-4f24-93f3-39def99800d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:56.704345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c3bfc-a98b-4f24-93f3-39def99800d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:56.704622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c3bfc-a98b-4f24-93f3-39def99800d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:56.705381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c3bfc-a98b-4f24-93f3-39def99800d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:56.707073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c3bfc-a98b-4f24-93f3-39def99800d9 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:56.736558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 855/1698] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:56.737536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c3bfc-a98b-4f24-93f3-39def99800d9 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:56.761477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c3bfc-a98b-4f24-93f3-39def99800d9 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:56.774096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea372d-4cce-452f-8c21-fd10811bddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:56.775131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea372d-4cce-452f-8c21-fd10811bddf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:56.775419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea372d-4cce-452f-8c21-fd10811bddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:56.775593 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea372d-4cce-452f-8c21-fd10811bddf0 admin admin] PATH_INFO: `/v3/projects/8a351be7dbce4308aabda439e1c53f97/users/70bd79b482004a11b45a710026a301f1/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:56.828118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea372d-4cce-452f-8c21-fd10811bddf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a351be7dbce4308aabda439e1c53f97, user_id=70bd79b482004a11b45a710026a301f1, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:56.831553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea372d-4cce-452f-8c21-fd10811bddf0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:56.833556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 844/1699] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 652 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:56.840147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaea4d-db8f-4492-b500-957d666a3dba None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:56.859361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaea4d-db8f-4492-b500-957d666a3dba None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:56.876269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 856/1700] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:56 2022] PUT /identity/v3/projects/8a351be7dbce4308aabda439e1c53f97/users/70bd79b482004a11b45a710026a301f1/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:56.879923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea372d-4cce-452f-8c21-fd10811bddf0 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:56.985172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ef5ad-935e-4b66-9266-bd2c5ed6836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:56.986093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ef5ad-935e-4b66-9266-bd2c5ed6836f admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:56.986577 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ef5ad-935e-4b66-9266-bd2c5ed6836f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:56.987095 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ef5ad-935e-4b66-9266-bd2c5ed6836f admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:56.988403 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ef5ad-935e-4b66-9266-bd2c5ed6836f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:56.994782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ef5ad-935e-4b66-9266-bd2c5ed6836f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:56.998731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea372d-4cce-452f-8c21-fd10811bddf0 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:57.013973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1571a-60c8-43bb-8c66-a05513913b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:57.014740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1571a-60c8-43bb-8c66-a05513913b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:57.015144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1571a-60c8-43bb-8c66-a05513913b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:57.015781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1571a-60c8-43bb-8c66-a05513913b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:57.016232 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1571a-60c8-43bb-8c66-a05513913b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:57.018178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1571a-60c8-43bb-8c66-a05513913b54 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:57.045278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 857/1701] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:04:57.047722 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1571a-60c8-43bb-8c66-a05513913b54 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:57.063547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 845/1702] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:04:56 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:04:57.064784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ef5ad-935e-4b66-9266-bd2c5ed6836f admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:57.069759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1571a-60c8-43bb-8c66-a05513913b54 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:57.189079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06560462-b97d-407d-9791-c2881d4e256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:57.190277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06560462-b97d-407d-9791-c2881d4e256b admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:57.190747 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06560462-b97d-407d-9791-c2881d4e256b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:57.191276 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06560462-b97d-407d-9791-c2881d4e256b admin admin] PATH_INFO: `/v3/projects/8a351be7dbce4308aabda439e1c53f97/users/70bd79b482004a11b45a710026a301f1/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:57.194742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06560462-b97d-407d-9791-c2881d4e256b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a351be7dbce4308aabda439e1c53f97, user_id=70bd79b482004a11b45a710026a301f1, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:57.202610 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06560462-b97d-407d-9791-c2881d4e256b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:57.212081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ef5ad-935e-4b66-9266-bd2c5ed6836f admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:57.224689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94e9da-7b7b-4a59-babe-cfe4735e0953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:57.225480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e9da-7b7b-4a59-babe-cfe4735e0953 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:57.225831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e9da-7b7b-4a59-babe-cfe4735e0953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:57.226175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e9da-7b7b-4a59-babe-cfe4735e0953 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:57.226973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94e9da-7b7b-4a59-babe-cfe4735e0953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:57.229167 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 858/1703] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:57 2022] PUT /identity/v3/projects/8a351be7dbce4308aabda439e1c53f97/users/70bd79b482004a11b45a710026a301f1/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:57.229589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94e9da-7b7b-4a59-babe-cfe4735e0953 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:57.239131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c28da-734d-41ae-af56-bba0c18258ee None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:57.239624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c28da-734d-41ae-af56-bba0c18258ee None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:57.240461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c28da-734d-41ae-af56-bba0c18258ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:57.275990 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 846/1704] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:04:57 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:04:57.280819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94e9da-7b7b-4a59-babe-cfe4735e0953 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:57.307746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94e9da-7b7b-4a59-babe-cfe4735e0953 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:57.311076 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-c61c28da-734d-41ae-af56-bba0c18258ee None None] MFA Rules not processed for user `70bd79b482004a11b45a710026a301f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:57.318038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c61c28da-734d-41ae-af56-bba0c18258ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:57.398202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:57.458494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:57.511911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee0017-8dae-4359-92bb-048af0ee8284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:57.515603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0017-8dae-4359-92bb-048af0ee8284 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:57.517223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0017-8dae-4359-92bb-048af0ee8284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:57.517517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0017-8dae-4359-92bb-048af0ee8284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:57.518627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee0017-8dae-4359-92bb-048af0ee8284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:57.523848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee0017-8dae-4359-92bb-048af0ee8284 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:57.549140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 847/1705] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:04:57.555430 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee0017-8dae-4359-92bb-048af0ee8284 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:57.560217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 859/1706] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:57 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:57.561646 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c28da-734d-41ae-af56-bba0c18258ee None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:57.575188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cdee0017-8dae-4359-92bb-048af0ee8284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:57.632828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c28da-734d-41ae-af56-bba0c18258ee None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:57.643970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee0017-8dae-4359-92bb-048af0ee8284 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:57.647322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc01b-37d3-4d0c-b5ec-5b21f528a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:57.652520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc01b-37d3-4d0c-b5ec-5b21f528a3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:57.652827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc01b-37d3-4d0c-b5ec-5b21f528a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:57.653118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc01b-37d3-4d0c-b5ec-5b21f528a3ca admin admin] PATH_INFO: `/v3/projects/1bc03b3f16424c90a8777ad80ccfce54/users/df6ee3b64a014623af4d6742cb81d609/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:57.674524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:57.675513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:57.676332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:57.676633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] PATH_INFO: `/v3/projects/24ab9724a74c43e1b0b12a3a8d63cd3b` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:57.678726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ab9724a74c43e1b0b12a3a8d63cd3b)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:57.680786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:57.708187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc01b-37d3-4d0c-b5ec-5b21f528a3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc03b3f16424c90a8777ad80ccfce54, user_id=df6ee3b64a014623af4d6742cb81d609, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:57.714417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc01b-37d3-4d0c-b5ec-5b21f528a3ca admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:57.742415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 860/1707] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:57 2022] PUT /identity/v3/projects/1bc03b3f16424c90a8777ad80ccfce54/users/df6ee3b64a014623af4d6742cb81d609/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:57.746233 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc01b-37d3-4d0c-b5ec-5b21f528a3ca admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:57.750785 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-48ffc01b-37d3-4d0c-b5ec-5b21f528a3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:57.824629 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ab9724a74c43e1b0b12a3a8d63cd3b', 'request_id': 'req-617fb6a1-331e-4d01-a217-07d4b13ed7a3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:57.835871 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ab9724a74c43e1b0b12a3a8d63cd3b', 'request_id': 'req-617fb6a1-331e-4d01-a217-07d4b13ed7a3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:57.858203 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ab9724a74c43e1b0b12a3a8d63cd3b', 'request_id': 'req-617fb6a1-331e-4d01-a217-07d4b13ed7a3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:57.882803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] The token cache is being invalidate because project 24ab9724a74c43e1b0b12a3a8d63cd3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:04:57.883151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:57.887230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:57.895339 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 848/1708] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:04:57 2022] DELETE /identity/v3/projects/24ab9724a74c43e1b0b12a3a8d63cd3b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:57.896490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:57.898888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:57.921299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc01b-37d3-4d0c-b5ec-5b21f528a3ca admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:58.010896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fb6a1-331e-4d01-a217-07d4b13ed7a3 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:58.029124 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957b13b-ac2f-48fb-b516-4868e7d9bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:58.030135 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957b13b-ac2f-48fb-b516-4868e7d9bfab admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:58.030561 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957b13b-ac2f-48fb-b516-4868e7d9bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:58.030894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957b13b-ac2f-48fb-b516-4868e7d9bfab admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:58.031870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957b13b-ac2f-48fb-b516-4868e7d9bfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:58.033822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957b13b-ac2f-48fb-b516-4868e7d9bfab admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:58.040178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8200-5ed3-4491-97c9-4d689ed73c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:58.041505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8200-5ed3-4491-97c9-4d689ed73c43 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:58.047705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8200-5ed3-4491-97c9-4d689ed73c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:58.048286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8200-5ed3-4491-97c9-4d689ed73c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:58.052283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7b0e8200-5ed3-4491-97c9-4d689ed73c43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:58.079157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 849/1709] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:04:58.080791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957b13b-ac2f-48fb-b516-4868e7d9bfab admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:58.083071 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9957b13b-ac2f-48fb-b516-4868e7d9bfab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:58.099175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957b13b-ac2f-48fb-b516-4868e7d9bfab admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:58.104671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc58cbe-17e9-4875-b451-db7b6359bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:58.105579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc58cbe-17e9-4875-b451-db7b6359bde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:58.105860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc58cbe-17e9-4875-b451-db7b6359bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:58.106138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc58cbe-17e9-4875-b451-db7b6359bde7 admin admin] PATH_INFO: `/v3/users/bba39dedc1094360a452c293b8387ac9` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:58.107622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc58cbe-17e9-4875-b451-db7b6359bde7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba39dedc1094360a452c293b8387ac9)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:58.110365 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc58cbe-17e9-4875-b451-db7b6359bde7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:58.225763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e8200-5ed3-4491-97c9-4d689ed73c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:58.228272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:58.232992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e8200-5ed3-4491-97c9-4d689ed73c43 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:58.236592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-dcc58cbe-17e9-4875-b451-db7b6359bde7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba39dedc1094360a452c293b8387ac9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:58.272616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 861/1710] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:57 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:58.273500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8200-5ed3-4491-97c9-4d689ed73c43 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:58.280216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-dcc58cbe-17e9-4875-b451-db7b6359bde7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba39dedc1094360a452c293b8387ac9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:58.281017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-dcc58cbe-17e9-4875-b451-db7b6359bde7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba39dedc1094360a452c293b8387ac9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:58.300519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-dcc58cbe-17e9-4875-b451-db7b6359bde7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba39dedc1094360a452c293b8387ac9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:58.301410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-dcc58cbe-17e9-4875-b451-db7b6359bde7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba39dedc1094360a452c293b8387ac9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:58.312986 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8200-5ed3-4491-97c9-4d689ed73c43 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:58.323973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9de5d7-1fe8-4999-bdd2-8783d72ab2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:58.324905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de5d7-1fe8-4999-bdd2-8783d72ab2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:58.325191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de5d7-1fe8-4999-bdd2-8783d72ab2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:58.325478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de5d7-1fe8-4999-bdd2-8783d72ab2b1 admin admin] PATH_INFO: `/v3/projects/1bc03b3f16424c90a8777ad80ccfce54/users/df6ee3b64a014623af4d6742cb81d609/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:58.331772 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9de5d7-1fe8-4999-bdd2-8783d72ab2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc03b3f16424c90a8777ad80ccfce54, user_id=df6ee3b64a014623af4d6742cb81d609, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:58.341291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 850/1711] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:04:58 2022] DELETE /identity/v3/users/bba39dedc1094360a452c293b8387ac9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:58.351823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9de5d7-1fe8-4999-bdd2-8783d72ab2b1 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:58.384257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 862/1712] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:04:58 2022] PUT /identity/v3/projects/1bc03b3f16424c90a8777ad80ccfce54/users/df6ee3b64a014623af4d6742cb81d609/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:58.396685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4983e-cb49-447d-91e0-940f5aaf9e0c None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:58.397063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4983e-cb49-447d-91e0-940f5aaf9e0c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:58.397256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4983e-cb49-447d-91e0-940f5aaf9e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:58.447945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-10f4983e-cb49-447d-91e0-940f5aaf9e0c None None] MFA Rules not processed for user `df6ee3b64a014623af4d6742cb81d609`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:58.450182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-10f4983e-cb49-447d-91e0-940f5aaf9e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:58.463816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9de5d7-1fe8-4999-bdd2-8783d72ab2b1 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:58.466218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-bd9de5d7-1fe8-4999-bdd2-8783d72ab2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:58.490119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:58.645227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9de5d7-1fe8-4999-bdd2-8783d72ab2b1 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:58.663779 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c375-21ab-492e-a727-e4752c8b2728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:58.664844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c375-21ab-492e-a727-e4752c8b2728 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:58.665132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c375-21ab-492e-a727-e4752c8b2728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:58.665416 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c375-21ab-492e-a727-e4752c8b2728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:58.669440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 851/1713] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:58.670336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4983e-cb49-447d-91e0-940f5aaf9e0c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:58.670782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1e20c375-21ab-492e-a727-e4752c8b2728 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:58.675842 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-10f4983e-cb49-447d-91e0-940f5aaf9e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:58.839687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4983e-cb49-447d-91e0-940f5aaf9e0c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:58.847925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20c375-21ab-492e-a727-e4752c8b2728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:58.851099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d39645-3468-42f4-965e-4f566c6abde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:58.852001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39645-3468-42f4-965e-4f566c6abde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:58.852278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39645-3468-42f4-965e-4f566c6abde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:58.852550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39645-3468-42f4-965e-4f566c6abde1 admin admin] PATH_INFO: `/v3/users/28e1b6aae87e4c398ce214e6311ba075` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:58.854000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20c375-21ab-492e-a727-e4752c8b2728 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:58.855871 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d39645-3468-42f4-965e-4f566c6abde1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e1b6aae87e4c398ce214e6311ba075)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:58.857826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d39645-3468-42f4-965e-4f566c6abde1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:58.893134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 863/1714] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:58 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:04:58.952996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c375-21ab-492e-a727-e4752c8b2728 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:58.955155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1e20c375-21ab-492e-a727-e4752c8b2728 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:58.985136 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c375-21ab-492e-a727-e4752c8b2728 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:59.006384 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0a254-afcb-4ac7-b72f-abb856b764a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:59.007573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0a254-afcb-4ac7-b72f-abb856b764a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:59.009344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0a254-afcb-4ac7-b72f-abb856b764a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:59.009851 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0a254-afcb-4ac7-b72f-abb856b764a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:59.019471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:59.022759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-aaa0a254-afcb-4ac7-b72f-abb856b764a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:59.023924 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c1d39645-3468-42f4-965e-4f566c6abde1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e1b6aae87e4c398ce214e6311ba075'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:59.086057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c1d39645-3468-42f4-965e-4f566c6abde1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e1b6aae87e4c398ce214e6311ba075'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:59.088952 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c1d39645-3468-42f4-965e-4f566c6abde1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e1b6aae87e4c398ce214e6311ba075'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:59.136707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c1d39645-3468-42f4-965e-4f566c6abde1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e1b6aae87e4c398ce214e6311ba075'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:59.139370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c1d39645-3468-42f4-965e-4f566c6abde1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e1b6aae87e4c398ce214e6311ba075'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:04:59.187330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 852/1715] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:04:58 2022] DELETE /identity/v3/users/28e1b6aae87e4c398ce214e6311ba075 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:04:59.189683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c85e-4fce-44e1-b2a1-a2896535f617 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:59.190010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c85e-4fce-44e1-b2a1-a2896535f617 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:59.190442 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c85e-4fce-44e1-b2a1-a2896535f617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:59.209392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0a254-afcb-4ac7-b72f-abb856b764a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:59.211749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0a254-afcb-4ac7-b72f-abb856b764a1 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:59.245129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 864/1716] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:04:59.250967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8f0fb-ab90-4baa-95e3-3b9669cb7ca5 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:59.251603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8f0fb-ab90-4baa-95e3-3b9669cb7ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:59.251603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8f0fb-ab90-4baa-95e3-3b9669cb7ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:59.281472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-45d8c85e-4fce-44e1-b2a1-a2896535f617 None None] MFA Rules not processed for user `62f614b02ced4c4fae0fc0853ed66431`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:59.290485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-45d8c85e-4fce-44e1-b2a1-a2896535f617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:59.325153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-77f8f0fb-ab90-4baa-95e3-3b9669cb7ca5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:04:59.330215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-77f8f0fb-ab90-4baa-95e3-3b9669cb7ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:59.536379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 853/1717] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:59.548325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:04:59.552326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8c85e-4fce-44e1-b2a1-a2896535f617 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:59.553810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-45d8c85e-4fce-44e1-b2a1-a2896535f617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:59.571797 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 865/1718] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:04:59.715765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8c85e-4fce-44e1-b2a1-a2896535f617 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:59.735490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d82df7-ba08-45d7-8813-d810440a6e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:59.736180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82df7-ba08-45d7-8813-d810440a6e6e service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:59.736580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82df7-ba08-45d7-8813-d810440a6e6e service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:59.736923 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82df7-ba08-45d7-8813-d810440a6e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:59.759547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d82df7-ba08-45d7-8813-d810440a6e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:59.768994 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d82df7-ba08-45d7-8813-d810440a6e6e service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:04:59.799237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 854/1719] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:04:59.841512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8f0fb-ab90-4baa-95e3-3b9669cb7ca5 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:59.846752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-77f8f0fb-ab90-4baa-95e3-3b9669cb7ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:59.871302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d82df7-ba08-45d7-8813-d810440a6e6e service nova] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:04:59.873487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-95d82df7-ba08-45d7-8813-d810440a6e6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:04:59.925300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d82df7-ba08-45d7-8813-d810440a6e6e service nova] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:04:59.951511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:04:59.957216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:04:59.959558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:04:59.960116 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] PATH_INFO: `/v3/projects/595017788ab94a9085a8de0f8616cc47` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:04:59.968003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=595017788ab94a9085a8de0f8616cc47)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:04:59.974678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:00.046389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8f0fb-ab90-4baa-95e3-3b9669cb7ca5 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:00.055996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30752-9e6f-4db6-8b30-436d2ebea97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:00.056758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30752-9e6f-4db6-8b30-436d2ebea97a service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:00.057108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30752-9e6f-4db6-8b30-436d2ebea97a service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:00.057471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30752-9e6f-4db6-8b30-436d2ebea97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:00.089124 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a30752-9e6f-4db6-8b30-436d2ebea97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:00.090898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a30752-9e6f-4db6-8b30-436d2ebea97a service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:00.116794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 866/1720] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:00.130717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:00.205271 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '595017788ab94a9085a8de0f8616cc47', 'request_id': 'req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:00.243459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '595017788ab94a9085a8de0f8616cc47', 'request_id': 'req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:00.260179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '595017788ab94a9085a8de0f8616cc47', 'request_id': 'req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:00.301698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] The token cache is being invalidate because project 595017788ab94a9085a8de0f8616cc47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:00.301698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:00.302879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-12755b1b-3b47-4e21-9ee9-3ac7c8e2b764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:00.304935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 855/1721] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:04:59 2022] DELETE /identity/v3/projects/595017788ab94a9085a8de0f8616cc47 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:00.315506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44c500-ac9b-4f81-b8cc-39efdd0aec8c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:00.316327 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44c500-ac9b-4f81-b8cc-39efdd0aec8c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:00.317200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44c500-ac9b-4f81-b8cc-39efdd0aec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:00.381764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-0c44c500-ac9b-4f81-b8cc-39efdd0aec8c None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:00.386797 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-0c44c500-ac9b-4f81-b8cc-39efdd0aec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:00.574229 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 867/1722] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:00.584746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b9f6-aba1-4a16-b63f-029eb46734fb None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:00.585198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b9f6-aba1-4a16-b63f-029eb46734fb None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:00.585883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b9f6-aba1-4a16-b63f-029eb46734fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:00.614057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-6524b9f6-aba1-4a16-b63f-029eb46734fb None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:00.616100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6524b9f6-aba1-4a16-b63f-029eb46734fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:00.644332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 856/1723] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:00.648682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44c500-ac9b-4f81-b8cc-39efdd0aec8c None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:00.662095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44c500-ac9b-4f81-b8cc-39efdd0aec8c None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:00.676221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc4fee-6dcd-472e-8069-20317eb5fc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:00.677083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc4fee-6dcd-472e-8069-20317eb5fc6f admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:00.677459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc4fee-6dcd-472e-8069-20317eb5fc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:00.678613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc4fee-6dcd-472e-8069-20317eb5fc6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:00.679696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc4fee-6dcd-472e-8069-20317eb5fc6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:00.680112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc4fee-6dcd-472e-8069-20317eb5fc6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:00.682014 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc4fee-6dcd-472e-8069-20317eb5fc6f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:00.744139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524b9f6-aba1-4a16-b63f-029eb46734fb None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:00.744307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 868/1724] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:00.776959 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524b9f6-aba1-4a16-b63f-029eb46734fb None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:00.797594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232975e-a679-49d6-9f07-9c4994168083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:00.798736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232975e-a679-49d6-9f07-9c4994168083 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:00.802066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232975e-a679-49d6-9f07-9c4994168083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:00.805027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232975e-a679-49d6-9f07-9c4994168083 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:00.810861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232975e-a679-49d6-9f07-9c4994168083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:00.815755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232975e-a679-49d6-9f07-9c4994168083 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:00.865148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc4fee-6dcd-472e-8069-20317eb5fc6f admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:00.870868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b2dc4fee-6dcd-472e-8069-20317eb5fc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:00.893771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc4fee-6dcd-472e-8069-20317eb5fc6f admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:00.898158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 857/1725] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:00 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:00.902709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232975e-a679-49d6-9f07-9c4994168083 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:01.063373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232975e-a679-49d6-9f07-9c4994168083 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:01.074722 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:01.075789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:01.076202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:01.076538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] PATH_INFO: `/v3/projects/94b6a37bb6d0430fae8c367370803894` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:01.078582 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b6a37bb6d0430fae8c367370803894)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:01.079027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68354cdb-2887-446d-b959-933ea1e5cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:01.079891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354cdb-2887-446d-b959-933ea1e5cb9c admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:01.080265 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354cdb-2887-446d-b959-933ea1e5cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:01.080590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:01.080697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354cdb-2887-446d-b959-933ea1e5cb9c admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:01.081500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354cdb-2887-446d-b959-933ea1e5cb9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:01.083563 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354cdb-2887-446d-b959-933ea1e5cb9c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:01.130219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 858/1726] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:00 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:01.133705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68354cdb-2887-446d-b959-933ea1e5cb9c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:01.155326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68354cdb-2887-446d-b959-933ea1e5cb9c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:01.169179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e750b-6f18-48bb-97c6-93fd115e9a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:01.169963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e750b-6f18-48bb-97c6-93fd115e9a34 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:01.170337 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e750b-6f18-48bb-97c6-93fd115e9a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:01.170706 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e750b-6f18-48bb-97c6-93fd115e9a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:01.171572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e750b-6f18-48bb-97c6-93fd115e9a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:01.173305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e750b-6f18-48bb-97c6-93fd115e9a34 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:01.201346 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 859/1727] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:01.209047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e750b-6f18-48bb-97c6-93fd115e9a34 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:01.213363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:01.238030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e750b-6f18-48bb-97c6-93fd115e9a34 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:01.251929 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b6a37bb6d0430fae8c367370803894', 'request_id': 'req-273c5848-85ce-4b9b-a6b1-332c72b0d133'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:01.273360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b6a37bb6d0430fae8c367370803894', 'request_id': 'req-273c5848-85ce-4b9b-a6b1-332c72b0d133'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:01.303255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b6a37bb6d0430fae8c367370803894', 'request_id': 'req-273c5848-85ce-4b9b-a6b1-332c72b0d133'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:01.357334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] The token cache is being invalidate because project 94b6a37bb6d0430fae8c367370803894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:01.357642 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:01.358401 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-273c5848-85ce-4b9b-a6b1-332c72b0d133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:01.366358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 869/1728] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:00 2022] DELETE /identity/v3/projects/94b6a37bb6d0430fae8c367370803894 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:01.370952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac009-bc31-4da2-a82d-fb07725a4a9b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:01.371267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac009-bc31-4da2-a82d-fb07725a4a9b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:01.371549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac009-bc31-4da2-a82d-fb07725a4a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:01.413220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ba1ac009-bc31-4da2-a82d-fb07725a4a9b None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:01.414823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ba1ac009-bc31-4da2-a82d-fb07725a4a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:01.447789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fed7e4-8166-47ea-a0a4-75265b07d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:01.449157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fed7e4-8166-47ea-a0a4-75265b07d325 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:01.449525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fed7e4-8166-47ea-a0a4-75265b07d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:01.450282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fed7e4-8166-47ea-a0a4-75265b07d325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:01.452930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fed7e4-8166-47ea-a0a4-75265b07d325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:01.457946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fed7e4-8166-47ea-a0a4-75265b07d325 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:01.516199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 860/1729] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:01.518713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fed7e4-8166-47ea-a0a4-75265b07d325 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:01.521842 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d2fed7e4-8166-47ea-a0a4-75265b07d325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:01.543514 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 870/1730] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:01.554733 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e40db6-9008-4f49-9d84-e1f6b8140481 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:01.555205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fed7e4-8166-47ea-a0a4-75265b07d325 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:01.563022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7d714-04e1-448e-addc-604d1f9f5ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:01.563989 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d714-04e1-448e-addc-604d1f9f5ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:01.564276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d714-04e1-448e-addc-604d1f9f5ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:01.565344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d714-04e1-448e-addc-604d1f9f5ea5 admin admin] PATH_INFO: `/v3/projects/36cd097bcdd841ff9464d2b4055a3cf5/users/d300066a023a483f93a63aa034cbb820/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:01.568932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e40db6-9008-4f49-9d84-e1f6b8140481 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:01.569358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e40db6-9008-4f49-9d84-e1f6b8140481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:01.571921 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:01.615860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7d714-04e1-448e-addc-604d1f9f5ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cd097bcdd841ff9464d2b4055a3cf5, user_id=d300066a023a483f93a63aa034cbb820, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:01.618320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-63e40db6-9008-4f49-9d84-e1f6b8140481 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:01.619757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-63e40db6-9008-4f49-9d84-e1f6b8140481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:01.628702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7d714-04e1-448e-addc-604d1f9f5ea5 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:01.635063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 871/1731] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:01.640257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e40db6-9008-4f49-9d84-e1f6b8140481 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:01.671883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 861/1732] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:01 2022] PUT /identity/v3/projects/36cd097bcdd841ff9464d2b4055a3cf5/users/d300066a023a483f93a63aa034cbb820/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:01.673613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e40db6-9008-4f49-9d84-e1f6b8140481 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:01.682789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606526d2-2c96-40a7-b399-17867a213205 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:01.683110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606526d2-2c96-40a7-b399-17867a213205 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:01.683435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606526d2-2c96-40a7-b399-17867a213205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:01.743031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-606526d2-2c96-40a7-b399-17867a213205 None None] MFA Rules not processed for user `d300066a023a483f93a63aa034cbb820`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:01.746369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-606526d2-2c96-40a7-b399-17867a213205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:01.843297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e852c-e448-4a79-adbb-7f2dd8f44e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:01.847192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e852c-e448-4a79-adbb-7f2dd8f44e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:01.849271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e852c-e448-4a79-adbb-7f2dd8f44e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:01.850530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e852c-e448-4a79-adbb-7f2dd8f44e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:01.851910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e852c-e448-4a79-adbb-7f2dd8f44e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:01.852732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e852c-e448-4a79-adbb-7f2dd8f44e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:01.856171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e852c-e448-4a79-adbb-7f2dd8f44e42 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:01.906186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 872/1733] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:01.910689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e852c-e448-4a79-adbb-7f2dd8f44e42 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:01.954184 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e852c-e448-4a79-adbb-7f2dd8f44e42 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:01.968884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa125b6-1ee1-444a-a47b-6eab30f8363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:01.969576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa125b6-1ee1-444a-a47b-6eab30f8363b admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:01.969856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa125b6-1ee1-444a-a47b-6eab30f8363b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:01.970129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa125b6-1ee1-444a-a47b-6eab30f8363b admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:01.974324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa125b6-1ee1-444a-a47b-6eab30f8363b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:01.983753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa125b6-1ee1-444a-a47b-6eab30f8363b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:01.987164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 862/1734] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:01.992279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606526d2-2c96-40a7-b399-17867a213205 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:02.027925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606526d2-2c96-40a7-b399-17867a213205 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:02.037512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76811383-d23a-4ae0-9e9e-5147cd9e7c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:02.038445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811383-d23a-4ae0-9e9e-5147cd9e7c17 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:02.038930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811383-d23a-4ae0-9e9e-5147cd9e7c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:02.039782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811383-d23a-4ae0-9e9e-5147cd9e7c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:02.042498 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76811383-d23a-4ae0-9e9e-5147cd9e7c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:02.051703 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76811383-d23a-4ae0-9e9e-5147cd9e7c17 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:02.062153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 873/1735] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:01 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:02.062153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa125b6-1ee1-444a-a47b-6eab30f8363b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:02.135768 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 863/1736] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:01 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:02.142120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76811383-d23a-4ae0-9e9e-5147cd9e7c17 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:02.176959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:02.326832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa125b6-1ee1-444a-a47b-6eab30f8363b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:02.413217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76811383-d23a-4ae0-9e9e-5147cd9e7c17 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:02.427678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deceb8-31c8-45fc-a3de-21381b6e521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:02.428496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deceb8-31c8-45fc-a3de-21381b6e521c admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:02.429939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deceb8-31c8-45fc-a3de-21381b6e521c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:02.431257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deceb8-31c8-45fc-a3de-21381b6e521c admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:02.433133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deceb8-31c8-45fc-a3de-21381b6e521c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:02.438344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deceb8-31c8-45fc-a3de-21381b6e521c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:02.508234 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 864/1737] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:02 2022] POST /identity/v3/users => generated 290 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:02.513684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deceb8-31c8-45fc-a3de-21381b6e521c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:02.532311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa80b19-be60-4ac8-a0f5-5bc3a7128683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:02.533131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa80b19-be60-4ac8-a0f5-5bc3a7128683 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:02.535290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa80b19-be60-4ac8-a0f5-5bc3a7128683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:02.536346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa80b19-be60-4ac8-a0f5-5bc3a7128683 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:02.538391 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa80b19-be60-4ac8-a0f5-5bc3a7128683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:02.544975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deceb8-31c8-45fc-a3de-21381b6e521c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:02.545122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa80b19-be60-4ac8-a0f5-5bc3a7128683 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:02.554266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aab076-2d8f-446f-9e46-41edb5c28815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:02.557329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aab076-2d8f-446f-9e46-41edb5c28815 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:02.557742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aab076-2d8f-446f-9e46-41edb5c28815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:02.558135 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aab076-2d8f-446f-9e46-41edb5c28815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:02.560275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aab076-2d8f-446f-9e46-41edb5c28815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:02.563349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aab076-2d8f-446f-9e46-41edb5c28815 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:02.589817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 865/1738] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:02.591075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aab076-2d8f-446f-9e46-41edb5c28815 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:02.608509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 874/1739] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:02 2022] POST /identity/v3/users => generated 294 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:02.614699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa80b19-be60-4ac8-a0f5-5bc3a7128683 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:02.616474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aab076-2d8f-446f-9e46-41edb5c28815 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:02.629539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa80b19-be60-4ac8-a0f5-5bc3a7128683 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:02.633731 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a00068-f3c6-4c15-97ad-9bdf46e3b484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:02.634751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a00068-f3c6-4c15-97ad-9bdf46e3b484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:02.635223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a00068-f3c6-4c15-97ad-9bdf46e3b484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:02.635627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a00068-f3c6-4c15-97ad-9bdf46e3b484 admin admin] PATH_INFO: `/v3/projects/472162c3449a4b0a842f3279f977dd8a/users/32e3f9c9bf31420c8298f6273f7dc560/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:02.652397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d242825-efe2-4b76-9a9b-5a4a07b166ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:02.654460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242825-efe2-4b76-9a9b-5a4a07b166ec admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:02.654816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242825-efe2-4b76-9a9b-5a4a07b166ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:02.655220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242825-efe2-4b76-9a9b-5a4a07b166ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:02.656142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d242825-efe2-4b76-9a9b-5a4a07b166ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:02.660711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d242825-efe2-4b76-9a9b-5a4a07b166ec admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:02.682603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a00068-f3c6-4c15-97ad-9bdf46e3b484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=472162c3449a4b0a842f3279f977dd8a, user_id=32e3f9c9bf31420c8298f6273f7dc560, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:02.686211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a00068-f3c6-4c15-97ad-9bdf46e3b484 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:02.710675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 875/1740] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:02.715776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d242825-efe2-4b76-9a9b-5a4a07b166ec admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:02.727778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 866/1741] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:02 2022] PUT /identity/v3/projects/472162c3449a4b0a842f3279f977dd8a/users/32e3f9c9bf31420c8298f6273f7dc560/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:02.729323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a00068-f3c6-4c15-97ad-9bdf46e3b484 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:02.748320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:02.750351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d242825-efe2-4b76-9a9b-5a4a07b166ec admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:02.912563 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a00068-f3c6-4c15-97ad-9bdf46e3b484 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:02.937150 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e224f34-7188-420a-94b5-1af04874529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:02.939694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e224f34-7188-420a-94b5-1af04874529c admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:02.940031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e224f34-7188-420a-94b5-1af04874529c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:02.940940 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e224f34-7188-420a-94b5-1af04874529c admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:02.943794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703abd24-0d63-452b-9a2d-dfbeda677890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:02.944170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e224f34-7188-420a-94b5-1af04874529c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:02.944608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703abd24-0d63-452b-9a2d-dfbeda677890 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:02.945586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703abd24-0d63-452b-9a2d-dfbeda677890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:02.946797 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703abd24-0d63-452b-9a2d-dfbeda677890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:02.948527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703abd24-0d63-452b-9a2d-dfbeda677890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:02.949621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e224f34-7188-420a-94b5-1af04874529c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:02.952409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703abd24-0d63-452b-9a2d-dfbeda677890 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:02.981978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 867/1742] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:02.987950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e224f34-7188-420a-94b5-1af04874529c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:02.989922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3e224f34-7188-420a-94b5-1af04874529c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:02.990119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 876/1743] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:02.991283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703abd24-0d63-452b-9a2d-dfbeda677890 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:03.030109 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703abd24-0d63-452b-9a2d-dfbeda677890 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:03.044512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36538b-54d6-4853-bf09-ccd884270403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:03.044512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36538b-54d6-4853-bf09-ccd884270403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:03.044512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36538b-54d6-4853-bf09-ccd884270403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:03.044512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36538b-54d6-4853-bf09-ccd884270403 admin admin] PATH_INFO: `/v3/projects/472162c3449a4b0a842f3279f977dd8a/users/32e3f9c9bf31420c8298f6273f7dc560/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:03.049959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36538b-54d6-4853-bf09-ccd884270403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=472162c3449a4b0a842f3279f977dd8a, user_id=32e3f9c9bf31420c8298f6273f7dc560, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:03.053215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36538b-54d6-4853-bf09-ccd884270403 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:03.081110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 877/1744] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:02 2022] PUT /identity/v3/projects/472162c3449a4b0a842f3279f977dd8a/users/32e3f9c9bf31420c8298f6273f7dc560/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:03.081943 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36538b-54d6-4853-bf09-ccd884270403 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:03.145897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e224f34-7188-420a-94b5-1af04874529c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:03.194457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:03.254916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36538b-54d6-4853-bf09-ccd884270403 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:03.267854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e5d98-880b-45c3-9b3d-d529888d6c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:03.268672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5d98-880b-45c3-9b3d-d529888d6c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:03.268788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5d98-880b-45c3-9b3d-d529888d6c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:03.269070 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e5d98-880b-45c3-9b3d-d529888d6c5f admin admin] PATH_INFO: `/v3/projects/b5e1cb84bb71458483595985b774c3c0/users/aad1b5c894414f6cb5399e457f15f87e/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:03.281975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbaae3-c9f7-4a49-a544-399ca49b7893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:03.284140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbaae3-c9f7-4a49-a544-399ca49b7893 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:03.286358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbaae3-c9f7-4a49-a544-399ca49b7893 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:03.286358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbaae3-c9f7-4a49-a544-399ca49b7893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:03.290067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-57dbaae3-c9f7-4a49-a544-399ca49b7893 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:03.308885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e5d98-880b-45c3-9b3d-d529888d6c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e1cb84bb71458483595985b774c3c0, user_id=aad1b5c894414f6cb5399e457f15f87e, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:03.311693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e5d98-880b-45c3-9b3d-d529888d6c5f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:03.344592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 878/1745] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:03 2022] PUT /identity/v3/projects/b5e1cb84bb71458483595985b774c3c0/users/aad1b5c894414f6cb5399e457f15f87e/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:03.348651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926643-48cf-4ef5-8065-ec98d8deec6c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:03.349714 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926643-48cf-4ef5-8065-ec98d8deec6c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:03.351050 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926643-48cf-4ef5-8065-ec98d8deec6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:03.407571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-18926643-48cf-4ef5-8065-ec98d8deec6c None None] MFA Rules not processed for user `32e3f9c9bf31420c8298f6273f7dc560`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:03.409619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-18926643-48cf-4ef5-8065-ec98d8deec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:03.478779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbaae3-c9f7-4a49-a544-399ca49b7893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:03.485898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbaae3-c9f7-4a49-a544-399ca49b7893 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:03.509625 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 868/1746] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:03.512347 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c0ad5-13d3-4559-bf83-869fd65da7db None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:03.514762 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c0ad5-13d3-4559-bf83-869fd65da7db None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:03.515045 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c0ad5-13d3-4559-bf83-869fd65da7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:03.536764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:03.603108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-dd6c0ad5-13d3-4559-bf83-869fd65da7db None None] MFA Rules not processed for user `aad1b5c894414f6cb5399e457f15f87e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:03.607038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 879/1747] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:03.611873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-dd6c0ad5-13d3-4559-bf83-869fd65da7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:03.619876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18926643-48cf-4ef5-8065-ec98d8deec6c None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:03.621658 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-18926643-48cf-4ef5-8065-ec98d8deec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:03.773707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18926643-48cf-4ef5-8065-ec98d8deec6c None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:03.780057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40419c17-aa0f-48d9-8dee-44c7116b79bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:03.781074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40419c17-aa0f-48d9-8dee-44c7116b79bf service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:03.781536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40419c17-aa0f-48d9-8dee-44c7116b79bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:03.781997 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40419c17-aa0f-48d9-8dee-44c7116b79bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:03.809626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40419c17-aa0f-48d9-8dee-44c7116b79bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:03.812461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40419c17-aa0f-48d9-8dee-44c7116b79bf service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:03.840659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 880/1748] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:03.843330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce9755-63a9-4dca-ac25-d1c6339f51c9 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:03.843775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce9755-63a9-4dca-ac25-d1c6339f51c9 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:03.844746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce9755-63a9-4dca-ac25-d1c6339f51c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:03.888281 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 869/1749] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:03.889309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c0ad5-13d3-4559-bf83-869fd65da7db None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:03.904867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-c7ce9755-63a9-4dca-ac25-d1c6339f51c9 None None] MFA Rules not processed for user `9d47131516614ef9adae65e8db11e650`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:03.907551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c7ce9755-63a9-4dca-ac25-d1c6339f51c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:03.998153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:04.108603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 881/1750] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:04.121865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c0ad5-13d3-4559-bf83-869fd65da7db None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:04.124926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244250-3313-489f-bf83-ad9ba1985016 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:04.125228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244250-3313-489f-bf83-ad9ba1985016 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:04.125451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f244250-3313-489f-bf83-ad9ba1985016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:04.136568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5dab4-d522-4de2-855a-c0989070099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:04.144804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5dab4-d522-4de2-855a-c0989070099a admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:04.145154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5dab4-d522-4de2-855a-c0989070099a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:04.145440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5dab4-d522-4de2-855a-c0989070099a admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:04.147209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5dab4-d522-4de2-855a-c0989070099a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:04.153557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5dab4-d522-4de2-855a-c0989070099a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:04.200548 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4f244250-3313-489f-bf83-ad9ba1985016 None None] MFA Rules not processed for user `9d47131516614ef9adae65e8db11e650`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:04.210824 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4f244250-3313-489f-bf83-ad9ba1985016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:04.230420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 882/1751] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:04.244740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f244250-3313-489f-bf83-ad9ba1985016 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:04.248413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4f244250-3313-489f-bf83-ad9ba1985016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:04.275983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 870/1752] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:03 2022] POST /identity/v3/projects => generated 387 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:04.280409 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5dab4-d522-4de2-855a-c0989070099a admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:04.526614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f244250-3313-489f-bf83-ad9ba1985016 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:04.533048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5dab4-d522-4de2-855a-c0989070099a admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:04.556886 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d626636-fdd8-49cf-870a-90cc155e99a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:04.557804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626636-fdd8-49cf-870a-90cc155e99a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:04.558252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626636-fdd8-49cf-870a-90cc155e99a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:04.558859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626636-fdd8-49cf-870a-90cc155e99a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:04.559786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d626636-fdd8-49cf-870a-90cc155e99a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:04.570870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d626636-fdd8-49cf-870a-90cc155e99a8 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:04.615447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 871/1753] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:04 2022] POST /identity/v3/users => generated 294 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:04.616716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d626636-fdd8-49cf-870a-90cc155e99a8 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:04.634548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d626636-fdd8-49cf-870a-90cc155e99a8 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:04.653202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a468a-d1f1-4903-a75e-d952018b1f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:04.654297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a468a-d1f1-4903-a75e-d952018b1f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:04.654749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a468a-d1f1-4903-a75e-d952018b1f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:04.655248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a468a-d1f1-4903-a75e-d952018b1f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:04.656173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a468a-d1f1-4903-a75e-d952018b1f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:04.658124 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a468a-d1f1-4903-a75e-d952018b1f5e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:04.669890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:04.688935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 872/1754] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:04.690594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d173f-eb20-485c-9f2e-d9b52ee18a98 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:04.692776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d173f-eb20-485c-9f2e-d9b52ee18a98 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:04.693228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d173f-eb20-485c-9f2e-d9b52ee18a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:04.697651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebda1c-f2aa-4eb2-8a7a-cac14bb95769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:04.700430 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebda1c-f2aa-4eb2-8a7a-cac14bb95769 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:04.701436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebda1c-f2aa-4eb2-8a7a-cac14bb95769 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:04.702532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebda1c-f2aa-4eb2-8a7a-cac14bb95769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:04.750702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9c5d173f-eb20-485c-9f2e-d9b52ee18a98 None None] MFA Rules not processed for user `3e291616a6574581af9e778d5849ccca`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:04.753701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9c5d173f-eb20-485c-9f2e-d9b52ee18a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:04.841278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebda1c-f2aa-4eb2-8a7a-cac14bb95769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:04.842934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebda1c-f2aa-4eb2-8a7a-cac14bb95769 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:04.871771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 883/1755] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:04.872806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebda1c-f2aa-4eb2-8a7a-cac14bb95769 service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:04.893461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:04.900214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 873/1756] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:04.914155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b56b3e-20d2-40f5-a3c9-f24542730709 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:04.914848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b56b3e-20d2-40f5-a3c9-f24542730709 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:04.915326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b56b3e-20d2-40f5-a3c9-f24542730709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:04.916992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebda1c-f2aa-4eb2-8a7a-cac14bb95769 service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:04.932135 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac593-b49a-477d-80c7-6d6414f67dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:04.932831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac593-b49a-477d-80c7-6d6414f67dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:04.933114 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac593-b49a-477d-80c7-6d6414f67dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:04.933393 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac593-b49a-477d-80c7-6d6414f67dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:04.934132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aac593-b49a-477d-80c7-6d6414f67dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:04.935787 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aac593-b49a-477d-80c7-6d6414f67dd9 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:04.953066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-d9b56b3e-20d2-40f5-a3c9-f24542730709 None None] MFA Rules not processed for user `3e291616a6574581af9e778d5849ccca`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:04.956374 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d9b56b3e-20d2-40f5-a3c9-f24542730709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:04.974463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 874/1757] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:04.984701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 884/1758] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:04.988401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b56b3e-20d2-40f5-a3c9-f24542730709 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:04.992490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac593-b49a-477d-80c7-6d6414f67dd9 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:04.998133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-55aac593-b49a-477d-80c7-6d6414f67dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:05.007230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b56b3e-20d2-40f5-a3c9-f24542730709 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:05.020243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bcdaf-bf6d-497b-8273-53173dd0cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:05.021264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bcdaf-bf6d-497b-8273-53173dd0cd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:05.021546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bcdaf-bf6d-497b-8273-53173dd0cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:05.021929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bcdaf-bf6d-497b-8273-53173dd0cd2c admin admin] PATH_INFO: `/v3/projects/ab918b432d984b0a953b898ff68f4406/users/70e7c0d9e1d7428d96b34f22fcdd4ecd/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:05.077941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac593-b49a-477d-80c7-6d6414f67dd9 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:05.089219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bcdaf-bf6d-497b-8273-53173dd0cd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab918b432d984b0a953b898ff68f4406, user_id=70e7c0d9e1d7428d96b34f22fcdd4ecd, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:05.094516 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bcdaf-bf6d-497b-8273-53173dd0cd2c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:05.095368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e3a3a-d807-410f-8f29-4908a3bd621d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:05.096139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e3a3a-d807-410f-8f29-4908a3bd621d service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:05.096775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e3a3a-d807-410f-8f29-4908a3bd621d service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:05.098686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e3a3a-d807-410f-8f29-4908a3bd621d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:05.129539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e3a3a-d807-410f-8f29-4908a3bd621d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:05.133897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e3a3a-d807-410f-8f29-4908a3bd621d service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:05.137888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 875/1759] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:04 2022] PUT /identity/v3/projects/ab918b432d984b0a953b898ff68f4406/users/70e7c0d9e1d7428d96b34f22fcdd4ecd/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:05.152321 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c781b4-eb9b-4638-9b76-9b0885d91a45 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:05.152912 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c781b4-eb9b-4638-9b76-9b0885d91a45 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:05.153386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c781b4-eb9b-4638-9b76-9b0885d91a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:05.200112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 885/1760] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:05:05.216338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-61c781b4-eb9b-4638-9b76-9b0885d91a45 None None] MFA Rules not processed for user `70e7c0d9e1d7428d96b34f22fcdd4ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:05.217571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-61c781b4-eb9b-4638-9b76-9b0885d91a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:05.285271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bcb2-8391-4747-9668-bbed5c42a214 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:05.285562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bcb2-8391-4747-9668-bbed5c42a214 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:05.285944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bcb2-8391-4747-9668-bbed5c42a214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:05.333434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-0693bcb2-8391-4747-9668-bbed5c42a214 None None] MFA Rules not processed for user `62f614b02ced4c4fae0fc0853ed66431`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:05.365920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-0693bcb2-8391-4747-9668-bbed5c42a214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:05.469668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 876/1761] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:05.475172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c781b4-eb9b-4638-9b76-9b0885d91a45 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:05.620668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:05.631868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 886/1762] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:05.663936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c781b4-eb9b-4638-9b76-9b0885d91a45 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:05.680026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc65d2-5e72-49fc-927b-f148b52443ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:05.685509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc65d2-5e72-49fc-927b-f148b52443ce admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:05.689555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc65d2-5e72-49fc-927b-f148b52443ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:05.690048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc65d2-5e72-49fc-927b-f148b52443ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:05.691096 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc65d2-5e72-49fc-927b-f148b52443ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:05.696725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc65d2-5e72-49fc-927b-f148b52443ce admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:05.793780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693bcb2-8391-4747-9668-bbed5c42a214 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:05.794626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 877/1763] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:05 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:05.823819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693bcb2-8391-4747-9668-bbed5c42a214 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:06.024524 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf185b-10ff-44d3-81fc-747057b3bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:06.025367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf185b-10ff-44d3-81fc-747057b3bccd admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:06.025731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf185b-10ff-44d3-81fc-747057b3bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:06.027917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf185b-10ff-44d3-81fc-747057b3bccd admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:06.030203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf185b-10ff-44d3-81fc-747057b3bccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:06.037982 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf185b-10ff-44d3-81fc-747057b3bccd admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:06.088413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 887/1764] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:05 2022] POST /identity/v3/users => generated 299 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:06.092348 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc65d2-5e72-49fc-927b-f148b52443ce admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:06.106799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc65d2-5e72-49fc-927b-f148b52443ce admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:06.132762 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd8fb8-f858-48b7-b305-8cde70f1d49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:06.135470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd8fb8-f858-48b7-b305-8cde70f1d49d admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:06.137177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd8fb8-f858-48b7-b305-8cde70f1d49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:06.137639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd8fb8-f858-48b7-b305-8cde70f1d49d admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:06.139028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd8fb8-f858-48b7-b305-8cde70f1d49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:06.144451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd8fb8-f858-48b7-b305-8cde70f1d49d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:06.196663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57040c-cdf5-4dde-a583-f3df43a30d16 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:06.199337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57040c-cdf5-4dde-a583-f3df43a30d16 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:06.199751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57040c-cdf5-4dde-a583-f3df43a30d16 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:06.201751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 888/1765] 10.222.0.36 () {54 vars in 912 bytes} [Sun Jun 26 03:05:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:05:06.212100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199cb3-49da-4b68-a56d-8acc44127ca6 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:06.212529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199cb3-49da-4b68-a56d-8acc44127ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:06.212963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199cb3-49da-4b68-a56d-8acc44127ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:06.248594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 878/1766] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:06.250450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd8fb8-f858-48b7-b305-8cde70f1d49d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:06.286062 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd8fb8-f858-48b7-b305-8cde70f1d49d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:06.315688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94defdc5-0b29-44d6-b149-281496dbe56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:06.320136 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-57199cb3-49da-4b68-a56d-8acc44127ca6 None None] MFA Rules not processed for user `4169682bfc5043a3a3d4c638dae2a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:06.320745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94defdc5-0b29-44d6-b149-281496dbe56d admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:06.321253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-57199cb3-49da-4b68-a56d-8acc44127ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:06.326397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94defdc5-0b29-44d6-b149-281496dbe56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:06.327355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94defdc5-0b29-44d6-b149-281496dbe56d admin admin] PATH_INFO: `/v3/projects/94545340701d4d0ab3f3e4d94b3e3ee0/users/afbfce94d54a466789e801a377ae219e/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:06.387574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94defdc5-0b29-44d6-b149-281496dbe56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94545340701d4d0ab3f3e4d94b3e3ee0, user_id=afbfce94d54a466789e801a377ae219e, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:06.413015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94defdc5-0b29-44d6-b149-281496dbe56d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:06.466716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 879/1767] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:06 2022] PUT /identity/v3/projects/94545340701d4d0ab3f3e4d94b3e3ee0/users/afbfce94d54a466789e801a377ae219e/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:06.478643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640bea5-9d51-4c10-8d58-f5b552c3b746 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:06.478643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640bea5-9d51-4c10-8d58-f5b552c3b746 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:06.478643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640bea5-9d51-4c10-8d58-f5b552c3b746 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:06.490703 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 880/1768] 10.222.0.36 () {54 vars in 912 bytes} [Sun Jun 26 03:05:06 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:05:06.491632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640bea5-9d51-4c10-8d58-f5b552c3b746 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:06.543084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 889/1769] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:05:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:06.551760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44667f63-8a0b-48cb-8d44-5bde5a8fa893 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:06.552060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44667f63-8a0b-48cb-8d44-5bde5a8fa893 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:06.555650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44667f63-8a0b-48cb-8d44-5bde5a8fa893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:06.637178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-44667f63-8a0b-48cb-8d44-5bde5a8fa893 None None] MFA Rules not processed for user `4169682bfc5043a3a3d4c638dae2a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:06.640362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-44667f63-8a0b-48cb-8d44-5bde5a8fa893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:06.668487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:06.707219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640bea5-9d51-4c10-8d58-f5b552c3b746 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:06.712432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9369ee3-53bc-4143-ad4f-17438ccedc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:06.713073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9369ee3-53bc-4143-ad4f-17438ccedc87 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:06.713362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9369ee3-53bc-4143-ad4f-17438ccedc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:06.713653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9369ee3-53bc-4143-ad4f-17438ccedc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:06.714451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9369ee3-53bc-4143-ad4f-17438ccedc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:06.716209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9369ee3-53bc-4143-ad4f-17438ccedc87 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:06.738604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 881/1770] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:06.739655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9369ee3-53bc-4143-ad4f-17438ccedc87 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:06.742920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e9369ee3-53bc-4143-ad4f-17438ccedc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:06.804824 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 890/1771] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:05:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:06.805897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44667f63-8a0b-48cb-8d44-5bde5a8fa893 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:06.834017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44667f63-8a0b-48cb-8d44-5bde5a8fa893 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:06.843683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b215c2-af36-467b-84a6-94e0b687da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:06.844752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b215c2-af36-467b-84a6-94e0b687da31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:06.845095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b215c2-af36-467b-84a6-94e0b687da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:06.845438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b215c2-af36-467b-84a6-94e0b687da31 admin admin] PATH_INFO: `/v3/projects/94545340701d4d0ab3f3e4d94b3e3ee0/users/afbfce94d54a466789e801a377ae219e/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:06.851110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b215c2-af36-467b-84a6-94e0b687da31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94545340701d4d0ab3f3e4d94b3e3ee0, user_id=afbfce94d54a466789e801a377ae219e, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:06.858723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b215c2-af36-467b-84a6-94e0b687da31 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:06.869551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9369ee3-53bc-4143-ad4f-17438ccedc87 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:06.888163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 891/1772] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:06 2022] PUT /identity/v3/projects/94545340701d4d0ab3f3e4d94b3e3ee0/users/afbfce94d54a466789e801a377ae219e/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:06.901358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b215c2-af36-467b-84a6-94e0b687da31 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:06.909919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-59b215c2-af36-467b-84a6-94e0b687da31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:07.027347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b215c2-af36-467b-84a6-94e0b687da31 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:07.044060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744ef0b-d8f9-4e20-8cf8-8afc9716ae1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:07.045248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ef0b-d8f9-4e20-8cf8-8afc9716ae1c service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:07.046609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ef0b-d8f9-4e20-8cf8-8afc9716ae1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:07.047134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ef0b-d8f9-4e20-8cf8-8afc9716ae1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:07.076469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744ef0b-d8f9-4e20-8cf8-8afc9716ae1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:07.080752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744ef0b-d8f9-4e20-8cf8-8afc9716ae1c service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:07.103640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e0837-028f-41bd-95d5-aa9cd0722f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:07.104303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e0837-028f-41bd-95d5-aa9cd0722f9a service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:07.104589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e0837-028f-41bd-95d5-aa9cd0722f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:07.104871 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e0837-028f-41bd-95d5-aa9cd0722f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:07.108067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 892/1773] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:07.109793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1ef2-5c27-492d-907d-18dcc01a65a5 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:07.111468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1ef2-5c27-492d-907d-18dcc01a65a5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:07.112815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1ef2-5c27-492d-907d-18dcc01a65a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:07.146948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:07.169274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e0837-028f-41bd-95d5-aa9cd0722f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:07.170774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e0837-028f-41bd-95d5-aa9cd0722f9a service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:07.206060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 882/1774] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:07.207312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5b4f1ef2-5c27-492d-907d-18dcc01a65a5 None None] MFA Rules not processed for user `afbfce94d54a466789e801a377ae219e`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:07.214172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5b4f1ef2-5c27-492d-907d-18dcc01a65a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:07.452078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 893/1775] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:07.628684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e0837-028f-41bd-95d5-aa9cd0722f9a service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:07.718969 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e0837-028f-41bd-95d5-aa9cd0722f9a service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:07.732747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348d3c3-4a4a-4d65-b621-f5efb7f1e4c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:07.732747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348d3c3-4a4a-4d65-b621-f5efb7f1e4c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:07.732747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348d3c3-4a4a-4d65-b621-f5efb7f1e4c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:07.737170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348d3c3-4a4a-4d65-b621-f5efb7f1e4c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:07.776321 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348d3c3-4a4a-4d65-b621-f5efb7f1e4c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:07.778505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348d3c3-4a4a-4d65-b621-f5efb7f1e4c5 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:07.811998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 883/1776] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:08.112332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860272be-bd85-49ea-be07-6e172051e388 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:08.113267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860272be-bd85-49ea-be07-6e172051e388 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:08.114191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860272be-bd85-49ea-be07-6e172051e388 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:08.119696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 894/1777] 10.222.0.36 () {54 vars in 960 bytes} [Sun Jun 26 03:05:08 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:05:08.128988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b11752-0d99-44f4-a6fd-d891d5d2155b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:08.129281 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b11752-0d99-44f4-a6fd-d891d5d2155b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:08.129784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b11752-0d99-44f4-a6fd-d891d5d2155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:08.199196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-10b11752-0d99-44f4-a6fd-d891d5d2155b None None] MFA Rules not processed for user `5ae5f8f789424969bd575f7360847261`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:08.200369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-10b11752-0d99-44f4-a6fd-d891d5d2155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:08.495620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 884/1778] 10.222.0.36 () {58 vars in 1057 bytes} [Sun Jun 26 03:05:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:08.504292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860272be-bd85-49ea-be07-6e172051e388 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:08.536499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860272be-bd85-49ea-be07-6e172051e388 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:08.538261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b11752-0d99-44f4-a6fd-d891d5d2155b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:08.540709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-10b11752-0d99-44f4-a6fd-d891d5d2155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:08.557941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b11752-0d99-44f4-a6fd-d891d5d2155b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:08.558611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3eb802-20e7-42ad-aa13-057afafa263a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:08.560916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb802-20e7-42ad-aa13-057afafa263a service placement] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:08.562027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb802-20e7-42ad-aa13-057afafa263a service placement] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:08.562808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb802-20e7-42ad-aa13-057afafa263a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:08.569701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-da3eb802-20e7-42ad-aa13-057afafa263a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:08.589811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdd13d-efca-4fe1-b61c-6a8cb9b98d23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:08.590687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd13d-efca-4fe1-b61c-6a8cb9b98d23 service placement] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:08.591152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd13d-efca-4fe1-b61c-6a8cb9b98d23 service placement] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:08.591693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd13d-efca-4fe1-b61c-6a8cb9b98d23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:08.610140 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3eb802-20e7-42ad-aa13-057afafa263a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:08.613405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3eb802-20e7-42ad-aa13-057afafa263a service placement] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:08.634081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdd13d-efca-4fe1-b61c-6a8cb9b98d23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:08.636558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdd13d-efca-4fe1-b61c-6a8cb9b98d23 service placement] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:08.667425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 895/1779] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:08.693748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 885/1780] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:08.806094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667919-170b-4612-ad72-a8cac86e4d13 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:08.806945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667919-170b-4612-ad72-a8cac86e4d13 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:08.807176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667919-170b-4612-ad72-a8cac86e4d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:08.868903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-40667919-170b-4612-ad72-a8cac86e4d13 None None] MFA Rules not processed for user `3e291616a6574581af9e778d5849ccca`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:08.872710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-40667919-170b-4612-ad72-a8cac86e4d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:08.954680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:09.105339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 896/1781] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:11.020997 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdd13d-efca-4fe1-b61c-6a8cb9b98d23 service placement] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:11.034336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdd13d-efca-4fe1-b61c-6a8cb9b98d23 service placement] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:11.045370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba1f68-ba20-4e9b-ac0f-e9662567cb42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:11.048517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba1f68-ba20-4e9b-ac0f-e9662567cb42 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:11.048993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba1f68-ba20-4e9b-ac0f-e9662567cb42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:11.049652 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba1f68-ba20-4e9b-ac0f-e9662567cb42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:11.268888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba1f68-ba20-4e9b-ac0f-e9662567cb42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:11.270716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba1f68-ba20-4e9b-ac0f-e9662567cb42 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:11.306389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 886/1782] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:11.837314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40667919-170b-4612-ad72-a8cac86e4d13 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:11.956856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40667919-170b-4612-ad72-a8cac86e4d13 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:11.963843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:11.964768 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:11.965033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:11.965443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] PATH_INFO: `/v3/users/d300066a023a483f93a63aa034cbb820` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:11.966704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d300066a023a483f93a63aa034cbb820)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:11.968990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:12.139373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd300066a023a483f93a63aa034cbb820'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:12.167516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd300066a023a483f93a63aa034cbb820'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:12.180072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd300066a023a483f93a63aa034cbb820'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:12.193635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd300066a023a483f93a63aa034cbb820'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:12.195349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd300066a023a483f93a63aa034cbb820'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:12.221746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdd04b-9f7e-4b88-9844-872b3d6b3481 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:12.222305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdd04b-9f7e-4b88-9844-872b3d6b3481 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:12.222389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdd04b-9f7e-4b88-9844-872b3d6b3481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:12.224057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 897/1783] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:11 2022] DELETE /identity/v3/users/d300066a023a483f93a63aa034cbb820 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:12.265860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-02cdd04b-9f7e-4b88-9844-872b3d6b3481 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:12.267221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-02cdd04b-9f7e-4b88-9844-872b3d6b3481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:12.297519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:12.398705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 887/1784] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:12.406758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:12.411934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:12.546819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:12.563999 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc9cab-34e1-4215-b559-1212e360a39d admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:12.574502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438bf63-c1d3-4599-a47d-1e3333d18896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:12.575208 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438bf63-c1d3-4599-a47d-1e3333d18896 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:12.577641 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438bf63-c1d3-4599-a47d-1e3333d18896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:12.578042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438bf63-c1d3-4599-a47d-1e3333d18896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:12.596261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438bf63-c1d3-4599-a47d-1e3333d18896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:12.598251 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438bf63-c1d3-4599-a47d-1e3333d18896 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:12.612826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 898/1785] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:05:13.364744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d5d42-b58f-44a9-a286-e269cb0d868f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:13.365300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d5d42-b58f-44a9-a286-e269cb0d868f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:13.366037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d5d42-b58f-44a9-a286-e269cb0d868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:13.409197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1b7d5d42-b58f-44a9-a286-e269cb0d868f None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:13.410677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1b7d5d42-b58f-44a9-a286-e269cb0d868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:13.556520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 888/1786] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:05:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:13.655950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438bf63-c1d3-4599-a47d-1e3333d18896 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:13.658152 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d438bf63-c1d3-4599-a47d-1e3333d18896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:13.757221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438bf63-c1d3-4599-a47d-1e3333d18896 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:13.777213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8a75e-d1cf-443b-8460-96106b828e2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:13.778220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8a75e-d1cf-443b-8460-96106b828e2e service swift] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:13.778686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8a75e-d1cf-443b-8460-96106b828e2e service swift] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:13.779460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8a75e-d1cf-443b-8460-96106b828e2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:13.792270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8a75e-d1cf-443b-8460-96106b828e2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:13.794153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8a75e-d1cf-443b-8460-96106b828e2e service swift] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:13.810872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 899/1787] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:05:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:05:14.954428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d5d42-b58f-44a9-a286-e269cb0d868f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:14.958084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1b7d5d42-b58f-44a9-a286-e269cb0d868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:14.984125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d5d42-b58f-44a9-a286-e269cb0d868f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:14.998468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:15.000624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:15.003490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:15.004463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] PATH_INFO: `/v3/projects/36cd097bcdd841ff9464d2b4055a3cf5` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:15.006403 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cd097bcdd841ff9464d2b4055a3cf5)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:15.011544 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:15.190656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cd097bcdd841ff9464d2b4055a3cf5', 'request_id': 'req-79acf672-7373-4765-8098-edc3898f1e5a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:15.208340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cd097bcdd841ff9464d2b4055a3cf5', 'request_id': 'req-79acf672-7373-4765-8098-edc3898f1e5a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:15.228293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cd097bcdd841ff9464d2b4055a3cf5', 'request_id': 'req-79acf672-7373-4765-8098-edc3898f1e5a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:15.254157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] The token cache is being invalidate because project 36cd097bcdd841ff9464d2b4055a3cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:15.254438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:15.255206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-79acf672-7373-4765-8098-edc3898f1e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:15.257514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 889/1788] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:14 2022] DELETE /identity/v3/projects/36cd097bcdd841ff9464d2b4055a3cf5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:15.262089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8a75e-d1cf-443b-8460-96106b828e2e service swift] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:15.350675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8a75e-d1cf-443b-8460-96106b828e2e service swift] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:15.544584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:15.545711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:15.546147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:15.546579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] PATH_INFO: `/v3/users/32e3f9c9bf31420c8298f6273f7dc560` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:15.548029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e3f9c9bf31420c8298f6273f7dc560)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:15.550236 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:15.625677 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e3f9c9bf31420c8298f6273f7dc560'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:15.670243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e3f9c9bf31420c8298f6273f7dc560'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:15.688854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e3f9c9bf31420c8298f6273f7dc560'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:15.710006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e3f9c9bf31420c8298f6273f7dc560'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:15.713203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e3f9c9bf31420c8298f6273f7dc560'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:15.715708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:15.742307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 900/1789] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:15 2022] DELETE /identity/v3/users/32e3f9c9bf31420c8298f6273f7dc560 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:16.150520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecb51-24fc-4330-980f-2562fc4bdee2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:16.151107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecb51-24fc-4330-980f-2562fc4bdee2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:16.151191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecb51-24fc-4330-980f-2562fc4bdee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:16.245370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-822ecb51-24fc-4330-980f-2562fc4bdee2 None None] MFA Rules not processed for user `4169682bfc5043a3a3d4c638dae2a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:16.251663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-822ecb51-24fc-4330-980f-2562fc4bdee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:16.414819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:16.457928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 890/1790] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Jun 26 03:05:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:16.504812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:16.506519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:16.545823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdac15-6594-4e02-856b-8933527f4621 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:16.562746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fff6e-bce6-4a55-a685-832c6a195eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:16.564845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fff6e-bce6-4a55-a685-832c6a195eac service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:16.565497 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fff6e-bce6-4a55-a685-832c6a195eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:16.567236 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fff6e-bce6-4a55-a685-832c6a195eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:16.593563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fff6e-bce6-4a55-a685-832c6a195eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:16.598807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fff6e-bce6-4a55-a685-832c6a195eac service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:16.621014 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 901/1791] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:05:16.684926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecb51-24fc-4330-980f-2562fc4bdee2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:16.687127 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-822ecb51-24fc-4330-980f-2562fc4bdee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:16.881811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecb51-24fc-4330-980f-2562fc4bdee2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:16.892047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916f59e-070e-4201-a8a4-60dac5fed097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:16.895748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916f59e-070e-4201-a8a4-60dac5fed097 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:16.896289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916f59e-070e-4201-a8a4-60dac5fed097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:16.896774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916f59e-070e-4201-a8a4-60dac5fed097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:16.904475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0916f59e-070e-4201-a8a4-60dac5fed097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:17.087786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916f59e-070e-4201-a8a4-60dac5fed097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:17.089653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916f59e-070e-4201-a8a4-60dac5fed097 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:17.114180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 891/1792] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:19.652013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fff6e-bce6-4a55-a685-832c6a195eac service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:19.654661 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-619fff6e-bce6-4a55-a685-832c6a195eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:19.889878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fff6e-bce6-4a55-a685-832c6a195eac service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:19.902764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:19.909636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:19.910287 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:19.911060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] PATH_INFO: `/v3/projects/472162c3449a4b0a842f3279f977dd8a` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:19.913816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=472162c3449a4b0a842f3279f977dd8a)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:19.916727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:20.114366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472162c3449a4b0a842f3279f977dd8a', 'request_id': 'req-f36e7d50-1c4a-4412-8b28-0f7587ef8880'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:20.157148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472162c3449a4b0a842f3279f977dd8a', 'request_id': 'req-f36e7d50-1c4a-4412-8b28-0f7587ef8880'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:20.183985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472162c3449a4b0a842f3279f977dd8a', 'request_id': 'req-f36e7d50-1c4a-4412-8b28-0f7587ef8880'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:20.211774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] The token cache is being invalidate because project 472162c3449a4b0a842f3279f977dd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:20.212067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:20.215751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f36e7d50-1c4a-4412-8b28-0f7587ef8880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:20.229199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 902/1793] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:19 2022] DELETE /identity/v3/projects/472162c3449a4b0a842f3279f977dd8a => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:20.234856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f5fd-1898-447f-9c53-36e136080011 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:20.235468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f5fd-1898-447f-9c53-36e136080011 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:20.235468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f5fd-1898-447f-9c53-36e136080011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:20.308160 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3398f5fd-1898-447f-9c53-36e136080011 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:20.313496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3398f5fd-1898-447f-9c53-36e136080011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:20.500671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 892/1794] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:20.519681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e416ad6-1206-4820-98bf-4b4225ac94ec None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:20.519681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e416ad6-1206-4820-98bf-4b4225ac94ec None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:20.519681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e416ad6-1206-4820-98bf-4b4225ac94ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:20.546804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4e416ad6-1206-4820-98bf-4b4225ac94ec None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:20.559419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4e416ad6-1206-4820-98bf-4b4225ac94ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:20.574412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad687e-5a16-494e-9785-06ddc2994480 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:20.574769 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad687e-5a16-494e-9785-06ddc2994480 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:20.575342 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad687e-5a16-494e-9785-06ddc2994480 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:20.577022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 893/1795] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 03:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:05:20.592734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 903/1796] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:20.597047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad687e-5a16-494e-9785-06ddc2994480 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:20.621997 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad687e-5a16-494e-9785-06ddc2994480 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:20.639927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19c85-cfcf-49fa-bf6b-5d4d8a77d668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:20.640657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19c85-cfcf-49fa-bf6b-5d4d8a77d668 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:20.640947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19c85-cfcf-49fa-bf6b-5d4d8a77d668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:20.641300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19c85-cfcf-49fa-bf6b-5d4d8a77d668 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:20.642048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19c85-cfcf-49fa-bf6b-5d4d8a77d668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:20.642360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19c85-cfcf-49fa-bf6b-5d4d8a77d668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:20.644101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19c85-cfcf-49fa-bf6b-5d4d8a77d668 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:20.683095 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 894/1797] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:20.687720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e416ad6-1206-4820-98bf-4b4225ac94ec None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:20.698776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e416ad6-1206-4820-98bf-4b4225ac94ec None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:20.723803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a8fb3-3e7f-49e4-967f-7ce42ea7291e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:20.724439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a8fb3-3e7f-49e4-967f-7ce42ea7291e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:20.724947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a8fb3-3e7f-49e4-967f-7ce42ea7291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:20.737101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dd3f3-3cc1-4ebf-9a48-073706296e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:20.739990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dd3f3-3cc1-4ebf-9a48-073706296e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:20.741962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dd3f3-3cc1-4ebf-9a48-073706296e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:20.743126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dd3f3-3cc1-4ebf-9a48-073706296e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:20.744175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dd3f3-3cc1-4ebf-9a48-073706296e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:20.758870 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dd3f3-3cc1-4ebf-9a48-073706296e4a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:20.815847 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-6c3a8fb3-3e7f-49e4-967f-7ce42ea7291e None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:20.819836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6c3a8fb3-3e7f-49e4-967f-7ce42ea7291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:20.865786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 904/1798] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:20 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:20.870311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dd3f3-3cc1-4ebf-9a48-073706296e4a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:20.980491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:21.093277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:21.114791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 895/1799] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 03:05:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:21.146002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dd3f3-3cc1-4ebf-9a48-073706296e4a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:21.160592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d105c9-f018-4708-af2c-0e0c37828b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:21.161883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d105c9-f018-4708-af2c-0e0c37828b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:21.162621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d105c9-f018-4708-af2c-0e0c37828b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:21.163320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d105c9-f018-4708-af2c-0e0c37828b66 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:21.166054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d105c9-f018-4708-af2c-0e0c37828b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:21.173267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d105c9-f018-4708-af2c-0e0c37828b66 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:21.232809 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 905/1800] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:20 2022] POST /identity/v3/users => generated 294 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:21.237134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a8fb3-3e7f-49e4-967f-7ce42ea7291e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:21.257319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a8fb3-3e7f-49e4-967f-7ce42ea7291e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:21.264294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142e8ee-d9e6-4351-9f86-248fcc81273d None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:21.264815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142e8ee-d9e6-4351-9f86-248fcc81273d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:21.265380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142e8ee-d9e6-4351-9f86-248fcc81273d None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:21.267292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 906/1801] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 03:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:05:21.279379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cbdd9-bf1b-4ba7-ac13-bd0c7f901124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:21.280245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cbdd9-bf1b-4ba7-ac13-bd0c7f901124 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:21.280804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cbdd9-bf1b-4ba7-ac13-bd0c7f901124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:21.281130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cbdd9-bf1b-4ba7-ac13-bd0c7f901124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:21.296741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cbdd9-bf1b-4ba7-ac13-bd0c7f901124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:21.301796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cbdd9-bf1b-4ba7-ac13-bd0c7f901124 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:21.335614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 896/1802] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:21.338721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142e8ee-d9e6-4351-9f86-248fcc81273d None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:21.352336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cbdd9-bf1b-4ba7-ac13-bd0c7f901124 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:21.356428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f84cbdd9-bf1b-4ba7-ac13-bd0c7f901124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:21.367847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142e8ee-d9e6-4351-9f86-248fcc81273d None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:21.386845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cbdd9-bf1b-4ba7-ac13-bd0c7f901124 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:21.394507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19736f-e765-4f89-b486-80dc78d5dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:21.397024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19736f-e765-4f89-b486-80dc78d5dede admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:21.397728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:21.398534 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19736f-e765-4f89-b486-80dc78d5dede admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:21.399626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19736f-e765-4f89-b486-80dc78d5dede admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:21.399767 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:21.399963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:21.401538 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] PATH_INFO: `/v3/users/0563cbd51ff146a6bdb0171ffafbce84` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:21.403601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19736f-e765-4f89-b486-80dc78d5dede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:21.404307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0563cbd51ff146a6bdb0171ffafbce84)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:21.408778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:21.411071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19736f-e765-4f89-b486-80dc78d5dede admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:21.454914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 907/1803] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:21.458225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340d7e4-425d-4916-9f78-7fc87a305c02 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:21.460409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340d7e4-425d-4916-9f78-7fc87a305c02 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:21.463166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340d7e4-425d-4916-9f78-7fc87a305c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:21.595252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d340d7e4-425d-4916-9f78-7fc87a305c02 None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:21.607549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d340d7e4-425d-4916-9f78-7fc87a305c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:21.632072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0563cbd51ff146a6bdb0171ffafbce84'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:21.671865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0563cbd51ff146a6bdb0171ffafbce84'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:21.674409 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0563cbd51ff146a6bdb0171ffafbce84'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:21.695672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0563cbd51ff146a6bdb0171ffafbce84'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:21.696461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0563cbd51ff146a6bdb0171ffafbce84'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:21.727893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 897/1804] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:21 2022] DELETE /identity/v3/users/0563cbd51ff146a6bdb0171ffafbce84 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:21.728953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:21.731991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:21.829247 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 908/1805] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 03:05:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:21.832478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340d7e4-425d-4916-9f78-7fc87a305c02 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:21.839391 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d340d7e4-425d-4916-9f78-7fc87a305c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:21.904897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340d7e4-425d-4916-9f78-7fc87a305c02 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:21.992069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c924a2f-547b-4f9c-81ca-96ad086f148e admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:22.019583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46208658-d513-4a28-8182-e80b663333df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:22.020873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46208658-d513-4a28-8182-e80b663333df admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:22.021303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46208658-d513-4a28-8182-e80b663333df admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:22.021738 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46208658-d513-4a28-8182-e80b663333df admin admin] PATH_INFO: `/v3/projects/d9fb8b5de1304e15addb7df682da6f31/users/58f2a837828a4a7ca2b12bad3e881d44/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:22.067749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46208658-d513-4a28-8182-e80b663333df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fb8b5de1304e15addb7df682da6f31, user_id=58f2a837828a4a7ca2b12bad3e881d44, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:22.075701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46208658-d513-4a28-8182-e80b663333df admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:22.115059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 898/1806] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:21 2022] PUT /identity/v3/projects/d9fb8b5de1304e15addb7df682da6f31/users/58f2a837828a4a7ca2b12bad3e881d44/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:22.116537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765c22e-359a-49dc-84e1-1110c046cc28 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:22.116891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765c22e-359a-49dc-84e1-1110c046cc28 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:22.117174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765c22e-359a-49dc-84e1-1110c046cc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:22.189500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2765c22e-359a-49dc-84e1-1110c046cc28 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:22.193186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2765c22e-359a-49dc-84e1-1110c046cc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:22.219034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:22.223532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e2d8f-61dc-447b-82b3-1a0594470ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:22.224226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e2d8f-61dc-447b-82b3-1a0594470ebf service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:22.234679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e2d8f-61dc-447b-82b3-1a0594470ebf service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:22.237558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e2d8f-61dc-447b-82b3-1a0594470ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:22.242853 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6c5e2d8f-61dc-447b-82b3-1a0594470ebf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:22.302404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e2d8f-61dc-447b-82b3-1a0594470ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:22.311057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e2d8f-61dc-447b-82b3-1a0594470ebf service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:22.390277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 909/1807] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:22.406629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e2d8f-61dc-447b-82b3-1a0594470ebf service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:22.412443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6c5e2d8f-61dc-447b-82b3-1a0594470ebf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:22.468172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e2d8f-61dc-447b-82b3-1a0594470ebf service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:22.518835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:22.519779 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:22.520069 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:22.520361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] PATH_INFO: `/v3/users/aad1b5c894414f6cb5399e457f15f87e` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:22.524107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 899/1808] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:22.525235 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886ac8-81c5-4eea-afe8-96be5d769e74 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:22.525804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886ac8-81c5-4eea-afe8-96be5d769e74 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:22.526104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886ac8-81c5-4eea-afe8-96be5d769e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:22.535815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad1b5c894414f6cb5399e457f15f87e)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:22.537962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:22.598409 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c5886ac8-81c5-4eea-afe8-96be5d769e74 None None] MFA Rules not processed for user `58f2a837828a4a7ca2b12bad3e881d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:22.599716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c5886ac8-81c5-4eea-afe8-96be5d769e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:22.638390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:22.663226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad1b5c894414f6cb5399e457f15f87e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:22.711155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 900/1809] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:22.711155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5886ac8-81c5-4eea-afe8-96be5d769e74 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:22.713077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c5886ac8-81c5-4eea-afe8-96be5d769e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:22.742896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad1b5c894414f6cb5399e457f15f87e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:22.786547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad1b5c894414f6cb5399e457f15f87e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:22.801989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad1b5c894414f6cb5399e457f15f87e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:22.803026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad1b5c894414f6cb5399e457f15f87e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:22.825814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5886ac8-81c5-4eea-afe8-96be5d769e74 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:22.846473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 910/1810] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:22 2022] DELETE /identity/v3/users/aad1b5c894414f6cb5399e457f15f87e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:22.854026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:22.857994 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:22.967408 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8ad6c-c9a0-4e55-9b03-8e7e7bc11cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:22.968114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ad6c-c9a0-4e55-9b03-8e7e7bc11cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:22.968420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ad6c-c9a0-4e55-9b03-8e7e7bc11cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:22.968733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ad6c-c9a0-4e55-9b03-8e7e7bc11cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:22.972384 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-26c8ad6c-c9a0-4e55-9b03-8e7e7bc11cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:23.007144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:23.021049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afe8b9-5944-4d3e-98ce-cfcf0e7e0cc0 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:23.030641 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ccd0e-2a74-437c-bbad-ca675d2cefec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:23.031922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ccd0e-2a74-437c-bbad-ca675d2cefec service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:23.032351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ccd0e-2a74-437c-bbad-ca675d2cefec service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:23.032775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ccd0e-2a74-437c-bbad-ca675d2cefec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:23.034828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-011ccd0e-2a74-437c-bbad-ca675d2cefec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:23.109621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ccd0e-2a74-437c-bbad-ca675d2cefec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:23.111347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ccd0e-2a74-437c-bbad-ca675d2cefec service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:23.133954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8ad6c-c9a0-4e55-9b03-8e7e7bc11cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:23.135584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8ad6c-c9a0-4e55-9b03-8e7e7bc11cf8 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:23.143263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 911/1811] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:23.144602 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ccd0e-2a74-437c-bbad-ca675d2cefec service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:23.150397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-011ccd0e-2a74-437c-bbad-ca675d2cefec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:23.182871 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 901/1812] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:23.184882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97053a60-6a73-46e8-8668-f8ebf47a0bf8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:23.185325 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97053a60-6a73-46e8-8668-f8ebf47a0bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:23.185757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97053a60-6a73-46e8-8668-f8ebf47a0bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:23.202632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ccd0e-2a74-437c-bbad-ca675d2cefec service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:23.224692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f2eaa-339e-4740-9cf6-0a5313887858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:23.225111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-97053a60-6a73-46e8-8668-f8ebf47a0bf8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:23.225428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f2eaa-339e-4740-9cf6-0a5313887858 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:23.225711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f2eaa-339e-4740-9cf6-0a5313887858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:23.225982 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f2eaa-339e-4740-9cf6-0a5313887858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:23.227173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-97053a60-6a73-46e8-8668-f8ebf47a0bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:23.228515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f2eaa-339e-4740-9cf6-0a5313887858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:23.230512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f2eaa-339e-4740-9cf6-0a5313887858 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:23.258470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 902/1813] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:23.323487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 912/1814] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:23 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:23.325335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97053a60-6a73-46e8-8668-f8ebf47a0bf8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:23.327441 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-97053a60-6a73-46e8-8668-f8ebf47a0bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:23.328663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f2eaa-339e-4740-9cf6-0a5313887858 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:23.345461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97053a60-6a73-46e8-8668-f8ebf47a0bf8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:23.512074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331423ad-da93-4897-a006-4cd3ff48c75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:23.513212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331423ad-da93-4897-a006-4cd3ff48c75b service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:23.514221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331423ad-da93-4897-a006-4cd3ff48c75b service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:23.516002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331423ad-da93-4897-a006-4cd3ff48c75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:23.593861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f2eaa-339e-4740-9cf6-0a5313887858 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:23.604341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4076be-9558-4a00-a10b-a4c49492ec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:23.605177 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4076be-9558-4a00-a10b-a4c49492ec71 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:23.605567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4076be-9558-4a00-a10b-a4c49492ec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:23.605953 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4076be-9558-4a00-a10b-a4c49492ec71 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:23.606771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4076be-9558-4a00-a10b-a4c49492ec71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:23.608912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4076be-9558-4a00-a10b-a4c49492ec71 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:23.671200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 913/1815] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:23 2022] POST /identity/v3/users => generated 299 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:23.673819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4076be-9558-4a00-a10b-a4c49492ec71 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:23.699379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4076be-9558-4a00-a10b-a4c49492ec71 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:23.713422 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba5f46-7667-49bf-888a-363da6638ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:23.714126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba5f46-7667-49bf-888a-363da6638ded admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:23.714428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba5f46-7667-49bf-888a-363da6638ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:23.714751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba5f46-7667-49bf-888a-363da6638ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:23.727736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba5f46-7667-49bf-888a-363da6638ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:23.734294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba5f46-7667-49bf-888a-363da6638ded admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:23.736403 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:23.737925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331423ad-da93-4897-a006-4cd3ff48c75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:23.739790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331423ad-da93-4897-a006-4cd3ff48c75b service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:23.774657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 914/1816] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:23.775794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba5f46-7667-49bf-888a-363da6638ded admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:23.785261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 903/1817] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:23.794067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba5f46-7667-49bf-888a-363da6638ded admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:23.806655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264659ca-d7f7-46e8-b618-c401450bb1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:23.808325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264659ca-d7f7-46e8-b618-c401450bb1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:23.808628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264659ca-d7f7-46e8-b618-c401450bb1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:23.809860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264659ca-d7f7-46e8-b618-c401450bb1f4 admin admin] PATH_INFO: `/v3/projects/37d1b1dc7dd34500b0bddc669faa3c79/users/15bb49f1b08d480f868a8599c252a4d6/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:23.847926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264659ca-d7f7-46e8-b618-c401450bb1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d1b1dc7dd34500b0bddc669faa3c79, user_id=15bb49f1b08d480f868a8599c252a4d6, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:23.851574 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264659ca-d7f7-46e8-b618-c401450bb1f4 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:23.884652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 915/1818] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:23 2022] PUT /identity/v3/projects/37d1b1dc7dd34500b0bddc669faa3c79/users/15bb49f1b08d480f868a8599c252a4d6/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:23.888056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331423ad-da93-4897-a006-4cd3ff48c75b service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:23.905928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331423ad-da93-4897-a006-4cd3ff48c75b service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:24.035130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:24.075234 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b942b9-553f-4792-83e1-3f302c15d013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:24.076105 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b942b9-553f-4792-83e1-3f302c15d013 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:24.076397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b942b9-553f-4792-83e1-3f302c15d013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:24.076684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b942b9-553f-4792-83e1-3f302c15d013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:24.077440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b942b9-553f-4792-83e1-3f302c15d013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:24.079141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b942b9-553f-4792-83e1-3f302c15d013 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:24.104618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 904/1819] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:24.107954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264659ca-d7f7-46e8-b618-c401450bb1f4 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:24.122617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264659ca-d7f7-46e8-b618-c401450bb1f4 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:24.132550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc199b9-0576-48a2-9805-dc4ba3dad305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:24.133496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc199b9-0576-48a2-9805-dc4ba3dad305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:24.133773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc199b9-0576-48a2-9805-dc4ba3dad305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:24.143395 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc199b9-0576-48a2-9805-dc4ba3dad305 admin admin] PATH_INFO: `/v3/projects/37d1b1dc7dd34500b0bddc669faa3c79/users/15bb49f1b08d480f868a8599c252a4d6/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:24.145730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc199b9-0576-48a2-9805-dc4ba3dad305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d1b1dc7dd34500b0bddc669faa3c79, user_id=15bb49f1b08d480f868a8599c252a4d6, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:24.156093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc199b9-0576-48a2-9805-dc4ba3dad305 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:24.182378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 916/1820] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:24 2022] PUT /identity/v3/projects/37d1b1dc7dd34500b0bddc669faa3c79/users/15bb49f1b08d480f868a8599c252a4d6/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:24.194011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66779a91-dfc3-4263-80d6-c7c5746ed7a7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:24.194464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66779a91-dfc3-4263-80d6-c7c5746ed7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:24.194848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66779a91-dfc3-4263-80d6-c7c5746ed7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:24.275113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-66779a91-dfc3-4263-80d6-c7c5746ed7a7 None None] MFA Rules not processed for user `15bb49f1b08d480f868a8599c252a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:24.276883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-66779a91-dfc3-4263-80d6-c7c5746ed7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:24.406726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 905/1821] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:24.416575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc199b9-0576-48a2-9805-dc4ba3dad305 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:24.418607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-abc199b9-0576-48a2-9805-dc4ba3dad305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:24.588459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc199b9-0576-48a2-9805-dc4ba3dad305 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:24.606068 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c2ddc-3a7e-46bf-83c8-bc35dbe6ea56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:24.607172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c2ddc-3a7e-46bf-83c8-bc35dbe6ea56 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:24.607613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c2ddc-3a7e-46bf-83c8-bc35dbe6ea56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:24.608153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c2ddc-3a7e-46bf-83c8-bc35dbe6ea56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:24.635842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c2ddc-3a7e-46bf-83c8-bc35dbe6ea56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:24.640851 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c2ddc-3a7e-46bf-83c8-bc35dbe6ea56 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:24.681531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 917/1822] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:24.798732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66779a91-dfc3-4263-80d6-c7c5746ed7a7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:24.800702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-66779a91-dfc3-4263-80d6-c7c5746ed7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:25.032464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66779a91-dfc3-4263-80d6-c7c5746ed7a7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:25.048303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:25.053134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:25.059550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:25.059916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] PATH_INFO: `/v3/users/53325323c41e4310bec02b6f8add2ee1` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:25.068979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53325323c41e4310bec02b6f8add2ee1)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:25.074920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:25.180658 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c2ddc-3a7e-46bf-83c8-bc35dbe6ea56 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:25.184659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-246c2ddc-3a7e-46bf-83c8-bc35dbe6ea56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:25.268977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c2ddc-3a7e-46bf-83c8-bc35dbe6ea56 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:25.284136 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53325323c41e4310bec02b6f8add2ee1'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.287204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:25.292607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:25.294065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:25.295754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] PATH_INFO: `/v3/projects/b5e1cb84bb71458483595985b774c3c0` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:25.302904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e1cb84bb71458483595985b774c3c0)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:25.312876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:25.346265 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53325323c41e4310bec02b6f8add2ee1'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.349015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53325323c41e4310bec02b6f8add2ee1'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.369855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53325323c41e4310bec02b6f8add2ee1'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.371814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53325323c41e4310bec02b6f8add2ee1'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.396819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:25.426008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 906/1823] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:24 2022] DELETE /identity/v3/users/53325323c41e4310bec02b6f8add2ee1 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:25.427070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:25.429627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:25.476566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e1cb84bb71458483595985b774c3c0', 'request_id': 'req-ebc93898-53f7-4c1f-a041-58b202d4e1fd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.501076 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e1cb84bb71458483595985b774c3c0', 'request_id': 'req-ebc93898-53f7-4c1f-a041-58b202d4e1fd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.524047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e1cb84bb71458483595985b774c3c0', 'request_id': 'req-ebc93898-53f7-4c1f-a041-58b202d4e1fd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.562271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] The token cache is being invalidate because project b5e1cb84bb71458483595985b774c3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:25.562621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.565908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ebc93898-53f7-4c1f-a041-58b202d4e1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.573348 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 918/1824] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:25 2022] DELETE /identity/v3/projects/b5e1cb84bb71458483595985b774c3c0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:25.578109 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1f210-df75-4045-a9a4-35259219ab75 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:25.578555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1f210-df75-4045-a9a4-35259219ab75 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:25.578843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1f210-df75-4045-a9a4-35259219ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:25.601465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0137937-9407-4995-9586-80c0fc270ef2 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:25.621877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:25.626709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:25.627598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:25.628856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] PATH_INFO: `/v3/projects/5bf2d13c960f4d3592f608d41cb2fdf1` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:25.638870 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f0d1f210-df75-4045-a9a4-35259219ab75 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:25.640225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf2d13c960f4d3592f608d41cb2fdf1)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:25.641713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f0d1f210-df75-4045-a9a4-35259219ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:25.650658 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:25.662079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 919/1825] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:25.663257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1f210-df75-4045-a9a4-35259219ab75 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:25.665794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f0d1f210-df75-4045-a9a4-35259219ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:25.683305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1f210-df75-4045-a9a4-35259219ab75 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:25.692822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:25.694314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:25.694774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:25.695250 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] PATH_INFO: `/v3/users/70e7c0d9e1d7428d96b34f22fcdd4ecd` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:25.697166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e7c0d9e1d7428d96b34f22fcdd4ecd)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:25.700775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:25.788332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:25.835950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e7c0d9e1d7428d96b34f22fcdd4ecd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.841222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf2d13c960f4d3592f608d41cb2fdf1', 'request_id': 'req-5a28c172-39ab-42ab-8756-f48eac13e4ac'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.859258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf2d13c960f4d3592f608d41cb2fdf1', 'request_id': 'req-5a28c172-39ab-42ab-8756-f48eac13e4ac'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.874353 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf2d13c960f4d3592f608d41cb2fdf1', 'request_id': 'req-5a28c172-39ab-42ab-8756-f48eac13e4ac'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.877015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e7c0d9e1d7428d96b34f22fcdd4ecd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.892057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e7c0d9e1d7428d96b34f22fcdd4ecd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.907664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] The token cache is being invalidate because project 5bf2d13c960f4d3592f608d41cb2fdf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:25.908325 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.909551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.914764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e7c0d9e1d7428d96b34f22fcdd4ecd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.917890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e7c0d9e1d7428d96b34f22fcdd4ecd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:25.918889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 907/1826] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:25 2022] DELETE /identity/v3/projects/5bf2d13c960f4d3592f608d41cb2fdf1 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:25.920292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:25.922248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:25.952552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 920/1827] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:25 2022] DELETE /identity/v3/users/70e7c0d9e1d7428d96b34f22fcdd4ecd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:25.954313 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:25.958467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:26.008888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28c172-39ab-42ab-8756-f48eac13e4ac admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:26.140858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:26.174397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15c0c-668a-4ad0-9df0-6cc51077d995 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:26.181431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7f9d8-831f-47b8-b4aa-342f700c7dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:26.184896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7f9d8-831f-47b8-b4aa-342f700c7dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:26.191677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7f9d8-831f-47b8-b4aa-342f700c7dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:26.192658 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7f9d8-831f-47b8-b4aa-342f700c7dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:26.196112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c04c-718c-4704-98e1-71455d77b76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:26.197911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c04c-718c-4704-98e1-71455d77b76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:26.198906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ecc7f9d8-831f-47b8-b4aa-342f700c7dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:26.200825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c04c-718c-4704-98e1-71455d77b76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:26.201310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c04c-718c-4704-98e1-71455d77b76f admin admin] PATH_INFO: `/v3/users/70bd79b482004a11b45a710026a301f1` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:26.204194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c04c-718c-4704-98e1-71455d77b76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bd79b482004a11b45a710026a301f1)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:26.209166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c04c-718c-4704-98e1-71455d77b76f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:26.257318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7f9d8-831f-47b8-b4aa-342f700c7dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:26.259190 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7f9d8-831f-47b8-b4aa-342f700c7dc9 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:26.288042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 908/1828] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:26.292634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7f9d8-831f-47b8-b4aa-342f700c7dc9 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:26.297204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ecc7f9d8-831f-47b8-b4aa-342f700c7dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:26.318507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7f9d8-831f-47b8-b4aa-342f700c7dc9 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:26.324698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:26.325606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:26.325889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:26.326165 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] PATH_INFO: `/v3/users/58f2a837828a4a7ca2b12bad3e881d44` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:26.327570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f2a837828a4a7ca2b12bad3e881d44)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:26.329819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:26.363871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a707c04c-718c-4704-98e1-71455d77b76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bd79b482004a11b45a710026a301f1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.382732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a707c04c-718c-4704-98e1-71455d77b76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bd79b482004a11b45a710026a301f1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.409165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a707c04c-718c-4704-98e1-71455d77b76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bd79b482004a11b45a710026a301f1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.418675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f2a837828a4a7ca2b12bad3e881d44'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.433286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a707c04c-718c-4704-98e1-71455d77b76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bd79b482004a11b45a710026a301f1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.435081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a707c04c-718c-4704-98e1-71455d77b76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bd79b482004a11b45a710026a301f1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.454676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 921/1829] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:25 2022] DELETE /identity/v3/users/70bd79b482004a11b45a710026a301f1 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:26.462111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f2a837828a4a7ca2b12bad3e881d44'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.463665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f2a837828a4a7ca2b12bad3e881d44'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.473730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f2a837828a4a7ca2b12bad3e881d44'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.473730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f2a837828a4a7ca2b12bad3e881d44'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.504193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 909/1830] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:26 2022] DELETE /identity/v3/users/58f2a837828a4a7ca2b12bad3e881d44 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:26.506030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869333e-3904-4fca-ae8a-3f1b80befa00 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:26.506320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869333e-3904-4fca-ae8a-3f1b80befa00 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:26.506599 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869333e-3904-4fca-ae8a-3f1b80befa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:26.525602 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4869333e-3904-4fca-ae8a-3f1b80befa00 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:26.527077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4869333e-3904-4fca-ae8a-3f1b80befa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:26.578017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:26.623828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 922/1831] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:26.644755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:26.647232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:26.724075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b1165-f45b-42d4-9644-d5da5618ab92 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:26.728158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28923ff1-61eb-4022-bee1-a57cd1df642e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:26.728834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28923ff1-61eb-4022-bee1-a57cd1df642e service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:26.729120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28923ff1-61eb-4022-bee1-a57cd1df642e service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:26.729411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28923ff1-61eb-4022-bee1-a57cd1df642e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:26.736011 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869333e-3904-4fca-ae8a-3f1b80befa00 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:26.738490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4869333e-3904-4fca-ae8a-3f1b80befa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:26.747162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28923ff1-61eb-4022-bee1-a57cd1df642e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:26.748904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28923ff1-61eb-4022-bee1-a57cd1df642e service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:26.763787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 910/1832] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:26.766411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869333e-3904-4fca-ae8a-3f1b80befa00 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:26.771427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:26.772322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:26.772601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:26.772878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] PATH_INFO: `/v3/projects/ab918b432d984b0a953b898ff68f4406` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:26.774206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab918b432d984b0a953b898ff68f4406)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:26.777017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:26.871187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab918b432d984b0a953b898ff68f4406', 'request_id': 'req-1c38389e-4d18-4631-b295-c52f081317ee'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.879500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab918b432d984b0a953b898ff68f4406', 'request_id': 'req-1c38389e-4d18-4631-b295-c52f081317ee'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.889079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab918b432d984b0a953b898ff68f4406', 'request_id': 'req-1c38389e-4d18-4631-b295-c52f081317ee'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.909655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] The token cache is being invalidate because project ab918b432d984b0a953b898ff68f4406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:26.909946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.910651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:26.916096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 923/1833] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:26 2022] DELETE /identity/v3/projects/ab918b432d984b0a953b898ff68f4406 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:26.918177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28923ff1-61eb-4022-bee1-a57cd1df642e service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:26.928531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28923ff1-61eb-4022-bee1-a57cd1df642e service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:26.998577 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:27.011933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:27.015223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:27.016251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:27.016828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] PATH_INFO: `/v3/users/afbfce94d54a466789e801a377ae219e` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:27.020013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=afbfce94d54a466789e801a377ae219e)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:27.022507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:27.041043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:27.043368 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:27.064956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38389e-4d18-4631-b295-c52f081317ee admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:27.070831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:27.072020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:27.072234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:27.072746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] PATH_INFO: `/v3/projects/8a351be7dbce4308aabda439e1c53f97` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:27.074136 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a351be7dbce4308aabda439e1c53f97)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:27.076690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:27.102531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afbfce94d54a466789e801a377ae219e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.120511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afbfce94d54a466789e801a377ae219e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.121774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afbfce94d54a466789e801a377ae219e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.135089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afbfce94d54a466789e801a377ae219e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.135833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afbfce94d54a466789e801a377ae219e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.144239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a351be7dbce4308aabda439e1c53f97', 'request_id': 'req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.153568 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a351be7dbce4308aabda439e1c53f97', 'request_id': 'req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.166883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a351be7dbce4308aabda439e1c53f97', 'request_id': 'req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.169971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 911/1834] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:26 2022] DELETE /identity/v3/users/afbfce94d54a466789e801a377ae219e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:27.169971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:27.170769 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:27.190941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] The token cache is being invalidate because project 8a351be7dbce4308aabda439e1c53f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:27.191268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.192138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.197535 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 924/1835] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:27 2022] DELETE /identity/v3/projects/8a351be7dbce4308aabda439e1c53f97 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:27.198864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:27.201765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:27.244819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:27.257787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aadbb-cdd2-423c-bc3f-cbf45bb3df7c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:27.264674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:27.265778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:27.266125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:27.266514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] PATH_INFO: `/v3/projects/7a1011e77b1f4f9da2c4b8254578ceff` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:27.267754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1011e77b1f4f9da2c4b8254578ceff)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:27.270012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:27.275433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b612c7-a50b-47c3-b0c3-69ec91237ff4 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:27.281263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:27.282153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:27.282429 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:27.282707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] PATH_INFO: `/v3/projects/d9fb8b5de1304e15addb7df682da6f31` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:27.283925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9fb8b5de1304e15addb7df682da6f31)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:27.285852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:27.331396 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1011e77b1f4f9da2c4b8254578ceff', 'request_id': 'req-02a98860-b9f6-4052-9695-ade034c46c94'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.338217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9fb8b5de1304e15addb7df682da6f31', 'request_id': 'req-e1ba7824-2797-4073-8875-c7f81e7800ff'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.343602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1011e77b1f4f9da2c4b8254578ceff', 'request_id': 'req-02a98860-b9f6-4052-9695-ade034c46c94'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.345669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9fb8b5de1304e15addb7df682da6f31', 'request_id': 'req-e1ba7824-2797-4073-8875-c7f81e7800ff'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.355414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1011e77b1f4f9da2c4b8254578ceff', 'request_id': 'req-02a98860-b9f6-4052-9695-ade034c46c94'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.363471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9fb8b5de1304e15addb7df682da6f31', 'request_id': 'req-e1ba7824-2797-4073-8875-c7f81e7800ff'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.374114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] The token cache is being invalidate because project 7a1011e77b1f4f9da2c4b8254578ceff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:27.374114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.374896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-02a98860-b9f6-4052-9695-ade034c46c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.377294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 912/1836] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:27 2022] DELETE /identity/v3/projects/7a1011e77b1f4f9da2c4b8254578ceff => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:27.378365 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9272-af94-496a-9826-b80e00e3c2e3 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:27.378679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9272-af94-496a-9826-b80e00e3c2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:27.379134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9272-af94-496a-9826-b80e00e3c2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:27.394582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:27.396279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] The token cache is being invalidate because project d9fb8b5de1304e15addb7df682da6f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:27.396585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.398973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.403609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-495a9272-af94-496a-9826-b80e00e3c2e3 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:27.405645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-495a9272-af94-496a-9826-b80e00e3c2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:27.405921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 925/1837] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:27 2022] DELETE /identity/v3/projects/d9fb8b5de1304e15addb7df682da6f31 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:27.406854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:27.411055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:27.522914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba7824-2797-4073-8875-c7f81e7800ff admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:27.534881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6e74f-df30-46db-8e4a-64f6efda25c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:27.535817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e74f-df30-46db-8e4a-64f6efda25c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:27.536174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 913/1838] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:27.537082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9272-af94-496a-9826-b80e00e3c2e3 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:27.537700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e74f-df30-46db-8e4a-64f6efda25c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:27.539623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6e74f-df30-46db-8e4a-64f6efda25c0 admin admin] PATH_INFO: `/v3/users/df6ee3b64a014623af4d6742cb81d609` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:27.543242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6e74f-df30-46db-8e4a-64f6efda25c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6ee3b64a014623af4d6742cb81d609)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:27.544562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-495a9272-af94-496a-9826-b80e00e3c2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:27.551170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6e74f-df30-46db-8e4a-64f6efda25c0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:27.557662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9272-af94-496a-9826-b80e00e3c2e3 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:27.566142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:27.567099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:27.567384 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:27.567668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] PATH_INFO: `/v3/users/15bb49f1b08d480f868a8599c252a4d6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:27.568889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15bb49f1b08d480f868a8599c252a4d6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:27.570827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:27.646137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-73f6e74f-df30-46db-8e4a-64f6efda25c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6ee3b64a014623af4d6742cb81d609'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.660297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15bb49f1b08d480f868a8599c252a4d6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.662666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-73f6e74f-df30-46db-8e4a-64f6efda25c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6ee3b64a014623af4d6742cb81d609'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.666604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:27.673951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-73f6e74f-df30-46db-8e4a-64f6efda25c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6ee3b64a014623af4d6742cb81d609'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.679054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15bb49f1b08d480f868a8599c252a4d6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.680181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15bb49f1b08d480f868a8599c252a4d6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.689187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-73f6e74f-df30-46db-8e4a-64f6efda25c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6ee3b64a014623af4d6742cb81d609'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.691903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-73f6e74f-df30-46db-8e4a-64f6efda25c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6ee3b64a014623af4d6742cb81d609'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.692863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15bb49f1b08d480f868a8599c252a4d6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.693633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15bb49f1b08d480f868a8599c252a4d6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.698695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 926/1839] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:27 2022] DELETE /identity/v3/users/df6ee3b64a014623af4d6742cb81d609 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:27.700507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e3089-7506-4069-9875-eafb648a9d08 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:27.700793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e3089-7506-4069-9875-eafb648a9d08 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:27.701173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e3089-7506-4069-9875-eafb648a9d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:27.723064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ec4e3089-7506-4069-9875-eafb648a9d08 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:27.724379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ec4e3089-7506-4069-9875-eafb648a9d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:27.724913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 914/1840] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:27 2022] DELETE /identity/v3/users/15bb49f1b08d480f868a8599c252a4d6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:27.726022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:27.727632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:27.835868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffc362-e842-401c-9257-38d4698678f1 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:27.845189 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:27.846939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:27.847255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:27.847608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] PATH_INFO: `/v3/projects/94545340701d4d0ab3f3e4d94b3e3ee0` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:27.849092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94545340701d4d0ab3f3e4d94b3e3ee0)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:27.851902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:27.889638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 927/1841] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:27.894345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e3089-7506-4069-9875-eafb648a9d08 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:27.905466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e3089-7506-4069-9875-eafb648a9d08 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:27.908023 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:27.912654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dd8fc-a1c5-4015-82b1-0148985c6f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:27.914760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dd8fc-a1c5-4015-82b1-0148985c6f9c admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:27.915276 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dd8fc-a1c5-4015-82b1-0148985c6f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:27.915746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dd8fc-a1c5-4015-82b1-0148985c6f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:27.917018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dd8fc-a1c5-4015-82b1-0148985c6f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:27.917760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dd8fc-a1c5-4015-82b1-0148985c6f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:27.919853 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dd8fc-a1c5-4015-82b1-0148985c6f9c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:27.946932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 928/1842] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:27.947788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dd8fc-a1c5-4015-82b1-0148985c6f9c admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:27.960732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dd8fc-a1c5-4015-82b1-0148985c6f9c admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:27.964556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94545340701d4d0ab3f3e4d94b3e3ee0', 'request_id': 'req-a3c2a47d-22af-4883-a671-806243d50970'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.977159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94545340701d4d0ab3f3e4d94b3e3ee0', 'request_id': 'req-a3c2a47d-22af-4883-a671-806243d50970'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:27.993182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94545340701d4d0ab3f3e4d94b3e3ee0', 'request_id': 'req-a3c2a47d-22af-4883-a671-806243d50970'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.019063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] The token cache is being invalidate because project 94545340701d4d0ab3f3e4d94b3e3ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:28.019348 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.020251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a3c2a47d-22af-4883-a671-806243d50970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.028169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 915/1843] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:27 2022] DELETE /identity/v3/projects/94545340701d4d0ab3f3e4d94b3e3ee0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:28.029723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2d3a9-75b1-4f9c-bee0-fc8978b6cbb3 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.030157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2d3a9-75b1-4f9c-bee0-fc8978b6cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.030446 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2d3a9-75b1-4f9c-bee0-fc8978b6cbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.062642 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecfa7b-bcf1-411b-88e9-5729d7efc53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.063916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecfa7b-bcf1-411b-88e9-5729d7efc53d admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.064266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecfa7b-bcf1-411b-88e9-5729d7efc53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.064526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecfa7b-bcf1-411b-88e9-5729d7efc53d admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.065431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecfa7b-bcf1-411b-88e9-5729d7efc53d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.065548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-45e2d3a9-75b1-4f9c-bee0-fc8978b6cbb3 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:28.067532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-45e2d3a9-75b1-4f9c-bee0-fc8978b6cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.069525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecfa7b-bcf1-411b-88e9-5729d7efc53d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.083970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 916/1844] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:28.088775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc332f91-91ed-4f67-a812-69eb70fd47f9 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.089114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc332f91-91ed-4f67-a812-69eb70fd47f9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.090082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc332f91-91ed-4f67-a812-69eb70fd47f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.116232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-cc332f91-91ed-4f67-a812-69eb70fd47f9 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:28.117560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cc332f91-91ed-4f67-a812-69eb70fd47f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.129359 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 929/1845] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:27 2022] POST /identity/v3/projects => generated 363 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:28.136343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 917/1846] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:28.138601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecfa7b-bcf1-411b-88e9-5729d7efc53d admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.140711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc332f91-91ed-4f67-a812-69eb70fd47f9 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.140863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7eecfa7b-bcf1-411b-88e9-5729d7efc53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.153631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc332f91-91ed-4f67-a812-69eb70fd47f9 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.237678 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:28.247038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247193be-c3b9-4162-be55-9c730e05fa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.247038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247193be-c3b9-4162-be55-9c730e05fa1e admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.247038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247193be-c3b9-4162-be55-9c730e05fa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.247038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247193be-c3b9-4162-be55-9c730e05fa1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.247493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247193be-c3b9-4162-be55-9c730e05fa1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:28.249138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247193be-c3b9-4162-be55-9c730e05fa1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.250866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247193be-c3b9-4162-be55-9c730e05fa1e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.254064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecfa7b-bcf1-411b-88e9-5729d7efc53d admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.265378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f68f9-f405-427e-8296-c8b00d1f0825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.265916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 918/1847] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:28.266943 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247193be-c3b9-4162-be55-9c730e05fa1e admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.269611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f68f9-f405-427e-8296-c8b00d1f0825 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.270004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f68f9-f405-427e-8296-c8b00d1f0825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.270291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f68f9-f405-427e-8296-c8b00d1f0825 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.270537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-247193be-c3b9-4162-be55-9c730e05fa1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.271018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f68f9-f405-427e-8296-c8b00d1f0825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.273213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f68f9-f405-427e-8296-c8b00d1f0825 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.289994 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247193be-c3b9-4162-be55-9c730e05fa1e admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.301298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.302200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.302485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.302808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] PATH_INFO: `/v3/projects/37d1b1dc7dd34500b0bddc669faa3c79` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.304180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d1b1dc7dd34500b0bddc669faa3c79)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.304836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 930/1848] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:28 2022] POST /identity/v3/users => generated 282 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:28.305965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f68f9-f405-427e-8296-c8b00d1f0825 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.306369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.321131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f68f9-f405-427e-8296-c8b00d1f0825 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.328941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40375ee3-3667-43c1-9154-a219b2c8879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.329922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40375ee3-3667-43c1-9154-a219b2c8879e admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.330405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40375ee3-3667-43c1-9154-a219b2c8879e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.331032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40375ee3-3667-43c1-9154-a219b2c8879e admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.331859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40375ee3-3667-43c1-9154-a219b2c8879e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.334507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40375ee3-3667-43c1-9154-a219b2c8879e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.370466 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d1b1dc7dd34500b0bddc669faa3c79', 'request_id': 'req-16a2c832-bbfe-45b8-afa3-dd846f2b2551'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.379098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 931/1849] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:28 2022] POST /identity/v3/projects => generated 407 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:28.379098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40375ee3-3667-43c1-9154-a219b2c8879e admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.380097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d1b1dc7dd34500b0bddc669faa3c79', 'request_id': 'req-16a2c832-bbfe-45b8-afa3-dd846f2b2551'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.381705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-40375ee3-3667-43c1-9154-a219b2c8879e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.391319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d1b1dc7dd34500b0bddc669faa3c79', 'request_id': 'req-16a2c832-bbfe-45b8-afa3-dd846f2b2551'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.411605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] The token cache is being invalidate because project 37d1b1dc7dd34500b0bddc669faa3c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:28.412392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.413204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.416275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 919/1850] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:28 2022] DELETE /identity/v3/projects/37d1b1dc7dd34500b0bddc669faa3c79 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:28.417004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.418333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.436879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:28.466842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40375ee3-3667-43c1-9154-a219b2c8879e admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.475327 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.476863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.477180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.477465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] PATH_INFO: `/v3/projects/1bc03b3f16424c90a8777ad80ccfce54` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.483939 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc03b3f16424c90a8777ad80ccfce54)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.486209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.516381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2c832-bbfe-45b8-afa3-dd846f2b2551 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.523018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6072a1-ec14-4eab-b16a-48352e3aa887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.523891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6072a1-ec14-4eab-b16a-48352e3aa887 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.524206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6072a1-ec14-4eab-b16a-48352e3aa887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.524519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6072a1-ec14-4eab-b16a-48352e3aa887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.525348 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6072a1-ec14-4eab-b16a-48352e3aa887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.527006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6072a1-ec14-4eab-b16a-48352e3aa887 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.537515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 920/1851] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:28.538306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6072a1-ec14-4eab-b16a-48352e3aa887 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.540570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4a6072a1-ec14-4eab-b16a-48352e3aa887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.547532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc03b3f16424c90a8777ad80ccfce54', 'request_id': 'req-617de46d-f537-4fe9-992a-ec434f883c7f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.553347 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6072a1-ec14-4eab-b16a-48352e3aa887 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.554925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc03b3f16424c90a8777ad80ccfce54', 'request_id': 'req-617de46d-f537-4fe9-992a-ec434f883c7f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.564501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc03b3f16424c90a8777ad80ccfce54', 'request_id': 'req-617de46d-f537-4fe9-992a-ec434f883c7f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.577719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] The token cache is being invalidate because project 1bc03b3f16424c90a8777ad80ccfce54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:28.578005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.578654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-617de46d-f537-4fe9-992a-ec434f883c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:28.580947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 932/1852] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:28 2022] DELETE /identity/v3/projects/1bc03b3f16424c90a8777ad80ccfce54 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:28.581790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62412049-a4e9-40bf-83fc-a331fe5ade47 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.582071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62412049-a4e9-40bf-83fc-a331fe5ade47 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.582351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62412049-a4e9-40bf-83fc-a331fe5ade47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.606198 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-62412049-a4e9-40bf-83fc-a331fe5ade47 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:28.607653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-62412049-a4e9-40bf-83fc-a331fe5ade47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.625705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e31ab1-6acf-4288-8844-95607a228261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.626312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31ab1-6acf-4288-8844-95607a228261 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.626598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31ab1-6acf-4288-8844-95607a228261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.626873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e31ab1-6acf-4288-8844-95607a228261 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.627600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e31ab1-6acf-4288-8844-95607a228261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.629529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e31ab1-6acf-4288-8844-95607a228261 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.652902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 921/1853] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:28 2022] POST /identity/v3/users => generated 304 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:28.652902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e31ab1-6acf-4288-8844-95607a228261 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.652902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d9e31ab1-6acf-4288-8844-95607a228261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.662624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:28.664519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e31ab1-6acf-4288-8844-95607a228261 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.669617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8659c-cefb-414c-b0e3-dfb2391c1c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.670284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8659c-cefb-414c-b0e3-dfb2391c1c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.670567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8659c-cefb-414c-b0e3-dfb2391c1c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.670930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8659c-cefb-414c-b0e3-dfb2391c1c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.671828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8659c-cefb-414c-b0e3-dfb2391c1c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.673649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8659c-cefb-414c-b0e3-dfb2391c1c0f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.684951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 933/1854] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:28.685146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 922/1855] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:28.685706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b206295-2f34-4cad-b791-1bcf71397c89 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.685825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8659c-cefb-414c-b0e3-dfb2391c1c0f admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.685907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b206295-2f34-4cad-b791-1bcf71397c89 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.686277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b206295-2f34-4cad-b791-1bcf71397c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.687606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-20e8659c-cefb-414c-b0e3-dfb2391c1c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.701389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8659c-cefb-414c-b0e3-dfb2391c1c0f admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.706266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde653ad-5d9e-4991-b63f-23fac3f2918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.707024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4b206295-2f34-4cad-b791-1bcf71397c89 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:28.707890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde653ad-5d9e-4991-b63f-23fac3f2918c admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.708212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde653ad-5d9e-4991-b63f-23fac3f2918c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.708334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4b206295-2f34-4cad-b791-1bcf71397c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.708511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde653ad-5d9e-4991-b63f-23fac3f2918c admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.709226 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde653ad-5d9e-4991-b63f-23fac3f2918c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.710837 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde653ad-5d9e-4991-b63f-23fac3f2918c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.725174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 923/1856] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:28.725174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac976f5-2f7c-44de-b70a-a973d2f8d052 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.725174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac976f5-2f7c-44de-b70a-a973d2f8d052 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.725174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac976f5-2f7c-44de-b70a-a973d2f8d052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.725869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 934/1857] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:28.726587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b206295-2f34-4cad-b791-1bcf71397c89 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.736369 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b206295-2f34-4cad-b791-1bcf71397c89 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.741053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916c53e-5dec-425a-b564-a05f28a9bb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.741960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916c53e-5dec-425a-b564-a05f28a9bb91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.742245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916c53e-5dec-425a-b564-a05f28a9bb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.742520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916c53e-5dec-425a-b564-a05f28a9bb91 admin admin] PATH_INFO: `/v3/projects/f95e4543a60c4d5ba6fbfbf1e7cc262e/users/6e15a43331664da88e0dd7ceb3e67048/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.744920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5ac976f5-2f7c-44de-b70a-a973d2f8d052 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:28.746404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5ac976f5-2f7c-44de-b70a-a973d2f8d052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.754873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 924/1858] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:28.755781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac976f5-2f7c-44de-b70a-a973d2f8d052 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.761714 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916c53e-5dec-425a-b564-a05f28a9bb91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95e4543a60c4d5ba6fbfbf1e7cc262e, user_id=6e15a43331664da88e0dd7ceb3e67048, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.765333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916c53e-5dec-425a-b564-a05f28a9bb91 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.765775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac976f5-2f7c-44de-b70a-a973d2f8d052 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.771264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a72ea-39f7-4797-8e36-3760d0a90666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.772305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a72ea-39f7-4797-8e36-3760d0a90666 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.772650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a72ea-39f7-4797-8e36-3760d0a90666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.773088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a72ea-39f7-4797-8e36-3760d0a90666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.773865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a72ea-39f7-4797-8e36-3760d0a90666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.775866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a72ea-39f7-4797-8e36-3760d0a90666 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.781648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 935/1859] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:28 2022] PUT /identity/v3/projects/f95e4543a60c4d5ba6fbfbf1e7cc262e/users/6e15a43331664da88e0dd7ceb3e67048/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:28.783152 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c46e2-a089-420a-a084-77455bd5777a None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.783651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c46e2-a089-420a-a084-77455bd5777a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.784494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c46e2-a089-420a-a084-77455bd5777a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.791682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 925/1860] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:28.792937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a72ea-39f7-4797-8e36-3760d0a90666 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.805425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5f8c46e2-a089-420a-a084-77455bd5777a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:28.805633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a72ea-39f7-4797-8e36-3760d0a90666 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.806927 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5f8c46e2-a089-420a-a084-77455bd5777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.863101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ec005-4dc3-4f15-92b3-70618a6534a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.863799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ec005-4dc3-4f15-92b3-70618a6534a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.864084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ec005-4dc3-4f15-92b3-70618a6534a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.864360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ec005-4dc3-4f15-92b3-70618a6534a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.865088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ec005-4dc3-4f15-92b3-70618a6534a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:28.865397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ec005-4dc3-4f15-92b3-70618a6534a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.867031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ec005-4dc3-4f15-92b3-70618a6534a2 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.868565 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:28.870423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 936/1861] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:28.871711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be3bf6-cb9b-4a77-a10a-73a7b28404ca None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.872003 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be3bf6-cb9b-4a77-a10a-73a7b28404ca None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.872284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be3bf6-cb9b-4a77-a10a-73a7b28404ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.886012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 926/1862] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:28.886012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ec005-4dc3-4f15-92b3-70618a6534a2 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.895037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ec005-4dc3-4f15-92b3-70618a6534a2 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:28.903326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0d58-b750-4aac-92aa-b0e36e92e3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:28.903326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0d58-b750-4aac-92aa-b0e36e92e3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:28.903326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0d58-b750-4aac-92aa-b0e36e92e3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:28.903326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0d58-b750-4aac-92aa-b0e36e92e3a0 admin admin] PATH_INFO: `/v3/projects/b81a2c34a782461f8214d69e4c48f2e5/users/5f05dacf9f544f12aa2d18f862b73382/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:28.914274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f5be3bf6-cb9b-4a77-a10a-73a7b28404ca None None] MFA Rules not processed for user `6e15a43331664da88e0dd7ceb3e67048`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:28.916282 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f5be3bf6-cb9b-4a77-a10a-73a7b28404ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:28.923451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced0d58-b750-4aac-92aa-b0e36e92e3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81a2c34a782461f8214d69e4c48f2e5, user_id=5f05dacf9f544f12aa2d18f862b73382, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:28.926333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced0d58-b750-4aac-92aa-b0e36e92e3a0 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:28.942158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 927/1863] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:28 2022] PUT /identity/v3/projects/b81a2c34a782461f8214d69e4c48f2e5/users/5f05dacf9f544f12aa2d18f862b73382/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:28.943054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0d58-b750-4aac-92aa-b0e36e92e3a0 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:28.997795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 937/1864] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:28.998799 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be3bf6-cb9b-4a77-a10a-73a7b28404ca None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.010055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be3bf6-cb9b-4a77-a10a-73a7b28404ca None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.015575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc91c1a-7066-454f-803b-31f25bdbddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.016432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91c1a-7066-454f-803b-31f25bdbddd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.016743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91c1a-7066-454f-803b-31f25bdbddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.017117 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91c1a-7066-454f-803b-31f25bdbddd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.017285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0d58-b750-4aac-92aa-b0e36e92e3a0 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.018057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc91c1a-7066-454f-803b-31f25bdbddd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.020104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc91c1a-7066-454f-803b-31f25bdbddd0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.021989 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3d535-9458-4778-9b05-677324be5e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.022776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3d535-9458-4778-9b05-677324be5e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.023079 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3d535-9458-4778-9b05-677324be5e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.023349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3d535-9458-4778-9b05-677324be5e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.024354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3d535-9458-4778-9b05-677324be5e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:29.025014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3d535-9458-4778-9b05-677324be5e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.026631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3d535-9458-4778-9b05-677324be5e36 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.040143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 928/1865] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:29.041546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d29fd-3455-4024-bbc1-28a76742181c None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.041827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d29fd-3455-4024-bbc1-28a76742181c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.042109 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d29fd-3455-4024-bbc1-28a76742181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.062802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 938/1866] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:28 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:29.062802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc91c1a-7066-454f-803b-31f25bdbddd0 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.072434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-857d29fd-3455-4024-bbc1-28a76742181c None None] MFA Rules not processed for user `5f05dacf9f544f12aa2d18f862b73382`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:29.073794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-857d29fd-3455-4024-bbc1-28a76742181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:29.099711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:29.133065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc91c1a-7066-454f-803b-31f25bdbddd0 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.138752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9691dd-2cd1-4fc9-9ebb-8438acd59b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.139598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9691dd-2cd1-4fc9-9ebb-8438acd59b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.139984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9691dd-2cd1-4fc9-9ebb-8438acd59b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.140422 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9691dd-2cd1-4fc9-9ebb-8438acd59b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.141333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9691dd-2cd1-4fc9-9ebb-8438acd59b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.143436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9691dd-2cd1-4fc9-9ebb-8438acd59b35 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.155428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 929/1867] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:29.155428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d29fd-3455-4024-bbc1-28a76742181c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.166656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d29fd-3455-4024-bbc1-28a76742181c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.174095 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6aad4-22a7-4951-9757-8b5bff10ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.174916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6aad4-22a7-4951-9757-8b5bff10ba91 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.175715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6aad4-22a7-4951-9757-8b5bff10ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.178956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6aad4-22a7-4951-9757-8b5bff10ba91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.179112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 939/1868] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:29 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:29.179207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6aad4-22a7-4951-9757-8b5bff10ba91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.179312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9691dd-2cd1-4fc9-9ebb-8438acd59b35 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.179683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6aad4-22a7-4951-9757-8b5bff10ba91 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.217896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 930/1869] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:29 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:29.218816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6aad4-22a7-4951-9757-8b5bff10ba91 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.252608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9691dd-2cd1-4fc9-9ebb-8438acd59b35 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.266453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:29.303877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6aad4-22a7-4951-9757-8b5bff10ba91 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.309520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99624d8f-ec7e-4064-a915-75575278829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.310229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99624d8f-ec7e-4064-a915-75575278829c admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.310508 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99624d8f-ec7e-4064-a915-75575278829c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.310784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99624d8f-ec7e-4064-a915-75575278829c admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.311518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99624d8f-ec7e-4064-a915-75575278829c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.313789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99624d8f-ec7e-4064-a915-75575278829c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.328559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e3b2-0cd1-4730-8f5c-2e24f39c6ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.329698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e3b2-0cd1-4730-8f5c-2e24f39c6ffc admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.330701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e3b2-0cd1-4730-8f5c-2e24f39c6ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.331000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e3b2-0cd1-4730-8f5c-2e24f39c6ffc admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.332222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9e3b2-0cd1-4730-8f5c-2e24f39c6ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.335320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9e3b2-0cd1-4730-8f5c-2e24f39c6ffc admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.347952 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 931/1870] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:29 2022] POST /identity/v3/projects => generated 409 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:29.348725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99624d8f-ec7e-4064-a915-75575278829c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.363066 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 940/1871] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:29 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:29.364120 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e3b2-0cd1-4730-8f5c-2e24f39c6ffc admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.374795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e3b2-0cd1-4730-8f5c-2e24f39c6ffc admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.412750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99624d8f-ec7e-4064-a915-75575278829c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.417830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b24cc-5ef0-4ac7-b883-942191a4354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.418503 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b24cc-5ef0-4ac7-b883-942191a4354c admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.418786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b24cc-5ef0-4ac7-b883-942191a4354c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.419090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b24cc-5ef0-4ac7-b883-942191a4354c admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.419787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b24cc-5ef0-4ac7-b883-942191a4354c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.421730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b24cc-5ef0-4ac7-b883-942191a4354c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.423004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:29.435623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09e6a6-7563-4cfd-9ec1-4b174b87dd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.436321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09e6a6-7563-4cfd-9ec1-4b174b87dd37 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.436829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09e6a6-7563-4cfd-9ec1-4b174b87dd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.437143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09e6a6-7563-4cfd-9ec1-4b174b87dd37 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.437947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09e6a6-7563-4cfd-9ec1-4b174b87dd37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.440035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09e6a6-7563-4cfd-9ec1-4b174b87dd37 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.443128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 932/1872] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:29 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:29.443956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b24cc-5ef0-4ac7-b883-942191a4354c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.445738 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e20b24cc-5ef0-4ac7-b883-942191a4354c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:29.460737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b24cc-5ef0-4ac7-b883-942191a4354c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.464964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 941/1873] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:29 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:29.464964 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09e6a6-7563-4cfd-9ec1-4b174b87dd37 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.465506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.466375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.466653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.466927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] PATH_INFO: `/v3/users/c65b499c56ed4e4a8e46222def726bb7` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.468143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c65b499c56ed4e4a8e46222def726bb7)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.470064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.473305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09e6a6-7563-4cfd-9ec1-4b174b87dd37 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.477919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf727c-a433-4172-9cba-f7a42c1cff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.478618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf727c-a433-4172-9cba-f7a42c1cff81 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.478896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf727c-a433-4172-9cba-f7a42c1cff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.479214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf727c-a433-4172-9cba-f7a42c1cff81 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.479891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf727c-a433-4172-9cba-f7a42c1cff81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.481812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf727c-a433-4172-9cba-f7a42c1cff81 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.504618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 942/1874] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:29 2022] POST /identity/v3/users => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:29.504951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf727c-a433-4172-9cba-f7a42c1cff81 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.516618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf727c-a433-4172-9cba-f7a42c1cff81 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.521102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adacef0-fa06-423d-b28a-e43f77ea6e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.521751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adacef0-fa06-423d-b28a-e43f77ea6e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.522030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adacef0-fa06-423d-b28a-e43f77ea6e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.522307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adacef0-fa06-423d-b28a-e43f77ea6e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.523049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adacef0-fa06-423d-b28a-e43f77ea6e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.523736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65b499c56ed4e4a8e46222def726bb7'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:29.524694 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adacef0-fa06-423d-b28a-e43f77ea6e98 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.535398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 943/1875] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:29.535579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65b499c56ed4e4a8e46222def726bb7'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:29.536205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65b499c56ed4e4a8e46222def726bb7'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:29.536739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adacef0-fa06-423d-b28a-e43f77ea6e98 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.544491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65b499c56ed4e4a8e46222def726bb7'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:29.545140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65b499c56ed4e4a8e46222def726bb7'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:29.546940 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adacef0-fa06-423d-b28a-e43f77ea6e98 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.551641 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86c65a-5607-4a02-b533-0dd427eb0520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.552319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86c65a-5607-4a02-b533-0dd427eb0520 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.552605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86c65a-5607-4a02-b533-0dd427eb0520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.552885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86c65a-5607-4a02-b533-0dd427eb0520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.553609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86c65a-5607-4a02-b533-0dd427eb0520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.555263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86c65a-5607-4a02-b533-0dd427eb0520 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.559989 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 933/1876] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:29 2022] DELETE /identity/v3/users/c65b499c56ed4e4a8e46222def726bb7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:29.560789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.562122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:29.571909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 944/1877] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:29.571909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86c65a-5607-4a02-b533-0dd427eb0520 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.571909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3a86c65a-5607-4a02-b533-0dd427eb0520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:29.581747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:29.583195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86c65a-5607-4a02-b533-0dd427eb0520 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.632775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e08c2-ceda-40e1-bddc-baaa4a8b73c9 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.637783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a989fe-7e7f-417a-8126-52ac0490dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.638488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a989fe-7e7f-417a-8126-52ac0490dc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.638756 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a989fe-7e7f-417a-8126-52ac0490dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.639069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a989fe-7e7f-417a-8126-52ac0490dc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.640066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a989fe-7e7f-417a-8126-52ac0490dc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.640807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60246b6-1f58-4606-86a9-7fcaae8ba00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.641486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a989fe-7e7f-417a-8126-52ac0490dc6b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.641634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60246b6-1f58-4606-86a9-7fcaae8ba00c admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.642065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60246b6-1f58-4606-86a9-7fcaae8ba00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.642487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60246b6-1f58-4606-86a9-7fcaae8ba00c admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.643478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60246b6-1f58-4606-86a9-7fcaae8ba00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.645145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60246b6-1f58-4606-86a9-7fcaae8ba00c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.652731 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 934/1878] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:29.653570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a989fe-7e7f-417a-8126-52ac0490dc6b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.655307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-81a989fe-7e7f-417a-8126-52ac0490dc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:29.659220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 945/1879] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:29.660531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9ece0-565c-4a17-95fb-138e770154eb None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.660816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9ece0-565c-4a17-95fb-138e770154eb None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.661095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9ece0-565c-4a17-95fb-138e770154eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.672520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a989fe-7e7f-417a-8126-52ac0490dc6b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.677240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c4a6d-83ce-4022-bd86-6c6942c144f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.677922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c4a6d-83ce-4022-bd86-6c6942c144f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.678201 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c4a6d-83ce-4022-bd86-6c6942c144f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.678474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c4a6d-83ce-4022-bd86-6c6942c144f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.679231 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c4a6d-83ce-4022-bd86-6c6942c144f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.680885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c4a6d-83ce-4022-bd86-6c6942c144f5 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.682879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-91c9ece0-565c-4a17-95fb-138e770154eb None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:29.684450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-91c9ece0-565c-4a17-95fb-138e770154eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:29.691473 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 935/1880] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:29.692173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c4a6d-83ce-4022-bd86-6c6942c144f5 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.693908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-555c4a6d-83ce-4022-bd86-6c6942c144f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:29.696129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 946/1881] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:29.697203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9ece0-565c-4a17-95fb-138e770154eb None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.706651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9ece0-565c-4a17-95fb-138e770154eb None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.711214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c4a6d-83ce-4022-bd86-6c6942c144f5 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.711868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244c3aa-1155-4df4-9834-2665d9948561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.712658 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244c3aa-1155-4df4-9834-2665d9948561 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.712935 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244c3aa-1155-4df4-9834-2665d9948561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.713208 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244c3aa-1155-4df4-9834-2665d9948561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.713932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244c3aa-1155-4df4-9834-2665d9948561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.715580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244c3aa-1155-4df4-9834-2665d9948561 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.716290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beae702-4870-4bc5-b82a-c2ce2d10692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.717187 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae702-4870-4bc5-b82a-c2ce2d10692c admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.717476 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae702-4870-4bc5-b82a-c2ce2d10692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.717747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae702-4870-4bc5-b82a-c2ce2d10692c admin admin] PATH_INFO: `/v3/projects/06341aff6370463c9ade1d19c5301988/users/860f97156734415c924322996fd65096/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.727145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 947/1882] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:29.728245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244c3aa-1155-4df4-9834-2665d9948561 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.737867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beae702-4870-4bc5-b82a-c2ce2d10692c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06341aff6370463c9ade1d19c5301988, user_id=860f97156734415c924322996fd65096, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.738809 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244c3aa-1155-4df4-9834-2665d9948561 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.740718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beae702-4870-4bc5-b82a-c2ce2d10692c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.743873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd37f3-2534-4051-bf48-3d2980fcb83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.744842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd37f3-2534-4051-bf48-3d2980fcb83b admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.745125 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd37f3-2534-4051-bf48-3d2980fcb83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.745398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd37f3-2534-4051-bf48-3d2980fcb83b admin admin] PATH_INFO: `/v3/projects/e19cbe06dbe14cb98c0857597e039025/users/47a1fb67740945cab457568c3dd60d95/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.759713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 936/1883] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:29 2022] PUT /identity/v3/projects/06341aff6370463c9ade1d19c5301988/users/860f97156734415c924322996fd65096/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:29.759713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beae702-4870-4bc5-b82a-c2ce2d10692c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.832023 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beae702-4870-4bc5-b82a-c2ce2d10692c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.839682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c104e8f-27e2-43ce-b478-326850deb152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.840688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104e8f-27e2-43ce-b478-326850deb152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.841107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104e8f-27e2-43ce-b478-326850deb152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.841378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104e8f-27e2-43ce-b478-326850deb152 admin admin] PATH_INFO: `/v3/projects/7c233e55f2514786935e01002fa58ae7/users/fd048c6b28a943f78a0661c1754036bd/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.859694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c104e8f-27e2-43ce-b478-326850deb152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c233e55f2514786935e01002fa58ae7, user_id=fd048c6b28a943f78a0661c1754036bd, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.862533 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c104e8f-27e2-43ce-b478-326850deb152 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.879865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 937/1884] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:29 2022] PUT /identity/v3/projects/7c233e55f2514786935e01002fa58ae7/users/fd048c6b28a943f78a0661c1754036bd/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:29.880823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c104e8f-27e2-43ce-b478-326850deb152 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.882466 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1c104e8f-27e2-43ce-b478-326850deb152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:29.889675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd37f3-2534-4051-bf48-3d2980fcb83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19cbe06dbe14cb98c0857597e039025, user_id=47a1fb67740945cab457568c3dd60d95, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:29.892662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd37f3-2534-4051-bf48-3d2980fcb83b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:29.909028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 948/1885] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:29 2022] PUT /identity/v3/projects/e19cbe06dbe14cb98c0857597e039025/users/47a1fb67740945cab457568c3dd60d95/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:29.909962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd37f3-2534-4051-bf48-3d2980fcb83b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:29.946144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c104e8f-27e2-43ce-b478-326850deb152 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.961886 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:29.976991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd37f3-2534-4051-bf48-3d2980fcb83b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:29.983469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ead8c8-207f-496c-93ed-246f43ea4ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:29.984456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ead8c8-207f-496c-93ed-246f43ea4ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:29.984804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ead8c8-207f-496c-93ed-246f43ea4ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:29.985148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ead8c8-207f-496c-93ed-246f43ea4ae2 admin admin] PATH_INFO: `/v3/projects/647881b331f146a19665e0a27d43c0cb/users/48756e37d07144e1ada4ef8a99a594c5/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:29.988458 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:30.004171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ead8c8-207f-496c-93ed-246f43ea4ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647881b331f146a19665e0a27d43c0cb, user_id=48756e37d07144e1ada4ef8a99a594c5, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.006649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ad5b0-10e2-4902-813b-7cb05b9c2a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.006827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ead8c8-207f-496c-93ed-246f43ea4ae2 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.007456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad5b0-10e2-4902-813b-7cb05b9c2a9b service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.007809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad5b0-10e2-4902-813b-7cb05b9c2a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.008159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ad5b0-10e2-4902-813b-7cb05b9c2a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.018662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ad5b0-10e2-4902-813b-7cb05b9c2a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.020190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 949/1886] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:29 2022] PUT /identity/v3/projects/647881b331f146a19665e0a27d43c0cb/users/48756e37d07144e1ada4ef8a99a594c5/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:30.020343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ad5b0-10e2-4902-813b-7cb05b9c2a9b service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.023868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ead8c8-207f-496c-93ed-246f43ea4ae2 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.030325 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 938/1887] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:30.031755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb84b2-f224-4308-9d8f-9b021c2bba2d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.032113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb84b2-f224-4308-9d8f-9b021c2bba2d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.032450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb84b2-f224-4308-9d8f-9b021c2bba2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.059305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-8ddb84b2-f224-4308-9d8f-9b021c2bba2d None None] MFA Rules not processed for user `fd048c6b28a943f78a0661c1754036bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:30.060655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8ddb84b2-f224-4308-9d8f-9b021c2bba2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.091449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ead8c8-207f-496c-93ed-246f43ea4ae2 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.096504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee65c8-246d-41cf-ab03-c9dc309a251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.097209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee65c8-246d-41cf-ab03-c9dc309a251a admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.097566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee65c8-246d-41cf-ab03-c9dc309a251a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.097929 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee65c8-246d-41cf-ab03-c9dc309a251a admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.098697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee65c8-246d-41cf-ab03-c9dc309a251a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.100394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee65c8-246d-41cf-ab03-c9dc309a251a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.112512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 950/1888] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:30.113393 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee65c8-246d-41cf-ab03-c9dc309a251a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.124490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee65c8-246d-41cf-ab03-c9dc309a251a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.129792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37082f-8ac8-4e00-affc-0898591d2a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.130525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37082f-8ac8-4e00-affc-0898591d2a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.130965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37082f-8ac8-4e00-affc-0898591d2a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.131336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37082f-8ac8-4e00-affc-0898591d2a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.132166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37082f-8ac8-4e00-affc-0898591d2a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.137971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37082f-8ac8-4e00-affc-0898591d2a80 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.138154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 939/1889] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:30.138154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50754629-c4d6-4880-b99e-3251c008d1f2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.138154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50754629-c4d6-4880-b99e-3251c008d1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.138154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50754629-c4d6-4880-b99e-3251c008d1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.153996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 951/1890] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:30.153996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37082f-8ac8-4e00-affc-0898591d2a80 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.163048 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37082f-8ac8-4e00-affc-0898591d2a80 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.165817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-50754629-c4d6-4880-b99e-3251c008d1f2 None None] MFA Rules not processed for user `48756e37d07144e1ada4ef8a99a594c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:30.167356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-50754629-c4d6-4880-b99e-3251c008d1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.168234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d9bfe-2bfc-4b10-8eb8-d673c0834111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.169141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d9bfe-2bfc-4b10-8eb8-d673c0834111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.169425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d9bfe-2bfc-4b10-8eb8-d673c0834111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.170021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d9bfe-2bfc-4b10-8eb8-d673c0834111 admin admin] PATH_INFO: `/v3/projects/06341aff6370463c9ade1d19c5301988/users/860f97156734415c924322996fd65096/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.171720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d9bfe-2bfc-4b10-8eb8-d673c0834111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06341aff6370463c9ade1d19c5301988, user_id=860f97156734415c924322996fd65096, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.174486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d9bfe-2bfc-4b10-8eb8-d673c0834111 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.187342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 952/1891] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:30 2022] PUT /identity/v3/projects/06341aff6370463c9ade1d19c5301988/users/860f97156734415c924322996fd65096/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:30.197594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d9bfe-2bfc-4b10-8eb8-d673c0834111 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.199436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-344d9bfe-2bfc-4b10-8eb8-d673c0834111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.250941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 940/1892] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:30.252014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50754629-c4d6-4880-b99e-3251c008d1f2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.263572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d9bfe-2bfc-4b10-8eb8-d673c0834111 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.265338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50754629-c4d6-4880-b99e-3251c008d1f2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.267404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611f916-613d-48f5-ac24-7dd4bdcaefdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.268154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f916-613d-48f5-ac24-7dd4bdcaefdd service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.268502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f916-613d-48f5-ac24-7dd4bdcaefdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.268915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f916-613d-48f5-ac24-7dd4bdcaefdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.307434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:30.330091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9381-2301-467c-b9f4-c761bb8200d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.331299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9381-2301-467c-b9f4-c761bb8200d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.331627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9381-2301-467c-b9f4-c761bb8200d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.331990 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9381-2301-467c-b9f4-c761bb8200d5 admin admin] PATH_INFO: `/v3/projects/e19cbe06dbe14cb98c0857597e039025/users/47a1fb67740945cab457568c3dd60d95/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.335670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9381-2301-467c-b9f4-c761bb8200d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19cbe06dbe14cb98c0857597e039025, user_id=47a1fb67740945cab457568c3dd60d95, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.336135 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611f916-613d-48f5-ac24-7dd4bdcaefdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.337758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611f916-613d-48f5-ac24-7dd4bdcaefdd service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.341200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9381-2301-467c-b9f4-c761bb8200d5 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.348277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 953/1893] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:30.351792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 941/1894] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:30 2022] PUT /identity/v3/projects/e19cbe06dbe14cb98c0857597e039025/users/47a1fb67740945cab457568c3dd60d95/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:30.352627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9381-2301-467c-b9f4-c761bb8200d5 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.364000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f44607-c232-4618-97ef-a33304f2221c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.364359 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f44607-c232-4618-97ef-a33304f2221c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.364705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f44607-c232-4618-97ef-a33304f2221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.384345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:30.395989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-e1f44607-c232-4618-97ef-a33304f2221c None None] MFA Rules not processed for user `860f97156734415c924322996fd65096`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:30.397586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e1f44607-c232-4618-97ef-a33304f2221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.441891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9381-2301-467c-b9f4-c761bb8200d5 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.449368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787a833-ed08-45d8-bdac-82303eb78d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.450310 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787a833-ed08-45d8-bdac-82303eb78d57 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.450790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787a833-ed08-45d8-bdac-82303eb78d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.451292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787a833-ed08-45d8-bdac-82303eb78d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.452064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787a833-ed08-45d8-bdac-82303eb78d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.454207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787a833-ed08-45d8-bdac-82303eb78d57 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.470946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 954/1895] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:30.471922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f44607-c232-4618-97ef-a33304f2221c None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.473231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e1f44607-c232-4618-97ef-a33304f2221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.493055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 942/1896] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:30 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:30.494054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1a08-5942-4e70-9336-357cca1e63fb None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.497635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f44607-c232-4618-97ef-a33304f2221c None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.500314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1a08-5942-4e70-9336-357cca1e63fb None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.500628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1a08-5942-4e70-9336-357cca1e63fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.530246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-717b1a08-5942-4e70-9336-357cca1e63fb None None] MFA Rules not processed for user `47a1fb67740945cab457568c3dd60d95`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:30.531506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-717b1a08-5942-4e70-9336-357cca1e63fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.560400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.561311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.561590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.561862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] PATH_INFO: `/v3/projects/01e7203b8d4541f892946bfed752c8f8` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.563303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e7203b8d4541f892946bfed752c8f8)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.565238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.607793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 943/1897] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:30.608637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b1a08-5942-4e70-9336-357cca1e63fb None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.613354 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e7203b8d4541f892946bfed752c8f8', 'request_id': 'req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.618538 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b1a08-5942-4e70-9336-357cca1e63fb None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.620259 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e7203b8d4541f892946bfed752c8f8', 'request_id': 'req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.629643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e7203b8d4541f892946bfed752c8f8', 'request_id': 'req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.640418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] The token cache is being invalidate because project 01e7203b8d4541f892946bfed752c8f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:30.640707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.641411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.643009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 955/1898] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:30 2022] DELETE /identity/v3/projects/01e7203b8d4541f892946bfed752c8f8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:30.643778 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.645128 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.663386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:30.676342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:30.680022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.680975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.681262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.681557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] PATH_INFO: `/v3/users/fd048c6b28a943f78a0661c1754036bd` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.682929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd048c6b28a943f78a0661c1754036bd)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.684985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.707235 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12733bfe-64cd-4d8a-8ffc-c7361deeb3b4 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.711551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc942-c0cc-48d5-b17c-86c995ed0087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.712310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc942-c0cc-48d5-b17c-86c995ed0087 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.712592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc942-c0cc-48d5-b17c-86c995ed0087 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.712860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc942-c0cc-48d5-b17c-86c995ed0087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.714977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-76bfc942-c0cc-48d5-b17c-86c995ed0087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.730391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd048c6b28a943f78a0661c1754036bd'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.742170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd048c6b28a943f78a0661c1754036bd'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.742874 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd048c6b28a943f78a0661c1754036bd'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.750003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd048c6b28a943f78a0661c1754036bd'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.750668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd048c6b28a943f78a0661c1754036bd'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.764087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 944/1899] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:30 2022] DELETE /identity/v3/users/fd048c6b28a943f78a0661c1754036bd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:30.764876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.766306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.781137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfc942-c0cc-48d5-b17c-86c995ed0087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.782592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfc942-c0cc-48d5-b17c-86c995ed0087 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.792926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 956/1900] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:30.793586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc942-c0cc-48d5-b17c-86c995ed0087 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.794894 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-76bfc942-c0cc-48d5-b17c-86c995ed0087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.806116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc942-c0cc-48d5-b17c-86c995ed0087 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.834504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8850ec9-7b17-47a2-ba56-fc15fef164b8 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.839873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca0fe4-e59a-43a6-81a4-520b99b69d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.840932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca0fe4-e59a-43a6-81a4-520b99b69d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.841066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca0fe4-e59a-43a6-81a4-520b99b69d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.841316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca0fe4-e59a-43a6-81a4-520b99b69d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.842003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca0fe4-e59a-43a6-81a4-520b99b69d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.843987 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca0fe4-e59a-43a6-81a4-520b99b69d0b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.874437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 945/1901] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:30 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:30.874437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca0fe4-e59a-43a6-81a4-520b99b69d0b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:30.875697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-37ca0fe4-e59a-43a6-81a4-520b99b69d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.875843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af4d11-bb61-4bae-be7b-503a898fa933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.876397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af4d11-bb61-4bae-be7b-503a898fa933 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.876846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af4d11-bb61-4bae-be7b-503a898fa933 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.877502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af4d11-bb61-4bae-be7b-503a898fa933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.879479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-87af4d11-bb61-4bae-be7b-503a898fa933 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:30.892248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca0fe4-e59a-43a6-81a4-520b99b69d0b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:30.898818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:30.900038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.900333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.900997 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] PATH_INFO: `/v3/users/0e1a803fc46b4b7cb7134926fbf5ea5d` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.902429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1a803fc46b4b7cb7134926fbf5ea5d)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.905149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.950144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af4d11-bb61-4bae-be7b-503a898fa933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:30.951748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af4d11-bb61-4bae-be7b-503a898fa933 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:30.962384 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 957/1902] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:30.962583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1a803fc46b4b7cb7134926fbf5ea5d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.963776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=79,keystone:DELETE=17,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:30.965670 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a27a-3340-4fbe-af29-e0403cee7915 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:30.966018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a27a-3340-4fbe-af29-e0403cee7915 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:30.966408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a27a-3340-4fbe-af29-e0403cee7915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:30.984589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1a803fc46b4b7cb7134926fbf5ea5d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.985338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1a803fc46b4b7cb7134926fbf5ea5d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:30.988024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-bca0a27a-3340-4fbe-af29-e0403cee7915 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:30.989293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-bca0a27a-3340-4fbe-af29-e0403cee7915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.007209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 958/1903] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:31.007209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0a27a-3340-4fbe-af29-e0403cee7915 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:31.007497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1a803fc46b4b7cb7134926fbf5ea5d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:31.008087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1a803fc46b4b7cb7134926fbf5ea5d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:31.018216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0a27a-3340-4fbe-af29-e0403cee7915 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:31.028367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 946/1904] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:30 2022] DELETE /identity/v3/users/0e1a803fc46b4b7cb7134926fbf5ea5d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:31.029173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195f15f-6984-4468-a2e4-7de87d450c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:31.029859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f15f-6984-4468-a2e4-7de87d450c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.030151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f15f-6984-4468-a2e4-7de87d450c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.030464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f15f-6984-4468-a2e4-7de87d450c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.030644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:31.031505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195f15f-6984-4468-a2e4-7de87d450c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:31.033108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195f15f-6984-4468-a2e4-7de87d450c4f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:31.051499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.054189 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 959/1905] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:31.057252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195f15f-6984-4468-a2e4-7de87d450c4f admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:31.060281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4195f15f-6984-4468-a2e4-7de87d450c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.079791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:31.132149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bfecb-72d2-4508-aa22-15d4049398c6 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:31.136437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a376959-7817-40a8-af75-34518c90d2de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:31.137107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a376959-7817-40a8-af75-34518c90d2de service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.137394 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a376959-7817-40a8-af75-34518c90d2de service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.137698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a376959-7817-40a8-af75-34518c90d2de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.139802 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3a376959-7817-40a8-af75-34518c90d2de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.146968 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195f15f-6984-4468-a2e4-7de87d450c4f admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:31.223362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16746ce-ed68-4c74-9422-4f6d1c770952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:31.224266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16746ce-ed68-4c74-9422-4f6d1c770952 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.224542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16746ce-ed68-4c74-9422-4f6d1c770952 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.224832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16746ce-ed68-4c74-9422-4f6d1c770952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.226920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d16746ce-ed68-4c74-9422-4f6d1c770952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.228077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a376959-7817-40a8-af75-34518c90d2de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:31.229564 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a376959-7817-40a8-af75-34518c90d2de service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:31.248127 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 947/1906] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:31 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:31.249040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a376959-7817-40a8-af75-34518c90d2de service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:31.251536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3a376959-7817-40a8-af75-34518c90d2de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.306547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16746ce-ed68-4c74-9422-4f6d1c770952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:31.308353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16746ce-ed68-4c74-9422-4f6d1c770952 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:31.324324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 960/1907] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:31.325773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16746ce-ed68-4c74-9422-4f6d1c770952 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:31.328413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d16746ce-ed68-4c74-9422-4f6d1c770952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.343349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16746ce-ed68-4c74-9422-4f6d1c770952 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:31.350139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ecf97-5e8c-445f-ba9f-cd0cd69bc825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:31.351084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ecf97-5e8c-445f-ba9f-cd0cd69bc825 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.351534 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ecf97-5e8c-445f-ba9f-cd0cd69bc825 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.351818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ecf97-5e8c-445f-ba9f-cd0cd69bc825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.354277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-959ecf97-5e8c-445f-ba9f-cd0cd69bc825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.361631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a376959-7817-40a8-af75-34518c90d2de service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:31.367866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca06a1d-ba77-4bc7-908c-8c2f7de1390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:31.368957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca06a1d-ba77-4bc7-908c-8c2f7de1390d admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.369248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca06a1d-ba77-4bc7-908c-8c2f7de1390d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.369566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca06a1d-ba77-4bc7-908c-8c2f7de1390d admin admin] PATH_INFO: `/v3/projects/6666e220514e4deaa4df1f3b992fcb48/users/f840016713124fbcbf3177b3883da361/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.392110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca06a1d-ba77-4bc7-908c-8c2f7de1390d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6666e220514e4deaa4df1f3b992fcb48, user_id=f840016713124fbcbf3177b3883da361, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:31.396238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca06a1d-ba77-4bc7-908c-8c2f7de1390d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:31.434303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 948/1908] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:31 2022] PUT /identity/v3/projects/6666e220514e4deaa4df1f3b992fcb48/users/f840016713124fbcbf3177b3883da361/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:31.437317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca06a1d-ba77-4bc7-908c-8c2f7de1390d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:31.443297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:31.467755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ecf97-5e8c-445f-ba9f-cd0cd69bc825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:31.469473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ecf97-5e8c-445f-ba9f-cd0cd69bc825 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:31.481001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 961/1909] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:31.526502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca06a1d-ba77-4bc7-908c-8c2f7de1390d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:31.531330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9b1ce-17b7-40e7-8266-bc85f1bd4925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:31.532179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b1ce-17b7-40e7-8266-bc85f1bd4925 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.532449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b1ce-17b7-40e7-8266-bc85f1bd4925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.532835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b1ce-17b7-40e7-8266-bc85f1bd4925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.534037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9b1ce-17b7-40e7-8266-bc85f1bd4925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:31.535667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9b1ce-17b7-40e7-8266-bc85f1bd4925 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:31.549532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 949/1910] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:31.550405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ecf97-5e8c-445f-ba9f-cd0cd69bc825 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:31.552538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-959ecf97-5e8c-445f-ba9f-cd0cd69bc825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.553724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9b1ce-17b7-40e7-8266-bc85f1bd4925 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:31.569919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ecf97-5e8c-445f-ba9f-cd0cd69bc825 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:31.576019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9b1ce-17b7-40e7-8266-bc85f1bd4925 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:31.580831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:31.582878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92554f35-666f-45a0-9b13-d8a1b0bc4291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:31.583431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.583741 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.584065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92554f35-666f-45a0-9b13-d8a1b0bc4291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.584189 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] PATH_INFO: `/v3/projects/dd03095f36754c059f6febea0e8af65e` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.584539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92554f35-666f-45a0-9b13-d8a1b0bc4291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.585773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd03095f36754c059f6febea0e8af65e)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:31.585889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92554f35-666f-45a0-9b13-d8a1b0bc4291 admin admin] PATH_INFO: `/v3/projects/6666e220514e4deaa4df1f3b992fcb48/users/f840016713124fbcbf3177b3883da361/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.587994 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92554f35-666f-45a0-9b13-d8a1b0bc4291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6666e220514e4deaa4df1f3b992fcb48, user_id=f840016713124fbcbf3177b3883da361, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:31.591371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92554f35-666f-45a0-9b13-d8a1b0bc4291 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:31.606380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 950/1911] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:31 2022] PUT /identity/v3/projects/6666e220514e4deaa4df1f3b992fcb48/users/f840016713124fbcbf3177b3883da361/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:31.616679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b88096-1254-46c0-bbc5-47b4d218eacd None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.617061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b88096-1254-46c0-bbc5-47b4d218eacd None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.617567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b88096-1254-46c0-bbc5-47b4d218eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.620987 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:31.657561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:31.664675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-28b88096-1254-46c0-bbc5-47b4d218eacd None None] MFA Rules not processed for user `f840016713124fbcbf3177b3883da361`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:31.666111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-28b88096-1254-46c0-bbc5-47b4d218eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.744386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd03095f36754c059f6febea0e8af65e', 'request_id': 'req-9457cd32-f4e8-415d-b088-577295462922'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:31.755428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd03095f36754c059f6febea0e8af65e', 'request_id': 'req-9457cd32-f4e8-415d-b088-577295462922'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:31.768527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd03095f36754c059f6febea0e8af65e', 'request_id': 'req-9457cd32-f4e8-415d-b088-577295462922'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:31.778217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 951/1912] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:31.785730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] The token cache is being invalidate because project dd03095f36754c059f6febea0e8af65e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:31.786093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:31.787026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:31.789243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 962/1913] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:31 2022] DELETE /identity/v3/projects/dd03095f36754c059f6febea0e8af65e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:31.793801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72549d5e-c2be-4e56-9485-d06d47aa510f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.794160 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72549d5e-c2be-4e56-9485-d06d47aa510f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.794537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72549d5e-c2be-4e56-9485-d06d47aa510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.798312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:31.812526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.827457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-72549d5e-c2be-4e56-9485-d06d47aa510f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:31.829110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-72549d5e-c2be-4e56-9485-d06d47aa510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.901104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457cd32-f4e8-415d-b088-577295462922 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:31.906320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a6a07-cb6e-4119-8810-304ceb95fe70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:31.907345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a6a07-cb6e-4119-8810-304ceb95fe70 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.907637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a6a07-cb6e-4119-8810-304ceb95fe70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.907917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a6a07-cb6e-4119-8810-304ceb95fe70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.910341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-996a6a07-cb6e-4119-8810-304ceb95fe70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.927542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 952/1914] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:31.928649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72549d5e-c2be-4e56-9485-d06d47aa510f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:31.930105 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-72549d5e-c2be-4e56-9485-d06d47aa510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:31.943668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72549d5e-c2be-4e56-9485-d06d47aa510f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:31.950289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:31.951272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:31.951643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:31.951959 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] PATH_INFO: `/v3/projects/7c233e55f2514786935e01002fa58ae7` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:31.953276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c233e55f2514786935e01002fa58ae7)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:31.956046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:31.964448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:31.995390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a6a07-cb6e-4119-8810-304ceb95fe70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:31.996789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a6a07-cb6e-4119-8810-304ceb95fe70 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.009425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 963/1915] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:32.009425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbfc37-61b7-43fd-9d34-adf0c83b57e6 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.009680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbfc37-61b7-43fd-9d34-adf0c83b57e6 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.012846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c233e55f2514786935e01002fa58ae7', 'request_id': 'req-ea8dff94-1419-4cc7-9aba-82161a6d0099'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:32.016083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbfc37-61b7-43fd-9d34-adf0c83b57e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.026922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c233e55f2514786935e01002fa58ae7', 'request_id': 'req-ea8dff94-1419-4cc7-9aba-82161a6d0099'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:32.040840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c233e55f2514786935e01002fa58ae7', 'request_id': 'req-ea8dff94-1419-4cc7-9aba-82161a6d0099'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:32.048834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4ddbfc37-61b7-43fd-9d34-adf0c83b57e6 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:32.050428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4ddbfc37-61b7-43fd-9d34-adf0c83b57e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:32.056314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] The token cache is being invalidate because project 7c233e55f2514786935e01002fa58ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:32.056620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:32.057299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ea8dff94-1419-4cc7-9aba-82161a6d0099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:32.060133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 953/1916] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:31 2022] DELETE /identity/v3/projects/7c233e55f2514786935e01002fa58ae7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:32.065625 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1155b-2b97-4c6c-add7-60d644383781 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.066073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1155b-2b97-4c6c-add7-60d644383781 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.066483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1155b-2b97-4c6c-add7-60d644383781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.089274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-92f1155b-2b97-4c6c-add7-60d644383781 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:32.090513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-92f1155b-2b97-4c6c-add7-60d644383781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:32.110018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:32.142914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 964/1917] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:32.147364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbfc37-61b7-43fd-9d34-adf0c83b57e6 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.159292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbfc37-61b7-43fd-9d34-adf0c83b57e6 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.164855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd1a26-cd10-4519-be13-c09eb7ab7159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.166102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd1a26-cd10-4519-be13-c09eb7ab7159 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.166458 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd1a26-cd10-4519-be13-c09eb7ab7159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.166802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd1a26-cd10-4519-be13-c09eb7ab7159 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.167821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd1a26-cd10-4519-be13-c09eb7ab7159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:32.168102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd1a26-cd10-4519-be13-c09eb7ab7159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.169792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd1a26-cd10-4519-be13-c09eb7ab7159 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.171339 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 954/1918] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:32.181180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30bb0-a585-4fd8-8b68-34f863349fc8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.181594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30bb0-a585-4fd8-8b68-34f863349fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.181934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30bb0-a585-4fd8-8b68-34f863349fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.194809 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 965/1919] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 03:05:32.198028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd1a26-cd10-4519-be13-c09eb7ab7159 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.201913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-49a30bb0-a585-4fd8-8b68-34f863349fc8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:32.203341 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-49a30bb0-a585-4fd8-8b68-34f863349fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:32.208045 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd1a26-cd10-4519-be13-c09eb7ab7159 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.212458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 955/1920] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:32.212637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90ca2c-5bf4-40e9-9935-9af21f9e5c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.213345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90ca2c-5bf4-40e9-9935-9af21f9e5c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.213630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90ca2c-5bf4-40e9-9935-9af21f9e5c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.213903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90ca2c-5bf4-40e9-9935-9af21f9e5c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.214579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90ca2c-5bf4-40e9-9935-9af21f9e5c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.216417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30bb0-a585-4fd8-8b68-34f863349fc8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.216748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90ca2c-5bf4-40e9-9935-9af21f9e5c90 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.226264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30bb0-a585-4fd8-8b68-34f863349fc8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.233332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aa076-13ef-4c07-9acf-bbd5c1bc688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.234048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa076-13ef-4c07-9acf-bbd5c1bc688e admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.234389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa076-13ef-4c07-9acf-bbd5c1bc688e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.234945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa076-13ef-4c07-9acf-bbd5c1bc688e admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.235455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aa076-13ef-4c07-9acf-bbd5c1bc688e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:32.235778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aa076-13ef-4c07-9acf-bbd5c1bc688e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.237658 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aa076-13ef-4c07-9acf-bbd5c1bc688e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.252276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 956/1921] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:32.256298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aa076-13ef-4c07-9acf-bbd5c1bc688e admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.260473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 966/1922] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:32 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:32.269622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aa076-13ef-4c07-9acf-bbd5c1bc688e admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.276087 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90ca2c-5bf4-40e9-9935-9af21f9e5c90 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.362379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e90e83-e56b-4cbd-b5c0-aae85fd06639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.362939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e90e83-e56b-4cbd-b5c0-aae85fd06639 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.363491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e90e83-e56b-4cbd-b5c0-aae85fd06639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.363956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e90e83-e56b-4cbd-b5c0-aae85fd06639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.364969 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e90e83-e56b-4cbd-b5c0-aae85fd06639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.367599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e90e83-e56b-4cbd-b5c0-aae85fd06639 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.396202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:32.405850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90ca2c-5bf4-40e9-9935-9af21f9e5c90 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.408190 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 957/1923] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:32 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:32.414285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e90e83-e56b-4cbd-b5c0-aae85fd06639 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.511785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e90e83-e56b-4cbd-b5c0-aae85fd06639 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.518324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde3001-c0e5-470d-a931-11fbd99be57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.519135 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3001-c0e5-470d-a931-11fbd99be57d admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.519417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3001-c0e5-470d-a931-11fbd99be57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.519717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3001-c0e5-470d-a931-11fbd99be57d admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.520523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde3001-c0e5-470d-a931-11fbd99be57d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.522699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde3001-c0e5-470d-a931-11fbd99be57d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.529812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1130fa-4182-403b-9ebc-e0e4e6412882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.530556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1130fa-4182-403b-9ebc-e0e4e6412882 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.530934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1130fa-4182-403b-9ebc-e0e4e6412882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.531357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1130fa-4182-403b-9ebc-e0e4e6412882 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.532373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1130fa-4182-403b-9ebc-e0e4e6412882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.534737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1130fa-4182-403b-9ebc-e0e4e6412882 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.558102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 967/1924] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:32 2022] POST /identity/v3/users => generated 290 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:32.558102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde3001-c0e5-470d-a931-11fbd99be57d admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.560114 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5dde3001-c0e5-470d-a931-11fbd99be57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:32.575090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 958/1925] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:32 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:32.576106 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1130fa-4182-403b-9ebc-e0e4e6412882 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.598474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1130fa-4182-403b-9ebc-e0e4e6412882 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.606684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c853b28-345a-4d88-aaed-c9e61667616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.608138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c853b28-345a-4d88-aaed-c9e61667616b admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.608641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c853b28-345a-4d88-aaed-c9e61667616b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.608983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c853b28-345a-4d88-aaed-c9e61667616b admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.609891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c853b28-345a-4d88-aaed-c9e61667616b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.611702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c853b28-345a-4d88-aaed-c9e61667616b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.628716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 959/1926] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:32.628716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c853b28-345a-4d88-aaed-c9e61667616b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.639256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:32.641216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c853b28-345a-4d88-aaed-c9e61667616b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.650954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe8ebd-7c0f-497e-bdb4-8f88d5549184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.651714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe8ebd-7c0f-497e-bdb4-8f88d5549184 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.651949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe8ebd-7c0f-497e-bdb4-8f88d5549184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.652221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe8ebd-7c0f-497e-bdb4-8f88d5549184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.652948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe8ebd-7c0f-497e-bdb4-8f88d5549184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.654581 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe8ebd-7c0f-497e-bdb4-8f88d5549184 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.660719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde3001-c0e5-470d-a931-11fbd99be57d admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.666061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f08a3-6fbb-4069-a240-4417200f00c0 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f840016713124fbcbf3177b3883da361', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6666e220514e4deaa4df1f3b992fcb48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.666745 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f08a3-6fbb-4069-a240-4417200f00c0 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.667057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f08a3-6fbb-4069-a240-4417200f00c0 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.667341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f08a3-6fbb-4069-a240-4417200f00c0 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.668086 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f08a3-6fbb-4069-a240-4417200f00c0 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:32.668396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f08a3-6fbb-4069-a240-4417200f00c0 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.670013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f08a3-6fbb-4069-a240-4417200f00c0 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.673225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 960/1927] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:32.674061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe8ebd-7c0f-497e-bdb4-8f88d5549184 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.685041 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 968/1928] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:32.685551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe8ebd-7c0f-497e-bdb4-8f88d5549184 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.686041 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f08a3-6fbb-4069-a240-4417200f00c0 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.691415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b92c58-9b8c-42a6-84a4-9d0c980396c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.692157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b92c58-9b8c-42a6-84a4-9d0c980396c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.692520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b92c58-9b8c-42a6-84a4-9d0c980396c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.692856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b92c58-9b8c-42a6-84a4-9d0c980396c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.693863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b92c58-9b8c-42a6-84a4-9d0c980396c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.695703 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b92c58-9b8c-42a6-84a4-9d0c980396c1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.700706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f08a3-6fbb-4069-a240-4417200f00c0 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.706611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a726dc-3511-412a-bd1e-39fafad4652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.707379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a726dc-3511-412a-bd1e-39fafad4652e admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.707724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a726dc-3511-412a-bd1e-39fafad4652e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.708101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a726dc-3511-412a-bd1e-39fafad4652e admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.708886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a726dc-3511-412a-bd1e-39fafad4652e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.713643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 961/1929] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:32.714195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a726dc-3511-412a-bd1e-39fafad4652e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.714294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b92c58-9b8c-42a6-84a4-9d0c980396c1 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.722931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 969/1930] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:32.723682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a726dc-3511-412a-bd1e-39fafad4652e admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.725027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b92c58-9b8c-42a6-84a4-9d0c980396c1 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.730335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2a630-b190-4ccd-9c91-697636af9116 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f840016713124fbcbf3177b3883da361', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6666e220514e4deaa4df1f3b992fcb48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.731032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2a630-b190-4ccd-9c91-697636af9116 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.731341 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2a630-b190-4ccd-9c91-697636af9116 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.731823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2a630-b190-4ccd-9c91-697636af9116 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.732522 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2a630-b190-4ccd-9c91-697636af9116 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.734710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2a630-b190-4ccd-9c91-697636af9116 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.735938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a726dc-3511-412a-bd1e-39fafad4652e admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.740544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af7ba-5c46-43bf-a9ef-f9411fdec786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.741421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af7ba-5c46-43bf-a9ef-f9411fdec786 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.741694 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af7ba-5c46-43bf-a9ef-f9411fdec786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.741962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af7ba-5c46-43bf-a9ef-f9411fdec786 admin admin] PATH_INFO: `/v3/projects/60d8b33744ef4c998850b75238021964/users/184d5e91b8d74e25a9c0c615af452081/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.757227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06af7ba-5c46-43bf-a9ef-f9411fdec786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d8b33744ef4c998850b75238021964, user_id=184d5e91b8d74e25a9c0c615af452081, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.760357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06af7ba-5c46-43bf-a9ef-f9411fdec786 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.768298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 962/1931] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:32 2022] POST /identity/v3/projects => generated 355 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:32.769207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2a630-b190-4ccd-9c91-697636af9116 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.778619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 970/1932] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:32 2022] PUT /identity/v3/projects/60d8b33744ef4c998850b75238021964/users/184d5e91b8d74e25a9c0c615af452081/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:32.780191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af7ba-5c46-43bf-a9ef-f9411fdec786 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:32.878398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2a630-b190-4ccd-9c91-697636af9116 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.898809 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af7ba-5c46-43bf-a9ef-f9411fdec786 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:32.913635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50246eb4-9d0a-47e1-93fb-2dfac449c870 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f840016713124fbcbf3177b3883da361', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6666e220514e4deaa4df1f3b992fcb48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:32.914693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50246eb4-9d0a-47e1-93fb-2dfac449c870 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.914978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50246eb4-9d0a-47e1-93fb-2dfac449c870 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.915367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50246eb4-9d0a-47e1-93fb-2dfac449c870 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.916303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50246eb4-9d0a-47e1-93fb-2dfac449c870 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:32.916619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50246eb4-9d0a-47e1-93fb-2dfac449c870 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:32.918267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50246eb4-9d0a-47e1-93fb-2dfac449c870 tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:32.949443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 971/1933] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:32.949443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21659e5-b7b6-43aa-8adc-a79f83959444 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:32.949443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21659e5-b7b6-43aa-8adc-a79f83959444 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:32.949443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21659e5-b7b6-43aa-8adc-a79f83959444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:32.981439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:33.002917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d21659e5-b7b6-43aa-8adc-a79f83959444 None None] MFA Rules not processed for user `184d5e91b8d74e25a9c0c615af452081`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:33.004834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d21659e5-b7b6-43aa-8adc-a79f83959444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:33.024247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f41485-e85b-4ca0-a487-7fbc7b03c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:33.025788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f41485-e85b-4ca0-a487-7fbc7b03c555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.026626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f41485-e85b-4ca0-a487-7fbc7b03c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.027304 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f41485-e85b-4ca0-a487-7fbc7b03c555 admin admin] PATH_INFO: `/v3/projects/c0296934ea8141fcb1d684bb5f827ac0/users/021c793f77654951ba11f6ccc025a552/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.049494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f41485-e85b-4ca0-a487-7fbc7b03c555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0296934ea8141fcb1d684bb5f827ac0, user_id=021c793f77654951ba11f6ccc025a552, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:33.052957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f41485-e85b-4ca0-a487-7fbc7b03c555 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:33.071673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 963/1934] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:32 2022] PUT /identity/v3/projects/c0296934ea8141fcb1d684bb5f827ac0/users/021c793f77654951ba11f6ccc025a552/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:33.085480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95737770-afbd-41a9-ab93-33491bbae5d6 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.085926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95737770-afbd-41a9-ab93-33491bbae5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.086326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95737770-afbd-41a9-ab93-33491bbae5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.140004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 972/1935] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:33.140876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21659e5-b7b6-43aa-8adc-a79f83959444 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:33.148137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-95737770-afbd-41a9-ab93-33491bbae5d6 None None] MFA Rules not processed for user `021c793f77654951ba11f6ccc025a552`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:33.149907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-95737770-afbd-41a9-ab93-33491bbae5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:33.154695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21659e5-b7b6-43aa-8adc-a79f83959444 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:33.185751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:33.231519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f840016713124fbcbf3177b3883da361', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6666e220514e4deaa4df1f3b992fcb48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:33.233061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.233299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.233709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] PATH_INFO: `/v3/projects/ecea052d560e412e86d938caccc56772` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.235512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ecea052d560e412e86d938caccc56772)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:33.237460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:33.267171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 964/1936] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:33.268225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95737770-afbd-41a9-ab93-33491bbae5d6 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:33.305101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecea052d560e412e86d938caccc56772', 'request_id': 'req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:33.313865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecea052d560e412e86d938caccc56772', 'request_id': 'req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:33.327559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecea052d560e412e86d938caccc56772', 'request_id': 'req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:33.345938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] The token cache is being invalidate because project ecea052d560e412e86d938caccc56772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:33.346528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:33.347450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:33.350042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 973/1937] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:33 2022] DELETE /identity/v3/projects/ecea052d560e412e86d938caccc56772 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:33.351337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:33.366905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:33.376007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95737770-afbd-41a9-ab93-33491bbae5d6 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:33.440744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83afaa-8463-4b83-b281-5db91a557cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:33.441580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83afaa-8463-4b83-b281-5db91a557cab admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.441891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83afaa-8463-4b83-b281-5db91a557cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.442144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83afaa-8463-4b83-b281-5db91a557cab admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.442853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83afaa-8463-4b83-b281-5db91a557cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:33.446188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83afaa-8463-4b83-b281-5db91a557cab admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:33.451528 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:33.490780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 965/1938] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:33 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:33.492307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83afaa-8463-4b83-b281-5db91a557cab admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:33.496678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1e83afaa-8463-4b83-b281-5db91a557cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:33.545747 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b81ec-4f2e-4923-90f2-5940ac3da45a tempest-VolumeQuotaClassesTest-279672359 tempest-VolumeQuotaClassesTest-279672359-project-admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:33.611240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0caae-c161-46a4-8dca-41787c756b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:33.612395 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0caae-c161-46a4-8dca-41787c756b56 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.612781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0caae-c161-46a4-8dca-41787c756b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.613600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0caae-c161-46a4-8dca-41787c756b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.616538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5fb0caae-c161-46a4-8dca-41787c756b56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:33.628429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83afaa-8463-4b83-b281-5db91a557cab admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:33.634082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41341001-9f50-403f-ab2c-a8d1dd02108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:33.634820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341001-9f50-403f-ab2c-a8d1dd02108b admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.635130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341001-9f50-403f-ab2c-a8d1dd02108b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.635657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341001-9f50-403f-ab2c-a8d1dd02108b admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.636243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41341001-9f50-403f-ab2c-a8d1dd02108b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:33.638413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41341001-9f50-403f-ab2c-a8d1dd02108b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:33.662686 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 966/1939] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:33 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:33.666903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41341001-9f50-403f-ab2c-a8d1dd02108b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:33.672686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:33.683239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41341001-9f50-403f-ab2c-a8d1dd02108b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:33.690397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e57f3-376d-4167-aa1f-fb193e871b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:33.691633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e57f3-376d-4167-aa1f-fb193e871b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.692020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e57f3-376d-4167-aa1f-fb193e871b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.692904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e57f3-376d-4167-aa1f-fb193e871b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.693785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e57f3-376d-4167-aa1f-fb193e871b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:33.695840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e57f3-376d-4167-aa1f-fb193e871b38 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:33.710823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 967/1940] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:33.712381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e57f3-376d-4167-aa1f-fb193e871b38 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:33.726200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0caae-c161-46a4-8dca-41787c756b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:33.729358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e57f3-376d-4167-aa1f-fb193e871b38 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:33.735181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200d7f-df65-4597-8ac6-520786b64c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:33.736283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200d7f-df65-4597-8ac6-520786b64c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.736636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200d7f-df65-4597-8ac6-520786b64c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.736990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0caae-c161-46a4-8dca-41787c756b56 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:33.737359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200d7f-df65-4597-8ac6-520786b64c29 admin admin] PATH_INFO: `/v3/projects/94dba55cf3ae42bdb19750f4f2ccabfa/users/f45187e56d074e41bf65be6e1c0e2309/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.747010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 974/1941] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:33.747816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0caae-c161-46a4-8dca-41787c756b56 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:33.749190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5fb0caae-c161-46a4-8dca-41787c756b56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:33.755089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce200d7f-df65-4597-8ac6-520786b64c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94dba55cf3ae42bdb19750f4f2ccabfa, user_id=f45187e56d074e41bf65be6e1c0e2309, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:33.757783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce200d7f-df65-4597-8ac6-520786b64c29 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:33.764108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0caae-c161-46a4-8dca-41787c756b56 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:33.769684 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e79d9-b35b-419b-a41b-a5d429b1ea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:33.770669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e79d9-b35b-419b-a41b-a5d429b1ea40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.771038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e79d9-b35b-419b-a41b-a5d429b1ea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.771376 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e79d9-b35b-419b-a41b-a5d429b1ea40 admin admin] PATH_INFO: `/v3/users/48756e37d07144e1ada4ef8a99a594c5` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.775029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 968/1942] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:33 2022] PUT /identity/v3/projects/94dba55cf3ae42bdb19750f4f2ccabfa/users/f45187e56d074e41bf65be6e1c0e2309/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:33.775180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e79d9-b35b-419b-a41b-a5d429b1ea40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48756e37d07144e1ada4ef8a99a594c5)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:33.775180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e79d9-b35b-419b-a41b-a5d429b1ea40 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:33.776561 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200d7f-df65-4597-8ac6-520786b64c29 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:33.829791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b75e79d9-b35b-419b-a41b-a5d429b1ea40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48756e37d07144e1ada4ef8a99a594c5'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:33.842455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b75e79d9-b35b-419b-a41b-a5d429b1ea40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48756e37d07144e1ada4ef8a99a594c5'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:33.843965 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200d7f-df65-4597-8ac6-520786b64c29 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:33.849003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4993eb-6f73-4cc1-858e-fa6e08daf15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:33.849733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4993eb-6f73-4cc1-858e-fa6e08daf15a admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.849973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4993eb-6f73-4cc1-858e-fa6e08daf15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.850243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4993eb-6f73-4cc1-858e-fa6e08daf15a admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.850980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4993eb-6f73-4cc1-858e-fa6e08daf15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:33.852670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4993eb-6f73-4cc1-858e-fa6e08daf15a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:33.853159 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b75e79d9-b35b-419b-a41b-a5d429b1ea40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48756e37d07144e1ada4ef8a99a594c5'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:33.861648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b75e79d9-b35b-419b-a41b-a5d429b1ea40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48756e37d07144e1ada4ef8a99a594c5'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:33.862792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b75e79d9-b35b-419b-a41b-a5d429b1ea40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48756e37d07144e1ada4ef8a99a594c5'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:33.863420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 969/1943] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:33.867217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4993eb-6f73-4cc1-858e-fa6e08daf15a admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:33.870055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6e4993eb-6f73-4cc1-858e-fa6e08daf15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:33.872886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 975/1944] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:33 2022] DELETE /identity/v3/users/48756e37d07144e1ada4ef8a99a594c5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:33.877373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2770d2f-8886-46d5-a668-22ce9a3393be None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.877729 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2770d2f-8886-46d5-a668-22ce9a3393be None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.878071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2770d2f-8886-46d5-a668-22ce9a3393be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.885823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4993eb-6f73-4cc1-858e-fa6e08daf15a admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:33.897209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-b2770d2f-8886-46d5-a668-22ce9a3393be None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:33.898651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b2770d2f-8886-46d5-a668-22ce9a3393be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:33.926816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:33.965730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48017200-e30a-4a12-a7cd-8af582648984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:33.967183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017200-e30a-4a12-a7cd-8af582648984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.967659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017200-e30a-4a12-a7cd-8af582648984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.968320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017200-e30a-4a12-a7cd-8af582648984 admin admin] PATH_INFO: `/v3/projects/94dba55cf3ae42bdb19750f4f2ccabfa/users/f45187e56d074e41bf65be6e1c0e2309/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:33.970819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48017200-e30a-4a12-a7cd-8af582648984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94dba55cf3ae42bdb19750f4f2ccabfa, user_id=f45187e56d074e41bf65be6e1c0e2309, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:33.974225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48017200-e30a-4a12-a7cd-8af582648984 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:33.987459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 970/1945] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:33 2022] PUT /identity/v3/projects/94dba55cf3ae42bdb19750f4f2ccabfa/users/f45187e56d074e41bf65be6e1c0e2309/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:33.990548 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 976/1946] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:33.997398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a209f-9fa2-45a5-94b1-efea86e1ec5e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:33.997689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a209f-9fa2-45a5-94b1-efea86e1ec5e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:33.997972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a209f-9fa2-45a5-94b1-efea86e1ec5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:34.001272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2770d2f-8886-46d5-a668-22ce9a3393be None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:34.002754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b2770d2f-8886-46d5-a668-22ce9a3393be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:34.028425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f20a209f-9fa2-45a5-94b1-efea86e1ec5e None None] MFA Rules not processed for user `f45187e56d074e41bf65be6e1c0e2309`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:34.029788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f20a209f-9fa2-45a5-94b1-efea86e1ec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:34.059998 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:34.075004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2770d2f-8886-46d5-a668-22ce9a3393be None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:34.130853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 971/1947] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:34.143588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a209f-9fa2-45a5-94b1-efea86e1ec5e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:34.145087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f20a209f-9fa2-45a5-94b1-efea86e1ec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:34.149172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113970aa-d074-467d-8866-f8e8848481ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:34.149874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113970aa-d074-467d-8866-f8e8848481ca service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:34.150154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113970aa-d074-467d-8866-f8e8848481ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:34.150431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113970aa-d074-467d-8866-f8e8848481ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:34.209788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a209f-9fa2-45a5-94b1-efea86e1ec5e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:34.214223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae1142-006c-41c5-97f0-aa994eeef022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:34.214912 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1142-006c-41c5-97f0-aa994eeef022 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:34.215258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1142-006c-41c5-97f0-aa994eeef022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:34.215522 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1142-006c-41c5-97f0-aa994eeef022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:34.227670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae1142-006c-41c5-97f0-aa994eeef022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:34.229204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae1142-006c-41c5-97f0-aa994eeef022 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:34.240664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 972/1948] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:05:34.251965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113970aa-d074-467d-8866-f8e8848481ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:34.253947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113970aa-d074-467d-8866-f8e8848481ca service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:34.267203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 977/1949] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:34.346056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae1142-006c-41c5-97f0-aa994eeef022 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:34.347607 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ecae1142-006c-41c5-97f0-aa994eeef022 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:34.354088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113970aa-d074-467d-8866-f8e8848481ca service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:34.355672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-113970aa-d074-467d-8866-f8e8848481ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:34.372508 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae1142-006c-41c5-97f0-aa994eeef022 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:34.375816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113970aa-d074-467d-8866-f8e8848481ca service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:34.381453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baf218-1ac8-46fc-9444-2c9ee6844dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:34.382172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baf218-1ac8-46fc-9444-2c9ee6844dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:34.382383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baf218-1ac8-46fc-9444-2c9ee6844dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:34.382655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baf218-1ac8-46fc-9444-2c9ee6844dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:34.385938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:34.386836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:34.387132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:34.387440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] PATH_INFO: `/v3/users/6e15a43331664da88e0dd7ceb3e67048` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:34.389268 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-94baf218-1ac8-46fc-9444-2c9ee6844dc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:34.390903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e15a43331664da88e0dd7ceb3e67048)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:34.392877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:34.502020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e15a43331664da88e0dd7ceb3e67048'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:34.506078 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baf218-1ac8-46fc-9444-2c9ee6844dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:34.510733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baf218-1ac8-46fc-9444-2c9ee6844dc1 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:34.521141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:34.521718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e15a43331664da88e0dd7ceb3e67048'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:34.535668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 973/1950] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:34.540810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e15a43331664da88e0dd7ceb3e67048'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:34.553061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e15a43331664da88e0dd7ceb3e67048'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:34.554224 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e15a43331664da88e0dd7ceb3e67048'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:34.564838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 978/1951] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:34 2022] DELETE /identity/v3/users/6e15a43331664da88e0dd7ceb3e67048 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:34.569209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4e2ea-8185-4a06-97c4-a12f8b527306 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:34.569656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4e2ea-8185-4a06-97c4-a12f8b527306 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:34.570085 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4e2ea-8185-4a06-97c4-a12f8b527306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:34.604218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2ad4e2ea-8185-4a06-97c4-a12f8b527306 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:34.605459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2ad4e2ea-8185-4a06-97c4-a12f8b527306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:34.772628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 974/1952] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:34.782464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:34.783939 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:34.787555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4e2ea-8185-4a06-97c4-a12f8b527306 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:34.790586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2ad4e2ea-8185-4a06-97c4-a12f8b527306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:34.826765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4e2ea-8185-4a06-97c4-a12f8b527306 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:34.843345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:34.844868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:34.845418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:34.845886 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] PATH_INFO: `/v3/projects/647881b331f146a19665e0a27d43c0cb` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:34.847506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] RBAC: Authorizing `identity:delete_project(project_id=647881b331f146a19665e0a27d43c0cb)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:34.850018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:34.856090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:34.933727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bffd-3170-4cb3-8145-c520cca9bbfb admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:34.941151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014fd1d-be8f-46e7-ba50-754730951e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:34.942147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014fd1d-be8f-46e7-ba50-754730951e37 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:34.942675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014fd1d-be8f-46e7-ba50-754730951e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:34.943179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014fd1d-be8f-46e7-ba50-754730951e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:34.964818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014fd1d-be8f-46e7-ba50-754730951e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:34.966417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014fd1d-be8f-46e7-ba50-754730951e37 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:34.981288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 979/1953] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:34.982790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4669b8-5e91-4a54-9768-82f6959da755 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:34.983183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4669b8-5e91-4a54-9768-82f6959da755 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:34.983530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4669b8-5e91-4a54-9768-82f6959da755 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:34.985666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 980/1954] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 03:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:05:34.986787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647881b331f146a19665e0a27d43c0cb', 'request_id': 'req-0b187808-8d10-4336-9e25-7a93f951301b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:34.995249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647881b331f146a19665e0a27d43c0cb', 'request_id': 'req-0b187808-8d10-4336-9e25-7a93f951301b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.007086 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad029755-2e19-46cb-bb35-79c1655645ed None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:35.014691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad029755-2e19-46cb-bb35-79c1655645ed None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:35.015002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad029755-2e19-46cb-bb35-79c1655645ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:35.016954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647881b331f146a19665e0a27d43c0cb', 'request_id': 'req-0b187808-8d10-4336-9e25-7a93f951301b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.036475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] The token cache is being invalidate because project 647881b331f146a19665e0a27d43c0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:35.036913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.038513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.043783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 975/1955] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:34 2022] DELETE /identity/v3/projects/647881b331f146a19665e0a27d43c0cb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:35.045656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:35.047500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:35.062228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ad029755-2e19-46cb-bb35-79c1655645ed None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:35.064625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ad029755-2e19-46cb-bb35-79c1655645ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:35.182725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 981/1956] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 03:05:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:35.202916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b187808-8d10-4336-9e25-7a93f951301b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:35.209903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:35.211579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:35.211579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:35.211813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] PATH_INFO: `/v3/users/f840016713124fbcbf3177b3883da361` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:35.214697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f840016713124fbcbf3177b3883da361)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:35.217451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:35.235461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad029755-2e19-46cb-bb35-79c1655645ed None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:35.237526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ad029755-2e19-46cb-bb35-79c1655645ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:35.267625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad029755-2e19-46cb-bb35-79c1655645ed None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:35.277499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ebbbd-e0ea-4865-ad8d-01add8f5b13a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:35.278457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ebbbd-e0ea-4865-ad8d-01add8f5b13a service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:35.279279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ebbbd-e0ea-4865-ad8d-01add8f5b13a service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:35.279766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ebbbd-e0ea-4865-ad8d-01add8f5b13a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:35.285528 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:35.300723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ebbbd-e0ea-4865-ad8d-01add8f5b13a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:35.302628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ebbbd-e0ea-4865-ad8d-01add8f5b13a service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:35.320314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 982/1957] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:35.332919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f840016713124fbcbf3177b3883da361'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.349404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f840016713124fbcbf3177b3883da361'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.350156 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f840016713124fbcbf3177b3883da361'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.366694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f840016713124fbcbf3177b3883da361'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.367580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f840016713124fbcbf3177b3883da361'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.388683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ebbbd-e0ea-4865-ad8d-01add8f5b13a service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:35.390459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b41ebbbd-e0ea-4865-ad8d-01add8f5b13a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:35.407490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ebbbd-e0ea-4865-ad8d-01add8f5b13a service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:35.411623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 976/1958] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:35 2022] DELETE /identity/v3/users/f840016713124fbcbf3177b3883da361 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:35.526842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:35.529008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:35.529008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:35.529008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] PATH_INFO: `/v3/projects/f95e4543a60c4d5ba6fbfbf1e7cc262e` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:35.530457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95e4543a60c4d5ba6fbfbf1e7cc262e)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:35.533530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:35.617384 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:35.624772 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95e4543a60c4d5ba6fbfbf1e7cc262e', 'request_id': 'req-96fdba43-cdab-46de-aa9d-1032275da4de'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.635446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95e4543a60c4d5ba6fbfbf1e7cc262e', 'request_id': 'req-96fdba43-cdab-46de-aa9d-1032275da4de'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.647741 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95e4543a60c4d5ba6fbfbf1e7cc262e', 'request_id': 'req-96fdba43-cdab-46de-aa9d-1032275da4de'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.674436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] The token cache is being invalidate because project f95e4543a60c4d5ba6fbfbf1e7cc262e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:35.674704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.681600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.684279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 983/1959] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:35 2022] DELETE /identity/v3/projects/f95e4543a60c4d5ba6fbfbf1e7cc262e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:35.688523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:35.689965 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:35.703702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee02734-fcb6-4707-adad-d719079ac8fd admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:35.765107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72018f8-8c65-47e9-abe3-2b9555a04f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:35.766079 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72018f8-8c65-47e9-abe3-2b9555a04f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:35.766362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72018f8-8c65-47e9-abe3-2b9555a04f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:35.766637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72018f8-8c65-47e9-abe3-2b9555a04f03 admin admin] PATH_INFO: `/v3/users/860f97156734415c924322996fd65096` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:35.768060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72018f8-8c65-47e9-abe3-2b9555a04f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=860f97156734415c924322996fd65096)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:35.771167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72018f8-8c65-47e9-abe3-2b9555a04f03 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:35.814813 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:35.816700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:35.838261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b72018f8-8c65-47e9-abe3-2b9555a04f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860f97156734415c924322996fd65096'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.850171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdba43-cdab-46de-aa9d-1032275da4de admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:35.856170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:35.857017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:35.857429 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:35.857775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] PATH_INFO: `/v3/projects/6666e220514e4deaa4df1f3b992fcb48` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:35.859169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6666e220514e4deaa4df1f3b992fcb48)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:35.861346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:35.861694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b72018f8-8c65-47e9-abe3-2b9555a04f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860f97156734415c924322996fd65096'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.862633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b72018f8-8c65-47e9-abe3-2b9555a04f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860f97156734415c924322996fd65096'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.870380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b72018f8-8c65-47e9-abe3-2b9555a04f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860f97156734415c924322996fd65096'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.871106 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b72018f8-8c65-47e9-abe3-2b9555a04f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860f97156734415c924322996fd65096'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.895539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 977/1960] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:35 2022] DELETE /identity/v3/users/860f97156734415c924322996fd65096 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:35.930137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6666e220514e4deaa4df1f3b992fcb48', 'request_id': 'req-437cdaf8-7f71-4917-8f90-582861ef1503'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.939322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6666e220514e4deaa4df1f3b992fcb48', 'request_id': 'req-437cdaf8-7f71-4917-8f90-582861ef1503'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.955231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6666e220514e4deaa4df1f3b992fcb48', 'request_id': 'req-437cdaf8-7f71-4917-8f90-582861ef1503'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.968061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] The token cache is being invalidate because project 6666e220514e4deaa4df1f3b992fcb48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:35.968348 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.969038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-437cdaf8-7f71-4917-8f90-582861ef1503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:35.970827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 984/1961] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:35 2022] DELETE /identity/v3/projects/6666e220514e4deaa4df1f3b992fcb48 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:35.976733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff45fe2-f219-4179-a7e0-106e0284bd7f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:35.977039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff45fe2-f219-4179-a7e0-106e0284bd7f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:35.977320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff45fe2-f219-4179-a7e0-106e0284bd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.019914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-4ff45fe2-f219-4179-a7e0-106e0284bd7f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:36.021293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4ff45fe2-f219-4179-a7e0-106e0284bd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:36.042377 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:36.122960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 978/1962] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:36.133239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055273e-694b-4b67-9c8e-b56413944f62 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.133771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055273e-694b-4b67-9c8e-b56413944f62 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.134310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055273e-694b-4b67-9c8e-b56413944f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.185229 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d055273e-694b-4b67-9c8e-b56413944f62 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:36.187294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d055273e-694b-4b67-9c8e-b56413944f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:36.205529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff45fe2-f219-4179-a7e0-106e0284bd7f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:36.206056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 985/1963] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:36.220374 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff45fe2-f219-4179-a7e0-106e0284bd7f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:36.236016 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8641e3-b9c3-4201-a6f6-32c7fcf5693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:36.237140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8641e3-b9c3-4201-a6f6-32c7fcf5693d admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.237502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8641e3-b9c3-4201-a6f6-32c7fcf5693d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.238327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8641e3-b9c3-4201-a6f6-32c7fcf5693d admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.238927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8641e3-b9c3-4201-a6f6-32c7fcf5693d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:36.240149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8641e3-b9c3-4201-a6f6-32c7fcf5693d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:36.243218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8641e3-b9c3-4201-a6f6-32c7fcf5693d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:36.282426 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 979/1964] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 03:05:36.290405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055273e-694b-4b67-9c8e-b56413944f62 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:36.302759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055273e-694b-4b67-9c8e-b56413944f62 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:36.336086 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397b134-365d-4c60-93d4-66578ed91bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:36.336746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397b134-365d-4c60-93d4-66578ed91bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.337148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397b134-365d-4c60-93d4-66578ed91bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.337466 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397b134-365d-4c60-93d4-66578ed91bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.338687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397b134-365d-4c60-93d4-66578ed91bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:36.343863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397b134-365d-4c60-93d4-66578ed91bb8 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:36.406361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 986/1965] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:36 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:36.411547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8641e3-b9c3-4201-a6f6-32c7fcf5693d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:36.432967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8641e3-b9c3-4201-a6f6-32c7fcf5693d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:36.451998 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397b134-365d-4c60-93d4-66578ed91bb8 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:36.453836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1397b134-365d-4c60-93d4-66578ed91bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:36.541970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397b134-365d-4c60-93d4-66578ed91bb8 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:36.546518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:36.547426 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.547706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.547979 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] PATH_INFO: `/v3/projects/06341aff6370463c9ade1d19c5301988` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.550832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=06341aff6370463c9ade1d19c5301988)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:36.552900 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:36.556688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5044ea-e63d-4fa6-bc82-d4f5acd8ef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:36.557323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5044ea-e63d-4fa6-bc82-d4f5acd8ef7c admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.557600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5044ea-e63d-4fa6-bc82-d4f5acd8ef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.557926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5044ea-e63d-4fa6-bc82-d4f5acd8ef7c admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.558569 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5044ea-e63d-4fa6-bc82-d4f5acd8ef7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:36.560705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5044ea-e63d-4fa6-bc82-d4f5acd8ef7c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:36.584995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 980/1966] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:36 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:36.589278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5044ea-e63d-4fa6-bc82-d4f5acd8ef7c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:36.596405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:36.599958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5044ea-e63d-4fa6-bc82-d4f5acd8ef7c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:36.619332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06341aff6370463c9ade1d19c5301988', 'request_id': 'req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:36.626765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06341aff6370463c9ade1d19c5301988', 'request_id': 'req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:36.637428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06341aff6370463c9ade1d19c5301988', 'request_id': 'req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:36.652439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] The token cache is being invalidate because project 06341aff6370463c9ade1d19c5301988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:36.652794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:36.653388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5fc31bf4-a95f-4111-b9c5-a6e561d57bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:36.659078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 987/1967] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:36 2022] DELETE /identity/v3/projects/06341aff6370463c9ade1d19c5301988 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:36.660573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7c2e-6d4c-43bd-951f-52a9f7b015bd None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.660863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7c2e-6d4c-43bd-951f-52a9f7b015bd None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.661145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7c2e-6d4c-43bd-951f-52a9f7b015bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.662203 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d21b4-7f76-42ff-9caa-b4fcdc9153a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:36.662946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d21b4-7f76-42ff-9caa-b4fcdc9153a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.664105 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d21b4-7f76-42ff-9caa-b4fcdc9153a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.664404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d21b4-7f76-42ff-9caa-b4fcdc9153a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.665217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d21b4-7f76-42ff-9caa-b4fcdc9153a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:36.668011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d21b4-7f76-42ff-9caa-b4fcdc9153a6 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:36.680183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 981/1968] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:36.684299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d21b4-7f76-42ff-9caa-b4fcdc9153a6 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:36.686553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-dc3d21b4-7f76-42ff-9caa-b4fcdc9153a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:36.692804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-328c7c2e-6d4c-43bd-951f-52a9f7b015bd None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:36.694168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-328c7c2e-6d4c-43bd-951f-52a9f7b015bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:36.702703 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d21b4-7f76-42ff-9caa-b4fcdc9153a6 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:36.703161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 988/1969] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:36.707872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d433f-6db8-4264-99be-504649fe43bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:36.708541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d433f-6db8-4264-99be-504649fe43bb admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.708824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d433f-6db8-4264-99be-504649fe43bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.709220 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d433f-6db8-4264-99be-504649fe43bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.709925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d433f-6db8-4264-99be-504649fe43bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:36.710868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e372-ba10-4b44-a2ab-5c73069f16fb None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.711185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e372-ba10-4b44-a2ab-5c73069f16fb None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.711465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3e372-ba10-4b44-a2ab-5c73069f16fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.711619 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d433f-6db8-4264-99be-504649fe43bb admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:36.723745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 982/1970] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:36.727952 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d433f-6db8-4264-99be-504649fe43bb admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:36.733324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-28f3e372-ba10-4b44-a2ab-5c73069f16fb None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:36.734501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-28f3e372-ba10-4b44-a2ab-5c73069f16fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:36.740541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d433f-6db8-4264-99be-504649fe43bb admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:36.743028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 989/1971] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:36.746731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3e372-ba10-4b44-a2ab-5c73069f16fb None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:36.747567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c9f65-4bdb-4e60-8fe3-4b4206a06682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:36.748633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c9f65-4bdb-4e60-8fe3-4b4206a06682 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.748919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c9f65-4bdb-4e60-8fe3-4b4206a06682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.749204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c9f65-4bdb-4e60-8fe3-4b4206a06682 admin admin] PATH_INFO: `/v3/projects/dee952840ffa4cc48eff68c54afe6527/users/b7fdc1a9ba7d4cbf9a0f3cd1a938b814/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.756844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3e372-ba10-4b44-a2ab-5c73069f16fb None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:36.762798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6236128-686f-4fb5-89d6-60bd0a6bf22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:36.763499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6236128-686f-4fb5-89d6-60bd0a6bf22c admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.763781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6236128-686f-4fb5-89d6-60bd0a6bf22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.764078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6236128-686f-4fb5-89d6-60bd0a6bf22c admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.764812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6236128-686f-4fb5-89d6-60bd0a6bf22c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:36.765115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6236128-686f-4fb5-89d6-60bd0a6bf22c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:36.766723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6236128-686f-4fb5-89d6-60bd0a6bf22c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:36.767978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c9f65-4bdb-4e60-8fe3-4b4206a06682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee952840ffa4cc48eff68c54afe6527, user_id=b7fdc1a9ba7d4cbf9a0f3cd1a938b814, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:36.771561 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c9f65-4bdb-4e60-8fe3-4b4206a06682 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:36.781082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 990/1972] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:36.781528 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:36.785242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6236128-686f-4fb5-89d6-60bd0a6bf22c admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:36.789366 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 983/1973] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:36 2022] PUT /identity/v3/projects/dee952840ffa4cc48eff68c54afe6527/users/b7fdc1a9ba7d4cbf9a0f3cd1a938b814/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:36.800834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6262af-b3df-4fa4-b1f3-2378e17060e2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.801451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6262af-b3df-4fa4-b1f3-2378e17060e2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.801737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6262af-b3df-4fa4-b1f3-2378e17060e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.802644 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6236128-686f-4fb5-89d6-60bd0a6bf22c admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:36.838839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fb6262af-b3df-4fa4-b1f3-2378e17060e2 None None] MFA Rules not processed for user `b7fdc1a9ba7d4cbf9a0f3cd1a938b814`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:36.840140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fb6262af-b3df-4fa4-b1f3-2378e17060e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:36.868722 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb2ca0-6f8c-48f8-8175-1f719bb42178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:36.869470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2ca0-6f8c-48f8-8175-1f719bb42178 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.869750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2ca0-6f8c-48f8-8175-1f719bb42178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.870032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2ca0-6f8c-48f8-8175-1f719bb42178 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.870732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb2ca0-6f8c-48f8-8175-1f719bb42178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:36.872707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb2ca0-6f8c-48f8-8175-1f719bb42178 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:36.902308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 991/1974] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:36 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:36.903434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb2ca0-6f8c-48f8-8175-1f719bb42178 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:36.908835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 984/1975] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:36.921312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6262af-b3df-4fa4-b1f3-2378e17060e2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:36.922859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fb6262af-b3df-4fa4-b1f3-2378e17060e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:36.965991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb2ca0-6f8c-48f8-8175-1f719bb42178 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:36.970540 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10cd57-0523-41b8-bf01-139b0be8b255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:36.971238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10cd57-0523-41b8-bf01-139b0be8b255 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:36.971520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10cd57-0523-41b8-bf01-139b0be8b255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:36.971794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10cd57-0523-41b8-bf01-139b0be8b255 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:36.972477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10cd57-0523-41b8-bf01-139b0be8b255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:36.974412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10cd57-0523-41b8-bf01-139b0be8b255 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:36.979191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6262af-b3df-4fa4-b1f3-2378e17060e2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:36.995062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 992/1976] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:36 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:36.999612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10cd57-0523-41b8-bf01-139b0be8b255 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:37.005820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:37.010898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10cd57-0523-41b8-bf01-139b0be8b255 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:37.018043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5579b1a-729d-4d59-a6d2-76a7fa104154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:37.019483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5579b1a-729d-4d59-a6d2-76a7fa104154 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.019483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5579b1a-729d-4d59-a6d2-76a7fa104154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.020209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5579b1a-729d-4d59-a6d2-76a7fa104154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.020996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5579b1a-729d-4d59-a6d2-76a7fa104154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:37.023251 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5579b1a-729d-4d59-a6d2-76a7fa104154 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:37.029713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256e3f3-55b3-40c5-b5ef-a61f398c7fc0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '250c47daff26400c96a6b467d7cf5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:37.030362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e3f3-55b3-40c5-b5ef-a61f398c7fc0 service glance] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.030645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e3f3-55b3-40c5-b5ef-a61f398c7fc0 service glance] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.030922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e3f3-55b3-40c5-b5ef-a61f398c7fc0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.033952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 993/1977] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:37.037908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5579b1a-729d-4d59-a6d2-76a7fa104154 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:37.051157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5579b1a-729d-4d59-a6d2-76a7fa104154 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:37.055957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44483c7-1162-4afc-b9d0-76da39dfedd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:37.056631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44483c7-1162-4afc-b9d0-76da39dfedd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.056934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44483c7-1162-4afc-b9d0-76da39dfedd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.057193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44483c7-1162-4afc-b9d0-76da39dfedd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.057919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44483c7-1162-4afc-b9d0-76da39dfedd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:37.059558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44483c7-1162-4afc-b9d0-76da39dfedd6 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:37.070173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 994/1978] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:37.074725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44483c7-1162-4afc-b9d0-76da39dfedd6 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:37.084440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44483c7-1162-4afc-b9d0-76da39dfedd6 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:37.089032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab5f14-d02b-4eed-878c-0fca89aae4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:37.089933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5f14-d02b-4eed-878c-0fca89aae4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.090299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5f14-d02b-4eed-878c-0fca89aae4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.090487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5f14-d02b-4eed-878c-0fca89aae4b4 admin admin] PATH_INFO: `/v3/projects/47ad57da9eb343c4b5b72902bd14c718/users/9bb22aaba4e7419fb737bbb4f2dd6694/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.093888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256e3f3-55b3-40c5-b5ef-a61f398c7fc0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:37.095580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256e3f3-55b3-40c5-b5ef-a61f398c7fc0 service glance] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:37.099668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:37.108578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 985/1979] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:05:37.109826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab5f14-d02b-4eed-878c-0fca89aae4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ad57da9eb343c4b5b72902bd14c718, user_id=9bb22aaba4e7419fb737bbb4f2dd6694, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:37.112737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab5f14-d02b-4eed-878c-0fca89aae4b4 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:37.128036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256e3f3-55b3-40c5-b5ef-a61f398c7fc0 service glance] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:37.129502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3256e3f3-55b3-40c5-b5ef-a61f398c7fc0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:37.134099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 995/1980] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:37 2022] PUT /identity/v3/projects/47ad57da9eb343c4b5b72902bd14c718/users/9bb22aaba4e7419fb737bbb4f2dd6694/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:37.143520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256e3f3-55b3-40c5-b5ef-a61f398c7fc0 service glance] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:37.144815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421422d-ac75-4028-bc43-b4de0b1ee25c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.145211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421422d-ac75-4028-bc43-b4de0b1ee25c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.145749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421422d-ac75-4028-bc43-b4de0b1ee25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.174896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-b421422d-ac75-4028-bc43-b4de0b1ee25c None None] MFA Rules not processed for user `9bb22aaba4e7419fb737bbb4f2dd6694`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:37.179559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b421422d-ac75-4028-bc43-b4de0b1ee25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:37.207243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa46ce-3b94-40d2-9f94-f21f4b7f334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:37.208394 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa46ce-3b94-40d2-9f94-f21f4b7f334b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.208685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa46ce-3b94-40d2-9f94-f21f4b7f334b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.209809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa46ce-3b94-40d2-9f94-f21f4b7f334b admin admin] PATH_INFO: `/v3/users/021c793f77654951ba11f6ccc025a552` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.211448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa46ce-3b94-40d2-9f94-f21f4b7f334b admin admin] RBAC: Authorizing `identity:delete_user(user_id=021c793f77654951ba11f6ccc025a552)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:37.214091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa46ce-3b94-40d2-9f94-f21f4b7f334b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:37.255367 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 996/1981] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:37.259905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421422d-ac75-4028-bc43-b4de0b1ee25c None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:37.270312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421422d-ac75-4028-bc43-b4de0b1ee25c None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:37.271345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-29fa46ce-3b94-40d2-9f94-f21f4b7f334b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '021c793f77654951ba11f6ccc025a552'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:37.275328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878a1b-8409-4a9e-81d8-c2fd3bda04cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:37.275991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878a1b-8409-4a9e-81d8-c2fd3bda04cd admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.276273 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878a1b-8409-4a9e-81d8-c2fd3bda04cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.276544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878a1b-8409-4a9e-81d8-c2fd3bda04cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.277352 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3878a1b-8409-4a9e-81d8-c2fd3bda04cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:37.281021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3878a1b-8409-4a9e-81d8-c2fd3bda04cd admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:37.290945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-29fa46ce-3b94-40d2-9f94-f21f4b7f334b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '021c793f77654951ba11f6ccc025a552'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:37.292887 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-29fa46ce-3b94-40d2-9f94-f21f4b7f334b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '021c793f77654951ba11f6ccc025a552'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:37.305147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-29fa46ce-3b94-40d2-9f94-f21f4b7f334b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '021c793f77654951ba11f6ccc025a552'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:37.306081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-29fa46ce-3b94-40d2-9f94-f21f4b7f334b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '021c793f77654951ba11f6ccc025a552'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:37.326815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 997/1982] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:37 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:37.333699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878a1b-8409-4a9e-81d8-c2fd3bda04cd admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:37.336381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d3878a1b-8409-4a9e-81d8-c2fd3bda04cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:37.339271 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 986/1983] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:37 2022] DELETE /identity/v3/users/021c793f77654951ba11f6ccc025a552 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:37.343643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60993-ee9a-469a-9ba1-d4d51bde9c44 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.344000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60993-ee9a-469a-9ba1-d4d51bde9c44 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.344395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead60993-ee9a-469a-9ba1-d4d51bde9c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.390350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ead60993-ee9a-469a-9ba1-d4d51bde9c44 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:37.393679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ead60993-ee9a-469a-9ba1-d4d51bde9c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:37.438502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878a1b-8409-4a9e-81d8-c2fd3bda04cd admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:37.491927 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:37.529161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 987/1984] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:37.545520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead60993-ee9a-469a-9ba1-d4d51bde9c44 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:37.547168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ead60993-ee9a-469a-9ba1-d4d51bde9c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:37.549398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271edd-0d01-4e05-8032-b4a50636c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:37.550321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271edd-0d01-4e05-8032-b4a50636c6ff admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.550791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271edd-0d01-4e05-8032-b4a50636c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.551268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271edd-0d01-4e05-8032-b4a50636c6ff admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.562770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d271edd-0d01-4e05-8032-b4a50636c6ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:37.565202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d271edd-0d01-4e05-8032-b4a50636c6ff admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:37.597398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:37.610272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 998/1985] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:37 2022] POST /identity/v3/users => generated 298 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:37.615617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271edd-0d01-4e05-8032-b4a50636c6ff admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:37.636519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271edd-0d01-4e05-8032-b4a50636c6ff admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:37.655041 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead60993-ee9a-469a-9ba1-d4d51bde9c44 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:37.661493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a366b-66b2-4ed0-b253-9c4a4a8b0d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:37.662256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a366b-66b2-4ed0-b253-9c4a4a8b0d11 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.662547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a366b-66b2-4ed0-b253-9c4a4a8b0d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.662857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecb399-ea85-43c2-b36d-f47854cf98b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:37.663270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a366b-66b2-4ed0-b253-9c4a4a8b0d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.667142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecb399-ea85-43c2-b36d-f47854cf98b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.667698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecb399-ea85-43c2-b36d-f47854cf98b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.670344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecb399-ea85-43c2-b36d-f47854cf98b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.671453 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecb399-ea85-43c2-b36d-f47854cf98b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:37.686525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecb399-ea85-43c2-b36d-f47854cf98b5 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:37.696088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a366b-66b2-4ed0-b253-9c4a4a8b0d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:37.700780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a366b-66b2-4ed0-b253-9c4a4a8b0d11 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:37.706705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 999/1986] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:37.708773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecb399-ea85-43c2-b36d-f47854cf98b5 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:37.719515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e6ecb399-ea85-43c2-b36d-f47854cf98b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:37.730455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 988/1987] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:37.732379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a366b-66b2-4ed0-b253-9c4a4a8b0d11 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:37.751219 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecb399-ea85-43c2-b36d-f47854cf98b5 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:37.757136 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a366b-66b2-4ed0-b253-9c4a4a8b0d11 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:37.769457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17b81-6664-4652-9e9f-6ce824ffb6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:37.771040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17b81-6664-4652-9e9f-6ce824ffb6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.771464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17b81-6664-4652-9e9f-6ce824ffb6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.771906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17b81-6664-4652-9e9f-6ce824ffb6d7 admin admin] PATH_INFO: `/v3/projects/74079ebfb90948bf9ca19b0443479874/users/1cbce9607e534ac7b76d7e16e33f217d/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.786099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa6b9a-d7d4-4bdc-a702-e00d4760a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:37.790051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa6b9a-d7d4-4bdc-a702-e00d4760a890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.790417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa6b9a-d7d4-4bdc-a702-e00d4760a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.790713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa6b9a-d7d4-4bdc-a702-e00d4760a890 admin admin] PATH_INFO: `/v3/users/5f05dacf9f544f12aa2d18f862b73382` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:37.795627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa6b9a-d7d4-4bdc-a702-e00d4760a890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f05dacf9f544f12aa2d18f862b73382)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:37.799838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa6b9a-d7d4-4bdc-a702-e00d4760a890 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:37.824340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff17b81-6664-4652-9e9f-6ce824ffb6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74079ebfb90948bf9ca19b0443479874, user_id=1cbce9607e534ac7b76d7e16e33f217d, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:37.827047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff17b81-6664-4652-9e9f-6ce824ffb6d7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:37.865453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 989/1988] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:37 2022] PUT /identity/v3/projects/74079ebfb90948bf9ca19b0443479874/users/1cbce9607e534ac7b76d7e16e33f217d/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:37.870169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17b81-6664-4652-9e9f-6ce824ffb6d7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:37.889375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a9fa6b9a-d7d4-4bdc-a702-e00d4760a890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f05dacf9f544f12aa2d18f862b73382'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:37.903275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a9fa6b9a-d7d4-4bdc-a702-e00d4760a890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f05dacf9f544f12aa2d18f862b73382'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:37.916284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a9fa6b9a-d7d4-4bdc-a702-e00d4760a890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f05dacf9f544f12aa2d18f862b73382'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:37.931785 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a9fa6b9a-d7d4-4bdc-a702-e00d4760a890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f05dacf9f544f12aa2d18f862b73382'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:37.934395 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a9fa6b9a-d7d4-4bdc-a702-e00d4760a890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f05dacf9f544f12aa2d18f862b73382'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:37.952212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1000/1989] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:37 2022] DELETE /identity/v3/users/5f05dacf9f544f12aa2d18f862b73382 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:37.963653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5bff-6080-43aa-8ebc-3cd8d1cd6a23 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:37.963927 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5bff-6080-43aa-8ebc-3cd8d1cd6a23 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:37.965223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5bff-6080-43aa-8ebc-3cd8d1cd6a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:38.009649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-dc6f5bff-6080-43aa-8ebc-3cd8d1cd6a23 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:38.012432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-dc6f5bff-6080-43aa-8ebc-3cd8d1cd6a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:38.053300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17b81-6664-4652-9e9f-6ce824ffb6d7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:38.156809 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1001/1990] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:38.171989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f5bff-6080-43aa-8ebc-3cd8d1cd6a23 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:38.174564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-dc6f5bff-6080-43aa-8ebc-3cd8d1cd6a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:38.176216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532456cc-9566-4f9a-97c0-39e9ab48463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:38.177393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532456cc-9566-4f9a-97c0-39e9ab48463c admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:38.177900 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532456cc-9566-4f9a-97c0-39e9ab48463c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:38.178678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532456cc-9566-4f9a-97c0-39e9ab48463c admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:38.179631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532456cc-9566-4f9a-97c0-39e9ab48463c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:38.181867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532456cc-9566-4f9a-97c0-39e9ab48463c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:38.195330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 990/1991] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:38.199609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532456cc-9566-4f9a-97c0-39e9ab48463c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:38.202196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-532456cc-9566-4f9a-97c0-39e9ab48463c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:38.223903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532456cc-9566-4f9a-97c0-39e9ab48463c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:38.229908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fcff6-8e8e-469a-88fd-22183d86c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:38.231391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fcff6-8e8e-469a-88fd-22183d86c986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:38.231712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fcff6-8e8e-469a-88fd-22183d86c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:38.232004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fcff6-8e8e-469a-88fd-22183d86c986 admin admin] PATH_INFO: `/v3/projects/74079ebfb90948bf9ca19b0443479874/users/1cbce9607e534ac7b76d7e16e33f217d/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:38.234337 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fcff6-8e8e-469a-88fd-22183d86c986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74079ebfb90948bf9ca19b0443479874, user_id=1cbce9607e534ac7b76d7e16e33f217d, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:38.237088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fcff6-8e8e-469a-88fd-22183d86c986 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:38.249002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:38.254186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 991/1992] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:38 2022] PUT /identity/v3/projects/74079ebfb90948bf9ca19b0443479874/users/1cbce9607e534ac7b76d7e16e33f217d/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:38.268964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a3e1-614f-4b40-8dd3-fe6732a72a23 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:38.271310 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a3e1-614f-4b40-8dd3-fe6732a72a23 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:38.274582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a3e1-614f-4b40-8dd3-fe6732a72a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:38.341046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f5bff-6080-43aa-8ebc-3cd8d1cd6a23 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:38.350583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a9d9a3e1-614f-4b40-8dd3-fe6732a72a23 None None] MFA Rules not processed for user `1cbce9607e534ac7b76d7e16e33f217d`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:38.351861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a9d9a3e1-614f-4b40-8dd3-fe6732a72a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:38.371080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:38.447726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a144-554d-46a4-91ba-ad0eef9dedee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:38.448400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a144-554d-46a4-91ba-ad0eef9dedee service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:38.448856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a144-554d-46a4-91ba-ad0eef9dedee service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:38.449143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a144-554d-46a4-91ba-ad0eef9dedee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:38.515227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 992/1993] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:38.528346 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9a3e1-614f-4b40-8dd3-fe6732a72a23 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:38.530219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a9d9a3e1-614f-4b40-8dd3-fe6732a72a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:38.582913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868a144-554d-46a4-91ba-ad0eef9dedee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:38.584569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868a144-554d-46a4-91ba-ad0eef9dedee service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:38.628481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9a3e1-614f-4b40-8dd3-fe6732a72a23 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:38.629438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1002/1994] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:38.630514 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a144-554d-46a4-91ba-ad0eef9dedee service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:38.635777 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c868a144-554d-46a4-91ba-ad0eef9dedee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:38.636392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf37c25-3587-432f-8dbd-d9dbb0847753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:38.637112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf37c25-3587-432f-8dbd-d9dbb0847753 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:38.637430 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf37c25-3587-432f-8dbd-d9dbb0847753 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:38.637639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf37c25-3587-432f-8dbd-d9dbb0847753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:38.649180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf37c25-3587-432f-8dbd-d9dbb0847753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:38.650835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf37c25-3587-432f-8dbd-d9dbb0847753 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:38.673198 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a144-554d-46a4-91ba-ad0eef9dedee service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:38.676130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 993/1995] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:05:38.683382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:38.684397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:38.685139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:38.687221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] PATH_INFO: `/v3/projects/c0296934ea8141fcb1d684bb5f827ac0` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:38.689492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0296934ea8141fcb1d684bb5f827ac0)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:38.692944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:38.811725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0296934ea8141fcb1d684bb5f827ac0', 'request_id': 'req-22655ecc-1339-479c-960c-309caffc4a98'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:38.816134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf37c25-3587-432f-8dbd-d9dbb0847753 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:38.818822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0296934ea8141fcb1d684bb5f827ac0', 'request_id': 'req-22655ecc-1339-479c-960c-309caffc4a98'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:38.825509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf37c25-3587-432f-8dbd-d9dbb0847753 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:38.828923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0296934ea8141fcb1d684bb5f827ac0', 'request_id': 'req-22655ecc-1339-479c-960c-309caffc4a98'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:38.845245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] The token cache is being invalidate because project c0296934ea8141fcb1d684bb5f827ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:38.845571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:38.846341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:38.848330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1003/1996] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:38 2022] DELETE /identity/v3/projects/c0296934ea8141fcb1d684bb5f827ac0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:38.887856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109ade6-e83d-4170-b4b9-35e003c21a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:38.888571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109ade6-e83d-4170-b4b9-35e003c21a7e service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:38.890112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109ade6-e83d-4170-b4b9-35e003c21a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:38.890112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109ade6-e83d-4170-b4b9-35e003c21a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:38.892277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c109ade6-e83d-4170-b4b9-35e003c21a7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:39.030660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109ade6-e83d-4170-b4b9-35e003c21a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:39.032889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109ade6-e83d-4170-b4b9-35e003c21a7e service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:39.057827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 994/1997] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:39.215217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:39.216787 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:39.242178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:39.354148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22655ecc-1339-479c-960c-309caffc4a98 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:39.364256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:39.365155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:39.365433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:39.365709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] PATH_INFO: `/v3/projects/b81a2c34a782461f8214d69e4c48f2e5` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:39.366938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81a2c34a782461f8214d69e4c48f2e5)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:39.368911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:39.435181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81a2c34a782461f8214d69e4c48f2e5', 'request_id': 'req-fd34dc1f-3f46-4e69-b891-b01439384330'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:39.443362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81a2c34a782461f8214d69e4c48f2e5', 'request_id': 'req-fd34dc1f-3f46-4e69-b891-b01439384330'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:39.458587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81a2c34a782461f8214d69e4c48f2e5', 'request_id': 'req-fd34dc1f-3f46-4e69-b891-b01439384330'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:39.479021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] The token cache is being invalidate because project b81a2c34a782461f8214d69e4c48f2e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:39.479021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:39.481590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:39.491377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1004/1998] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:39 2022] DELETE /identity/v3/projects/b81a2c34a782461f8214d69e4c48f2e5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:39.495579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109ade6-e83d-4170-b4b9-35e003c21a7e service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:39.513290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109ade6-e83d-4170-b4b9-35e003c21a7e service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:39.521455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:39.585964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15f332-7892-4156-a43c-83ee2b32649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:39.586942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f332-7892-4156-a43c-83ee2b32649e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:39.587382 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f332-7892-4156-a43c-83ee2b32649e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:39.587669 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f332-7892-4156-a43c-83ee2b32649e admin admin] PATH_INFO: `/v3/users/47a1fb67740945cab457568c3dd60d95` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:39.588930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15f332-7892-4156-a43c-83ee2b32649e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a1fb67740945cab457568c3dd60d95)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:39.591216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15f332-7892-4156-a43c-83ee2b32649e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:39.648315 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0e15f332-7892-4156-a43c-83ee2b32649e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a1fb67740945cab457568c3dd60d95'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:39.660326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0e15f332-7892-4156-a43c-83ee2b32649e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a1fb67740945cab457568c3dd60d95'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:39.661051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0e15f332-7892-4156-a43c-83ee2b32649e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a1fb67740945cab457568c3dd60d95'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:39.668805 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0e15f332-7892-4156-a43c-83ee2b32649e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a1fb67740945cab457568c3dd60d95'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:39.669427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0e15f332-7892-4156-a43c-83ee2b32649e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a1fb67740945cab457568c3dd60d95'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:39.683742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 995/1999] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:39 2022] DELETE /identity/v3/users/47a1fb67740945cab457568c3dd60d95 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:39.965672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:39.967229 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:39.983806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34dc1f-3f46-4e69-b891-b01439384330 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:40.048419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:40.049286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:40.049567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:40.049840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] PATH_INFO: `/v3/projects/e19cbe06dbe14cb98c0857597e039025` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:40.051105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19cbe06dbe14cb98c0857597e039025)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:40.053040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:40.114501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:40.117780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19cbe06dbe14cb98c0857597e039025', 'request_id': 'req-8d40ed11-65a7-4cef-9e2e-3774fb579755'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:40.125257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19cbe06dbe14cb98c0857597e039025', 'request_id': 'req-8d40ed11-65a7-4cef-9e2e-3774fb579755'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:40.134035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19cbe06dbe14cb98c0857597e039025', 'request_id': 'req-8d40ed11-65a7-4cef-9e2e-3774fb579755'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:40.144239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] The token cache is being invalidate because project e19cbe06dbe14cb98c0857597e039025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:40.144508 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:40.145136 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-8d40ed11-65a7-4cef-9e2e-3774fb579755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:40.146782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1005/2000] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:39 2022] DELETE /identity/v3/projects/e19cbe06dbe14cb98c0857597e039025 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:40.152136 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25825664-0794-457f-8d2e-c6ab9f41a8e8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:40.152423 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25825664-0794-457f-8d2e-c6ab9f41a8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:40.152718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25825664-0794-457f-8d2e-c6ab9f41a8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:40.170591 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-25825664-0794-457f-8d2e-c6ab9f41a8e8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:40.171840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-25825664-0794-457f-8d2e-c6ab9f41a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:40.233108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 996/2001] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:40.240842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393172d-8335-48f9-a1bd-0bee12f987dd None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:40.241130 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393172d-8335-48f9-a1bd-0bee12f987dd None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:40.241412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393172d-8335-48f9-a1bd-0bee12f987dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:40.259872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6393172d-8335-48f9-a1bd-0bee12f987dd None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:40.261061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6393172d-8335-48f9-a1bd-0bee12f987dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:40.269409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1006/2002] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:40.273878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25825664-0794-457f-8d2e-c6ab9f41a8e8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:40.284559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25825664-0794-457f-8d2e-c6ab9f41a8e8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:40.290333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ea7a8-b0ba-4b2d-a60c-4504f410e283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:40.291124 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ea7a8-b0ba-4b2d-a60c-4504f410e283 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:40.291407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ea7a8-b0ba-4b2d-a60c-4504f410e283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:40.291680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ea7a8-b0ba-4b2d-a60c-4504f410e283 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:40.292407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ea7a8-b0ba-4b2d-a60c-4504f410e283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:40.292714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ea7a8-b0ba-4b2d-a60c-4504f410e283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:40.294312 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ea7a8-b0ba-4b2d-a60c-4504f410e283 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:40.309926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 997/2003] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:40.311179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393172d-8335-48f9-a1bd-0bee12f987dd None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:40.321067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393172d-8335-48f9-a1bd-0bee12f987dd None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:40.326433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c5cd2-b546-414a-8833-af36d16fa0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:40.327153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c5cd2-b546-414a-8833-af36d16fa0be admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:40.327469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c5cd2-b546-414a-8833-af36d16fa0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:40.327744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c5cd2-b546-414a-8833-af36d16fa0be admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:40.328580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c5cd2-b546-414a-8833-af36d16fa0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:40.330492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c5cd2-b546-414a-8833-af36d16fa0be admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:40.362158 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1007/2004] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:40 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:40.363687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ea7a8-b0ba-4b2d-a60c-4504f410e283 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:40.374694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ea7a8-b0ba-4b2d-a60c-4504f410e283 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:40.387199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:40.439092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5dea4a-4288-412c-ae2c-b4472da22c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:40.440033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dea4a-4288-412c-ae2c-b4472da22c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:40.440478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dea4a-4288-412c-ae2c-b4472da22c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:40.440820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dea4a-4288-412c-ae2c-b4472da22c15 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:40.441599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5dea4a-4288-412c-ae2c-b4472da22c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:40.443652 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5dea4a-4288-412c-ae2c-b4472da22c15 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:40.471234 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 998/2005] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:40 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:40.472194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c5cd2-b546-414a-8833-af36d16fa0be admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:40.483365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c5cd2-b546-414a-8833-af36d16fa0be admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:40.488754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceecc9f-8594-4427-b565-3ea1b67d1f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:40.489081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceecc9f-8594-4427-b565-3ea1b67d1f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:40.489360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceecc9f-8594-4427-b565-3ea1b67d1f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:40.489633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceecc9f-8594-4427-b565-3ea1b67d1f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:40.490692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceecc9f-8594-4427-b565-3ea1b67d1f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:40.492091 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceecc9f-8594-4427-b565-3ea1b67d1f10 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:40.504170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1008/2006] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:40.508868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5dea4a-4288-412c-ae2c-b4472da22c15 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:40.521747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5dea4a-4288-412c-ae2c-b4472da22c15 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:40.528427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d037d-b61e-4800-8690-08d69e89f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:40.529223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d037d-b61e-4800-8690-08d69e89f670 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:40.529627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d037d-b61e-4800-8690-08d69e89f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:40.529916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d037d-b61e-4800-8690-08d69e89f670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:40.530704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d037d-b61e-4800-8690-08d69e89f670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:40.532552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d037d-b61e-4800-8690-08d69e89f670 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:40.545879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 999/2007] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:40.552605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceecc9f-8594-4427-b565-3ea1b67d1f10 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:40.563182 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceecc9f-8594-4427-b565-3ea1b67d1f10 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:40.568329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc758c0-822d-497f-b31c-822d33dc08f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:40.571053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc758c0-822d-497f-b31c-822d33dc08f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:40.571053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc758c0-822d-497f-b31c-822d33dc08f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:40.571053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc758c0-822d-497f-b31c-822d33dc08f3 admin admin] PATH_INFO: `/v3/projects/96bcabc3935045f985adc882fab88391/users/601150291fab4d6e83b24dba086294b2/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:40.598529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc758c0-822d-497f-b31c-822d33dc08f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bcabc3935045f985adc882fab88391, user_id=601150291fab4d6e83b24dba086294b2, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:40.601834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc758c0-822d-497f-b31c-822d33dc08f3 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:40.631118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1009/2008] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:40 2022] PUT /identity/v3/projects/96bcabc3935045f985adc882fab88391/users/601150291fab4d6e83b24dba086294b2/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:40.642714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bf011-65e2-45b5-9c83-ced87839e397 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:40.642714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bf011-65e2-45b5-9c83-ced87839e397 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:40.642714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bf011-65e2-45b5-9c83-ced87839e397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:40.682781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-240bf011-65e2-45b5-9c83-ced87839e397 None None] MFA Rules not processed for user `601150291fab4d6e83b24dba086294b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:40.684470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-240bf011-65e2-45b5-9c83-ced87839e397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:40.790067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1000/2009] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:40.791532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc758c0-822d-497f-b31c-822d33dc08f3 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:40.879359 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc758c0-822d-497f-b31c-822d33dc08f3 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:40.884357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffce42-a2a0-49e5-b859-db4087fe596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:40.884978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffce42-a2a0-49e5-b859-db4087fe596f admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:40.885264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffce42-a2a0-49e5-b859-db4087fe596f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:40.885547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffce42-a2a0-49e5-b859-db4087fe596f admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:40.886444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffce42-a2a0-49e5-b859-db4087fe596f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:40.888329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffce42-a2a0-49e5-b859-db4087fe596f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:40.936473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1010/2010] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:40 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:40.941273 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bf011-65e2-45b5-9c83-ced87839e397 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:40.954850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bf011-65e2-45b5-9c83-ced87839e397 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:41.024332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fadcaa-562d-4e28-bc1e-af3bd2912e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:41.025043 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fadcaa-562d-4e28-bc1e-af3bd2912e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:41.025334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fadcaa-562d-4e28-bc1e-af3bd2912e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:41.025661 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fadcaa-562d-4e28-bc1e-af3bd2912e3f admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:41.026376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fadcaa-562d-4e28-bc1e-af3bd2912e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:41.028369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fadcaa-562d-4e28-bc1e-af3bd2912e3f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:41.064680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1001/2011] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:40 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:41.066164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffce42-a2a0-49e5-b859-db4087fe596f admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:41.089836 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffce42-a2a0-49e5-b859-db4087fe596f admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:41.107020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744b929-51c3-4d1a-be31-64f830e58c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:41.107776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744b929-51c3-4d1a-be31-64f830e58c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:41.108169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744b929-51c3-4d1a-be31-64f830e58c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:41.108749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744b929-51c3-4d1a-be31-64f830e58c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:41.109573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744b929-51c3-4d1a-be31-64f830e58c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:41.111865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744b929-51c3-4d1a-be31-64f830e58c21 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:41.124625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1011/2012] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:41.128924 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fadcaa-562d-4e28-bc1e-af3bd2912e3f admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:41.144291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fadcaa-562d-4e28-bc1e-af3bd2912e3f admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:41.152130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277ab58-17d6-4ad7-a39e-0e053c874af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:41.152804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ab58-17d6-4ad7-a39e-0e053c874af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:41.153330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ab58-17d6-4ad7-a39e-0e053c874af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:41.153672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ab58-17d6-4ad7-a39e-0e053c874af7 admin admin] PATH_INFO: `/v3/projects/337d6a74bf214783b30931e84393b4a2/users/cd3d57553116402489929a0de3e6cde9/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:41.171074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:41.176350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277ab58-17d6-4ad7-a39e-0e053c874af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337d6a74bf214783b30931e84393b4a2, user_id=cd3d57553116402489929a0de3e6cde9, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:41.180186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277ab58-17d6-4ad7-a39e-0e053c874af7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:41.195653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1002/2013] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:41 2022] PUT /identity/v3/projects/337d6a74bf214783b30931e84393b4a2/users/cd3d57553116402489929a0de3e6cde9/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:41.200949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744b929-51c3-4d1a-be31-64f830e58c21 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:41.212773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744b929-51c3-4d1a-be31-64f830e58c21 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:41.258449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:41.280613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c05fc-2c86-43e4-a6ab-1e50b056b175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:41.281318 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c05fc-2c86-43e4-a6ab-1e50b056b175 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:41.281592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c05fc-2c86-43e4-a6ab-1e50b056b175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:41.281937 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c05fc-2c86-43e4-a6ab-1e50b056b175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:41.282682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c05fc-2c86-43e4-a6ab-1e50b056b175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:41.284385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c05fc-2c86-43e4-a6ab-1e50b056b175 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:41.295795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1012/2014] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:41.300134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277ab58-17d6-4ad7-a39e-0e053c874af7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:41.310679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277ab58-17d6-4ad7-a39e-0e053c874af7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:41.318588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a251cde-a75e-4870-9740-1d7d3440b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:41.319761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a251cde-a75e-4870-9740-1d7d3440b2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:41.320086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a251cde-a75e-4870-9740-1d7d3440b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:41.320406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a251cde-a75e-4870-9740-1d7d3440b2e0 admin admin] PATH_INFO: `/v3/projects/337d6a74bf214783b30931e84393b4a2/users/cd3d57553116402489929a0de3e6cde9/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:41.322795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a251cde-a75e-4870-9740-1d7d3440b2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337d6a74bf214783b30931e84393b4a2, user_id=cd3d57553116402489929a0de3e6cde9, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:41.326065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a251cde-a75e-4870-9740-1d7d3440b2e0 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:41.339414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1003/2015] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:41 2022] PUT /identity/v3/projects/337d6a74bf214783b30931e84393b4a2/users/cd3d57553116402489929a0de3e6cde9/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:41.351234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7120808-2db4-4b77-980a-a5f04ef810fd None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:41.351667 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7120808-2db4-4b77-980a-a5f04ef810fd None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:41.352083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7120808-2db4-4b77-980a-a5f04ef810fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:41.394509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-a7120808-2db4-4b77-980a-a5f04ef810fd None None] MFA Rules not processed for user `cd3d57553116402489929a0de3e6cde9`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:41.396277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a7120808-2db4-4b77-980a-a5f04ef810fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:41.470161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1013/2016] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:41.487814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a251cde-a75e-4870-9740-1d7d3440b2e0 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:41.491281 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3a251cde-a75e-4870-9740-1d7d3440b2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:41.563031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a251cde-a75e-4870-9740-1d7d3440b2e0 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:41.567748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afceab-2e0c-46fd-a5c7-ef065fbd71f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:41.568659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afceab-2e0c-46fd-a5c7-ef065fbd71f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:41.569246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afceab-2e0c-46fd-a5c7-ef065fbd71f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:41.569377 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afceab-2e0c-46fd-a5c7-ef065fbd71f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:41.628627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afceab-2e0c-46fd-a5c7-ef065fbd71f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:41.630081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afceab-2e0c-46fd-a5c7-ef065fbd71f6 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:41.639739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1004/2017] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:41.836192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7120808-2db4-4b77-980a-a5f04ef810fd None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:41.838121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a7120808-2db4-4b77-980a-a5f04ef810fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:41.909493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7120808-2db4-4b77-980a-a5f04ef810fd None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:41.915239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:41.916040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:41.916403 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:41.916644 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] PATH_INFO: `/v3/users/9bb22aaba4e7419fb737bbb4f2dd6694` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:41.917860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb22aaba4e7419fb737bbb4f2dd6694)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:41.920773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:42.003416 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb22aaba4e7419fb737bbb4f2dd6694'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.028044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb22aaba4e7419fb737bbb4f2dd6694'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.033860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:42.058625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb22aaba4e7419fb737bbb4f2dd6694'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.073435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb22aaba4e7419fb737bbb4f2dd6694'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.074234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb22aaba4e7419fb737bbb4f2dd6694'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.084214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1014/2018] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:41 2022] DELETE /identity/v3/users/9bb22aaba4e7419fb737bbb4f2dd6694 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:42.086135 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3634e3-a98c-42d5-b0a6-ac4c6762c5d6 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:42.086427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3634e3-a98c-42d5-b0a6-ac4c6762c5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:42.086885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3634e3-a98c-42d5-b0a6-ac4c6762c5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:42.105464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5b3634e3-a98c-42d5-b0a6-ac4c6762c5d6 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:42.106680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5b3634e3-a98c-42d5-b0a6-ac4c6762c5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:42.174019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1005/2019] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:42.183891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:42.185344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:42.248992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae4881-7ea8-4e7f-82c6-133def0fe815 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:42.253110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e0de3-b4f3-4f73-8291-777460fdfd98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:42.253762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e0de3-b4f3-4f73-8291-777460fdfd98 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:42.254040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e0de3-b4f3-4f73-8291-777460fdfd98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:42.254313 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e0de3-b4f3-4f73-8291-777460fdfd98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:42.263509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e0de3-b4f3-4f73-8291-777460fdfd98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:42.264947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e0de3-b4f3-4f73-8291-777460fdfd98 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:42.274663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1015/2020] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:05:42.572282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3634e3-a98c-42d5-b0a6-ac4c6762c5d6 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:42.574511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5b3634e3-a98c-42d5-b0a6-ac4c6762c5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:42.597540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3634e3-a98c-42d5-b0a6-ac4c6762c5d6 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:42.615514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b6c1-f334-4560-9d41-f2af0fd00fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:42.616521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b6c1-f334-4560-9d41-f2af0fd00fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:42.617530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b6c1-f334-4560-9d41-f2af0fd00fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:42.618151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b6c1-f334-4560-9d41-f2af0fd00fd0 admin admin] PATH_INFO: `/v3/users/184d5e91b8d74e25a9c0c615af452081` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:42.620123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b6c1-f334-4560-9d41-f2af0fd00fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=184d5e91b8d74e25a9c0c615af452081)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:42.622486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b6c1-f334-4560-9d41-f2af0fd00fd0 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:42.676558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e0de3-b4f3-4f73-8291-777460fdfd98 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:42.677977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-0a4e0de3-b4f3-4f73-8291-777460fdfd98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:42.696701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e0de3-b4f3-4f73-8291-777460fdfd98 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:42.703774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:42.703979 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:42.704770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:42.705057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:42.705336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] PATH_INFO: `/v3/projects/47ad57da9eb343c4b5b72902bd14c718` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:42.706751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ad57da9eb343c4b5b72902bd14c718)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:42.709409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:42.751690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-6f99b6c1-f334-4560-9d41-f2af0fd00fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184d5e91b8d74e25a9c0c615af452081'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.772736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-6f99b6c1-f334-4560-9d41-f2af0fd00fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184d5e91b8d74e25a9c0c615af452081'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.774865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-6f99b6c1-f334-4560-9d41-f2af0fd00fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184d5e91b8d74e25a9c0c615af452081'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.791664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-6f99b6c1-f334-4560-9d41-f2af0fd00fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184d5e91b8d74e25a9c0c615af452081'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.792911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-6f99b6c1-f334-4560-9d41-f2af0fd00fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184d5e91b8d74e25a9c0c615af452081'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.820609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ad57da9eb343c4b5b72902bd14c718', 'request_id': 'req-bf9cead3-4201-4b23-b93f-eafdf3d78b74'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.827011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1006/2021] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:42 2022] DELETE /identity/v3/users/184d5e91b8d74e25a9c0c615af452081 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:42.832243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ad57da9eb343c4b5b72902bd14c718', 'request_id': 'req-bf9cead3-4201-4b23-b93f-eafdf3d78b74'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.833257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f4ad-855d-4eee-90cc-346bc643ca56 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:42.833818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f4ad-855d-4eee-90cc-346bc643ca56 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:42.834516 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f4ad-855d-4eee-90cc-346bc643ca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:42.845499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ad57da9eb343c4b5b72902bd14c718', 'request_id': 'req-bf9cead3-4201-4b23-b93f-eafdf3d78b74'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.867299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] The token cache is being invalidate because project 47ad57da9eb343c4b5b72902bd14c718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:42.867589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.868808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-61c0f4ad-855d-4eee-90cc-346bc643ca56 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:42.870080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-61c0f4ad-855d-4eee-90cc-346bc643ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:42.871921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:42.873804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1016/2022] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:42 2022] DELETE /identity/v3/projects/47ad57da9eb343c4b5b72902bd14c718 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:42.879967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:42.883498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:42.964066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1007/2023] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:42.965632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cead3-4201-4b23-b93f-eafdf3d78b74 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:42.970506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:42.971536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:42.971867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:42.972119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] PATH_INFO: `/v3/users/1cbce9607e534ac7b76d7e16e33f217d` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:42.973447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cbce9607e534ac7b76d7e16e33f217d)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:42.975426 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:42.976189 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0f4ad-855d-4eee-90cc-346bc643ca56 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:42.977785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-61c0f4ad-855d-4eee-90cc-346bc643ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:42.993480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:43.036147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cbce9607e534ac7b76d7e16e33f217d'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.043810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0f4ad-855d-4eee-90cc-346bc643ca56 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:43.047532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83861d0-8efa-4288-848c-54fff270db88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:43.048186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83861d0-8efa-4288-848c-54fff270db88 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:43.048465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83861d0-8efa-4288-848c-54fff270db88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:43.048859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83861d0-8efa-4288-848c-54fff270db88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:43.051054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cbce9607e534ac7b76d7e16e33f217d'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.060455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83861d0-8efa-4288-848c-54fff270db88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:43.063529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83861d0-8efa-4288-848c-54fff270db88 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:43.063902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cbce9607e534ac7b76d7e16e33f217d'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.071724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cbce9607e534ac7b76d7e16e33f217d'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.072544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cbce9607e534ac7b76d7e16e33f217d'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.074145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1008/2024] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:43.080056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1017/2025] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:42 2022] DELETE /identity/v3/users/1cbce9607e534ac7b76d7e16e33f217d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:43.430938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83861d0-8efa-4288-848c-54fff270db88 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:43.432977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b83861d0-8efa-4288-848c-54fff270db88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:43.444180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:43.449705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:43.450861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83861d0-8efa-4288-848c-54fff270db88 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:43.508594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:43.528134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:43.530177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:43.530431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:43.530722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] PATH_INFO: `/v3/projects/60d8b33744ef4c998850b75238021964` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:43.532058 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d8b33744ef4c998850b75238021964)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:43.534260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:43.589813 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ed98c-8380-4c58-b27f-813611ba7030 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:43.599107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:43.600222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:43.600660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:43.601055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] PATH_INFO: `/v3/projects/74079ebfb90948bf9ca19b0443479874` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:43.602846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74079ebfb90948bf9ca19b0443479874)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:43.606192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:43.625885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d8b33744ef4c998850b75238021964', 'request_id': 'req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.634402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d8b33744ef4c998850b75238021964', 'request_id': 'req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.643526 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d8b33744ef4c998850b75238021964', 'request_id': 'req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.667450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] The token cache is being invalidate because project 60d8b33744ef4c998850b75238021964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:43.667899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.668122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74079ebfb90948bf9ca19b0443479874', 'request_id': 'req-578f8480-2400-40f1-964a-b45eb8ac3180'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.668579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.671511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1009/2026] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:43 2022] DELETE /identity/v3/projects/60d8b33744ef4c998850b75238021964 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:43.675356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74079ebfb90948bf9ca19b0443479874', 'request_id': 'req-578f8480-2400-40f1-964a-b45eb8ac3180'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.675640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:43.677582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:43.685284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74079ebfb90948bf9ca19b0443479874', 'request_id': 'req-578f8480-2400-40f1-964a-b45eb8ac3180'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.698867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] The token cache is being invalidate because project 74079ebfb90948bf9ca19b0443479874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:43.699276 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.700092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-578f8480-2400-40f1-964a-b45eb8ac3180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.702182 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1018/2027] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:43 2022] DELETE /identity/v3/projects/74079ebfb90948bf9ca19b0443479874 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:43.706759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8c78b-c204-4577-a745-8f9892dea926 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:43.707141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8c78b-c204-4577-a745-8f9892dea926 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:43.707520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8c78b-c204-4577-a745-8f9892dea926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:43.730467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-55b8c78b-c204-4577-a745-8f9892dea926 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:43.732024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-55b8c78b-c204-4577-a745-8f9892dea926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:43.748554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:43.782301 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe29ee9-ee85-4b71-a3b6-cb05bc65ac10 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:43.812969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1019/2028] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:43.824441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ab615-f9d6-41d7-b650-df265803b7d5 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:43.825719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ab615-f9d6-41d7-b650-df265803b7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:43.826220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ab615-f9d6-41d7-b650-df265803b7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:43.847581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-7c8ab615-f9d6-41d7-b650-df265803b7d5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:43.848815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7c8ab615-f9d6-41d7-b650-df265803b7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:43.850576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:43.851735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:43.852275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:43.852753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] PATH_INFO: `/v3/users/f45187e56d074e41bf65be6e1c0e2309` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:43.854188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45187e56d074e41bf65be6e1c0e2309)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:43.856352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:43.857590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1020/2029] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:43.864098 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ab615-f9d6-41d7-b650-df265803b7d5 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:43.873389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ab615-f9d6-41d7-b650-df265803b7d5 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:43.877951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd31d62-ca6a-4f2e-a0db-2d51b591b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:43.878605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31d62-ca6a-4f2e-a0db-2d51b591b20f admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:43.878888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31d62-ca6a-4f2e-a0db-2d51b591b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:43.879532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd31d62-ca6a-4f2e-a0db-2d51b591b20f admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:43.879948 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd31d62-ca6a-4f2e-a0db-2d51b591b20f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:43.880427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd31d62-ca6a-4f2e-a0db-2d51b591b20f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:43.882049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd31d62-ca6a-4f2e-a0db-2d51b591b20f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:43.886750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:43.895350 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1021/2030] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:43.899918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd31d62-ca6a-4f2e-a0db-2d51b591b20f admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:43.909703 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd31d62-ca6a-4f2e-a0db-2d51b591b20f admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:43.913536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45187e56d074e41bf65be6e1c0e2309'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.915213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe30ca1-d1f1-4871-8c93-6ee60a2d24db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:43.917284 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe30ca1-d1f1-4871-8c93-6ee60a2d24db admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:43.917570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe30ca1-d1f1-4871-8c93-6ee60a2d24db admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:43.917848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe30ca1-d1f1-4871-8c93-6ee60a2d24db admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:43.918565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe30ca1-d1f1-4871-8c93-6ee60a2d24db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:43.920658 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe30ca1-d1f1-4871-8c93-6ee60a2d24db admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:43.927635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45187e56d074e41bf65be6e1c0e2309'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.928387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45187e56d074e41bf65be6e1c0e2309'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.937862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45187e56d074e41bf65be6e1c0e2309'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.938651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45187e56d074e41bf65be6e1c0e2309'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:43.950481 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1022/2031] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:43 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:43.953301 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1010/2032] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:43 2022] DELETE /identity/v3/users/f45187e56d074e41bf65be6e1c0e2309 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:43.956475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe30ca1-d1f1-4871-8c93-6ee60a2d24db admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:43.958142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1fe30ca1-d1f1-4871-8c93-6ee60a2d24db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:44.037319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe30ca1-d1f1-4871-8c93-6ee60a2d24db admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.111848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3652c-810f-4b23-9fa6-d901bbdafa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.112693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3652c-810f-4b23-9fa6-d901bbdafa84 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.113205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3652c-810f-4b23-9fa6-d901bbdafa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.113773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3652c-810f-4b23-9fa6-d901bbdafa84 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.115063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3652c-810f-4b23-9fa6-d901bbdafa84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.116837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3652c-810f-4b23-9fa6-d901bbdafa84 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.138258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1023/2033] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:43 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:44.142499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:44.153091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ebbbd-8d15-4de7-aa83-85fd7811eb5c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.158232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2b599-249f-4673-945b-75d32ef54c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.159172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2b599-249f-4673-945b-75d32ef54c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.161572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2b599-249f-4673-945b-75d32ef54c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.161572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2b599-249f-4673-945b-75d32ef54c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.161572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2b599-249f-4673-945b-75d32ef54c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.162752 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2b599-249f-4673-945b-75d32ef54c10 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.174022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1011/2034] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:44.178155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3652c-810f-4b23-9fa6-d901bbdafa84 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:44.188558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3652c-810f-4b23-9fa6-d901bbdafa84 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.194362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eaea8-8e39-4896-8d09-db781bbcdb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.195226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eaea8-8e39-4896-8d09-db781bbcdb54 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.195555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eaea8-8e39-4896-8d09-db781bbcdb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.195849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eaea8-8e39-4896-8d09-db781bbcdb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.196717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690eaea8-8e39-4896-8d09-db781bbcdb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.198626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690eaea8-8e39-4896-8d09-db781bbcdb54 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.209477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1024/2035] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:44.213626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2b599-249f-4673-945b-75d32ef54c10 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:44.224920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2b599-249f-4673-945b-75d32ef54c10 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.230286 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83f88d-46af-49c3-ad57-6f65b7974553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.231332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f88d-46af-49c3-ad57-6f65b7974553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.231650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f88d-46af-49c3-ad57-6f65b7974553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.231993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f88d-46af-49c3-ad57-6f65b7974553 admin admin] PATH_INFO: `/v3/projects/5de97b2e74ac44c1ba4a577ec0865b4e/users/fce08673e7ed466c96d32f2edb7e5912/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.243141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eaea8-8e39-4896-8d09-db781bbcdb54 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:44.245119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-690eaea8-8e39-4896-8d09-db781bbcdb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:44.260539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83f88d-46af-49c3-ad57-6f65b7974553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de97b2e74ac44c1ba4a577ec0865b4e, user_id=fce08673e7ed466c96d32f2edb7e5912, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.265190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:44.266241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83f88d-46af-49c3-ad57-6f65b7974553 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.270181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eaea8-8e39-4896-8d09-db781bbcdb54 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.279409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.280497 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.280833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.281453 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] PATH_INFO: `/v3/projects/94dba55cf3ae42bdb19750f4f2ccabfa` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.284196 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94dba55cf3ae42bdb19750f4f2ccabfa)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.286479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.291040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1012/2036] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:44 2022] PUT /identity/v3/projects/5de97b2e74ac44c1ba4a577ec0865b4e/users/fce08673e7ed466c96d32f2edb7e5912/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:44.303101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700888e-12b8-4fb9-9596-26b4533dba89 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.303653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700888e-12b8-4fb9-9596-26b4533dba89 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.304176 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700888e-12b8-4fb9-9596-26b4533dba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.344793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1700888e-12b8-4fb9-9596-26b4533dba89 None None] MFA Rules not processed for user `fce08673e7ed466c96d32f2edb7e5912`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:44.347967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1700888e-12b8-4fb9-9596-26b4533dba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:44.364058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94dba55cf3ae42bdb19750f4f2ccabfa', 'request_id': 'req-2f4362d5-9be6-499b-8a30-becd165cd447'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:44.371715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94dba55cf3ae42bdb19750f4f2ccabfa', 'request_id': 'req-2f4362d5-9be6-499b-8a30-becd165cd447'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:44.382172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94dba55cf3ae42bdb19750f4f2ccabfa', 'request_id': 'req-2f4362d5-9be6-499b-8a30-becd165cd447'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:44.397657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] The token cache is being invalidate because project 94dba55cf3ae42bdb19750f4f2ccabfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:44.397944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:44.398603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2f4362d5-9be6-499b-8a30-becd165cd447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:44.400605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1025/2037] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:44 2022] DELETE /identity/v3/projects/94dba55cf3ae42bdb19750f4f2ccabfa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:44.405221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d4dba-b60d-4d0d-837e-a7cc291991b0 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.405578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d4dba-b60d-4d0d-837e-a7cc291991b0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.405958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d4dba-b60d-4d0d-837e-a7cc291991b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.429659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d90d4dba-b60d-4d0d-837e-a7cc291991b0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:44.429996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1013/2038] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:44.431059 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d90d4dba-b60d-4d0d-837e-a7cc291991b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:44.441460 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700888e-12b8-4fb9-9596-26b4533dba89 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:44.443401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1700888e-12b8-4fb9-9596-26b4533dba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:44.518326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700888e-12b8-4fb9-9596-26b4533dba89 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.523471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5b3b4-fc4d-44d6-bdd0-1e9f1ada3455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.524131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1026/2039] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:44.524617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5b3b4-fc4d-44d6-bdd0-1e9f1ada3455 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.525160 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5b3b4-fc4d-44d6-bdd0-1e9f1ada3455 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.525467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5b3b4-fc4d-44d6-bdd0-1e9f1ada3455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.535401 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0b67b-dd74-4491-84fa-5f094160cbb4 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.535583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5b3b4-fc4d-44d6-bdd0-1e9f1ada3455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.535817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0b67b-dd74-4491-84fa-5f094160cbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.536103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0b67b-dd74-4491-84fa-5f094160cbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.537040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5b3b4-fc4d-44d6-bdd0-1e9f1ada3455 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.545788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:44.559093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1014/2040] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:05:44.565387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-05f0b67b-dd74-4491-84fa-5f094160cbb4 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:44.566637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-05f0b67b-dd74-4491-84fa-5f094160cbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:44.575760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1027/2041] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:44.580182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5b3b4-fc4d-44d6-bdd0-1e9f1ada3455 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:44.591507 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5b3b4-fc4d-44d6-bdd0-1e9f1ada3455 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.601104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ab56-be46-4c0c-bf81-815a66237018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.601744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ab56-be46-4c0c-bf81-815a66237018 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.602038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ab56-be46-4c0c-bf81-815a66237018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.602458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ab56-be46-4c0c-bf81-815a66237018 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.603273 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ab56-be46-4c0c-bf81-815a66237018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:44.603696 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ab56-be46-4c0c-bf81-815a66237018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.605449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ab56-be46-4c0c-bf81-815a66237018 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.619063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1015/2042] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:05:44.624287 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0b67b-dd74-4491-84fa-5f094160cbb4 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:44.635582 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0b67b-dd74-4491-84fa-5f094160cbb4 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.647141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bda5f8-6430-4590-b6d4-34ae18a886ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.649319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda5f8-6430-4590-b6d4-34ae18a886ee admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.650509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda5f8-6430-4590-b6d4-34ae18a886ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.651003 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda5f8-6430-4590-b6d4-34ae18a886ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.651896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bda5f8-6430-4590-b6d4-34ae18a886ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.655727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bda5f8-6430-4590-b6d4-34ae18a886ee admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.690567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1028/2043] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:44 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:44.691755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ab56-be46-4c0c-bf81-815a66237018 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:44.703101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ab56-be46-4c0c-bf81-815a66237018 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.775412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a715c-92d8-45de-8040-7480c862310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.776141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a715c-92d8-45de-8040-7480c862310c admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.776496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a715c-92d8-45de-8040-7480c862310c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.776842 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a715c-92d8-45de-8040-7480c862310c admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.779451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a715c-92d8-45de-8040-7480c862310c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.781394 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a715c-92d8-45de-8040-7480c862310c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.809056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1016/2044] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:44 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:44.810597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bda5f8-6430-4590-b6d4-34ae18a886ee admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:44.826886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bda5f8-6430-4590-b6d4-34ae18a886ee admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.833212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414f182-d64d-48f6-8029-639312a2c5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.833983 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f182-d64d-48f6-8029-639312a2c5ae admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.834354 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f182-d64d-48f6-8029-639312a2c5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.834736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f182-d64d-48f6-8029-639312a2c5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.835883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414f182-d64d-48f6-8029-639312a2c5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.837471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414f182-d64d-48f6-8029-639312a2c5ae admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.850649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1029/2045] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:44.854756 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a715c-92d8-45de-8040-7480c862310c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:44.866152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a715c-92d8-45de-8040-7480c862310c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.876240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b443e6-8929-4187-a67c-3e4bab61f24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.877034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b443e6-8929-4187-a67c-3e4bab61f24f admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.877329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b443e6-8929-4187-a67c-3e4bab61f24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.877613 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b443e6-8929-4187-a67c-3e4bab61f24f admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.878457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b443e6-8929-4187-a67c-3e4bab61f24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.880750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b443e6-8929-4187-a67c-3e4bab61f24f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.900527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1017/2046] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:44.904600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414f182-d64d-48f6-8029-639312a2c5ae admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:44.916175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414f182-d64d-48f6-8029-639312a2c5ae admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:44.923294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102352e8-d637-4abc-8236-239b4d0b227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:44.924690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102352e8-d637-4abc-8236-239b4d0b227f admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.924969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102352e8-d637-4abc-8236-239b4d0b227f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.925447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102352e8-d637-4abc-8236-239b4d0b227f admin admin] PATH_INFO: `/v3/projects/8fc414baf39940f2835af45437ff9069/users/1aaa373b8edb4d61aa5c800b47d79f40/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:44.954013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102352e8-d637-4abc-8236-239b4d0b227f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc414baf39940f2835af45437ff9069, user_id=1aaa373b8edb4d61aa5c800b47d79f40, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:44.957072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102352e8-d637-4abc-8236-239b4d0b227f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:44.983675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1030/2047] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:44 2022] PUT /identity/v3/projects/8fc414baf39940f2835af45437ff9069/users/1aaa373b8edb4d61aa5c800b47d79f40/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:44.996302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071177e-548f-4d8b-8627-bd32918ec26e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:44.996820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071177e-548f-4d8b-8627-bd32918ec26e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:44.997324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071177e-548f-4d8b-8627-bd32918ec26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:45.030947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a071177e-548f-4d8b-8627-bd32918ec26e None None] MFA Rules not processed for user `1aaa373b8edb4d61aa5c800b47d79f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:45.032435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a071177e-548f-4d8b-8627-bd32918ec26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:45.138767 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1018/2048] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:45.140129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102352e8-d637-4abc-8236-239b4d0b227f admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:45.177875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:45.229432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102352e8-d637-4abc-8236-239b4d0b227f admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:45.234412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac4fda-f4d5-45fb-a4ce-78f93e74056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:45.235303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac4fda-f4d5-45fb-a4ce-78f93e74056e admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:45.235439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac4fda-f4d5-45fb-a4ce-78f93e74056e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:45.236065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac4fda-f4d5-45fb-a4ce-78f93e74056e admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:45.236402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac4fda-f4d5-45fb-a4ce-78f93e74056e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:45.238355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac4fda-f4d5-45fb-a4ce-78f93e74056e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:45.268016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1031/2049] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:45 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:45.269304 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071177e-548f-4d8b-8627-bd32918ec26e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:45.280716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071177e-548f-4d8b-8627-bd32918ec26e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:45.335200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:45.343259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4e06d-96ee-4c7c-b9d2-df5c29b05325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:45.343961 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4e06d-96ee-4c7c-b9d2-df5c29b05325 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:45.345815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4e06d-96ee-4c7c-b9d2-df5c29b05325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:45.346111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4e06d-96ee-4c7c-b9d2-df5c29b05325 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:45.346816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4e06d-96ee-4c7c-b9d2-df5c29b05325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:45.348800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4e06d-96ee-4c7c-b9d2-df5c29b05325 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:45.369982 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1019/2050] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:45 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:45.374199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac4fda-f4d5-45fb-a4ce-78f93e74056e admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:45.385341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac4fda-f4d5-45fb-a4ce-78f93e74056e admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:45.391029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebbe6d-19fc-4cbb-9eb9-37bb089750ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:45.391801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebbe6d-19fc-4cbb-9eb9-37bb089750ea admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:45.392185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebbe6d-19fc-4cbb-9eb9-37bb089750ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:45.393166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebbe6d-19fc-4cbb-9eb9-37bb089750ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:45.393981 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebbe6d-19fc-4cbb-9eb9-37bb089750ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:45.395780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebbe6d-19fc-4cbb-9eb9-37bb089750ea admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:45.407403 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1032/2051] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:45.411663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4e06d-96ee-4c7c-b9d2-df5c29b05325 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:45.422784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4e06d-96ee-4c7c-b9d2-df5c29b05325 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:45.427744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4914cd-2f3d-4d82-aa5c-318ecf18e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:45.428642 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4914cd-2f3d-4d82-aa5c-318ecf18e976 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:45.428923 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4914cd-2f3d-4d82-aa5c-318ecf18e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:45.429201 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4914cd-2f3d-4d82-aa5c-318ecf18e976 admin admin] PATH_INFO: `/v3/projects/4ac8a6cf29fe4e33bb9d17ffa1e21598/users/7195c891184a407994a1abcb813a7432/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:45.445042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4914cd-2f3d-4d82-aa5c-318ecf18e976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac8a6cf29fe4e33bb9d17ffa1e21598, user_id=7195c891184a407994a1abcb813a7432, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:45.449928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4914cd-2f3d-4d82-aa5c-318ecf18e976 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:45.467612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1020/2052] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:45 2022] PUT /identity/v3/projects/4ac8a6cf29fe4e33bb9d17ffa1e21598/users/7195c891184a407994a1abcb813a7432/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:45.471929 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebbe6d-19fc-4cbb-9eb9-37bb089750ea admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:45.488166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebbe6d-19fc-4cbb-9eb9-37bb089750ea admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:45.557509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ec3b2-001b-4d89-8683-c08d5dc18342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:45.558174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ec3b2-001b-4d89-8683-c08d5dc18342 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:45.558450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ec3b2-001b-4d89-8683-c08d5dc18342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:45.558721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ec3b2-001b-4d89-8683-c08d5dc18342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:45.559504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ec3b2-001b-4d89-8683-c08d5dc18342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:45.561100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ec3b2-001b-4d89-8683-c08d5dc18342 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:45.570820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1033/2053] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:45.575246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4914cd-2f3d-4d82-aa5c-318ecf18e976 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:45.586683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4914cd-2f3d-4d82-aa5c-318ecf18e976 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:45.592513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8abe71-3053-4755-8a26-22333fbc92fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:45.593553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8abe71-3053-4755-8a26-22333fbc92fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:45.593841 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8abe71-3053-4755-8a26-22333fbc92fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:45.594113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8abe71-3053-4755-8a26-22333fbc92fc admin admin] PATH_INFO: `/v3/projects/4ac8a6cf29fe4e33bb9d17ffa1e21598/users/7195c891184a407994a1abcb813a7432/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:45.596405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8abe71-3053-4755-8a26-22333fbc92fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac8a6cf29fe4e33bb9d17ffa1e21598, user_id=7195c891184a407994a1abcb813a7432, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:45.599154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8abe71-3053-4755-8a26-22333fbc92fc admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:45.610857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1021/2054] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:45 2022] PUT /identity/v3/projects/4ac8a6cf29fe4e33bb9d17ffa1e21598/users/7195c891184a407994a1abcb813a7432/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:45.621362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640109d-b3ed-4c64-8b81-c1466c562df5 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:45.621676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640109d-b3ed-4c64-8b81-c1466c562df5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:45.621950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640109d-b3ed-4c64-8b81-c1466c562df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:45.648852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-7640109d-b3ed-4c64-8b81-c1466c562df5 None None] MFA Rules not processed for user `7195c891184a407994a1abcb813a7432`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:45.650150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7640109d-b3ed-4c64-8b81-c1466c562df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:45.719550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1034/2055] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:45.732063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8abe71-3053-4755-8a26-22333fbc92fc admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:45.734075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-af8abe71-3053-4755-8a26-22333fbc92fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:45.800696 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8abe71-3053-4755-8a26-22333fbc92fc admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:45.804307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87dc88-e512-4ebb-98cb-fa0d86ec58b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:45.804983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87dc88-e512-4ebb-98cb-fa0d86ec58b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:45.805313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87dc88-e512-4ebb-98cb-fa0d86ec58b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:45.805608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87dc88-e512-4ebb-98cb-fa0d86ec58b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:45.814344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87dc88-e512-4ebb-98cb-fa0d86ec58b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:45.815814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87dc88-e512-4ebb-98cb-fa0d86ec58b2 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:45.828909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1022/2056] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:45.907974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640109d-b3ed-4c64-8b81-c1466c562df5 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:45.923495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640109d-b3ed-4c64-8b81-c1466c562df5 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:45.927883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f56dd-5973-455c-9e58-4caae5202637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:45.928533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f56dd-5973-455c-9e58-4caae5202637 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:45.928814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f56dd-5973-455c-9e58-4caae5202637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:45.929113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f56dd-5973-455c-9e58-4caae5202637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:45.946899 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:45.990280 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f56dd-5973-455c-9e58-4caae5202637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:45.991837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f56dd-5973-455c-9e58-4caae5202637 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:46.001528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1035/2057] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:46.325716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87dc88-e512-4ebb-98cb-fa0d86ec58b2 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:46.334936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87dc88-e512-4ebb-98cb-fa0d86ec58b2 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:46.345209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594df875-f6b7-4da0-b890-481b53f46d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:46.346067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df875-f6b7-4da0-b890-481b53f46d98 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:46.346223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df875-f6b7-4da0-b890-481b53f46d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:46.346444 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594df875-f6b7-4da0-b890-481b53f46d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:46.348492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-594df875-f6b7-4da0-b890-481b53f46d98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:46.416466 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594df875-f6b7-4da0-b890-481b53f46d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:46.417857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594df875-f6b7-4da0-b890-481b53f46d98 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:46.428313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1023/2058] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:50.661569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f56dd-5973-455c-9e58-4caae5202637 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:50.663228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-240f56dd-5973-455c-9e58-4caae5202637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:50.730358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f56dd-5973-455c-9e58-4caae5202637 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:50.735308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:50.736184 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:50.736484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:50.736771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] PATH_INFO: `/v3/users/fce08673e7ed466c96d32f2edb7e5912` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:50.737987 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce08673e7ed466c96d32f2edb7e5912)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:50.740019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:50.791251 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce08673e7ed466c96d32f2edb7e5912'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:50.802695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce08673e7ed466c96d32f2edb7e5912'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:50.812183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce08673e7ed466c96d32f2edb7e5912'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:50.819465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce08673e7ed466c96d32f2edb7e5912'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:50.820117 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce08673e7ed466c96d32f2edb7e5912'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:50.826616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1036/2059] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:50 2022] DELETE /identity/v3/users/fce08673e7ed466c96d32f2edb7e5912 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:50.831596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f30c-2386-4859-9559-10fe1d066c3a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:50.832164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f30c-2386-4859-9559-10fe1d066c3a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:50.832164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f30c-2386-4859-9559-10fe1d066c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:50.851583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7123f30c-2386-4859-9559-10fe1d066c3a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:50.852782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7123f30c-2386-4859-9559-10fe1d066c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:50.899360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:50.925720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1024/2060] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:50.936104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:50.937761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:50.980679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:50.998160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ccdc-b759-4b2a-88a1-3e77ccafd326 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:51.002265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f1ee1-86b7-4bde-b7a2-ae07d7428baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:51.002924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f1ee1-86b7-4bde-b7a2-ae07d7428baa service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.003244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f1ee1-86b7-4bde-b7a2-ae07d7428baa service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.003513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f1ee1-86b7-4bde-b7a2-ae07d7428baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.013871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f1ee1-86b7-4bde-b7a2-ae07d7428baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:51.015395 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f1ee1-86b7-4bde-b7a2-ae07d7428baa service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:51.026100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1037/2061] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:05:51.318127 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f30c-2386-4859-9559-10fe1d066c3a None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:51.319545 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7123f30c-2386-4859-9559-10fe1d066c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:51.339724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f30c-2386-4859-9559-10fe1d066c3a None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:51.345787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:51.347375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.347375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.347375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] PATH_INFO: `/v3/projects/5de97b2e74ac44c1ba4a577ec0865b4e` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.348604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de97b2e74ac44c1ba4a577ec0865b4e)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:51.351570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:51.406316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f1ee1-86b7-4bde-b7a2-ae07d7428baa service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:51.407081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de97b2e74ac44c1ba4a577ec0865b4e', 'request_id': 'req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.407882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ef3f1ee1-86b7-4bde-b7a2-ae07d7428baa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:51.414173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de97b2e74ac44c1ba4a577ec0865b4e', 'request_id': 'req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.421340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f1ee1-86b7-4bde-b7a2-ae07d7428baa service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:51.422642 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de97b2e74ac44c1ba4a577ec0865b4e', 'request_id': 'req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.435771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] The token cache is being invalidate because project 5de97b2e74ac44c1ba4a577ec0865b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:51.436057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.436706 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8b2c12f-1f90-47c3-910e-6d91077cf3cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.438908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1025/2062] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:51 2022] DELETE /identity/v3/projects/5de97b2e74ac44c1ba4a577ec0865b4e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:51.443845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae466348-bf59-41a2-a556-4b6deae26e78 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.444179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae466348-bf59-41a2-a556-4b6deae26e78 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.444578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae466348-bf59-41a2-a556-4b6deae26e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.465448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ae466348-bf59-41a2-a556-4b6deae26e78 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:51.466826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ae466348-bf59-41a2-a556-4b6deae26e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:51.492995 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:51.497890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.497890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.497890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] PATH_INFO: `/v3/users/1aaa373b8edb4d61aa5c800b47d79f40` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.499023 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aaa373b8edb4d61aa5c800b47d79f40)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:51.501672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:51.541976 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1026/2063] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:51.549849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab7a2-a15a-4c21-a61a-445b98df2d19 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.550215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab7a2-a15a-4c21-a61a-445b98df2d19 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.550497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab7a2-a15a-4c21-a61a-445b98df2d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.558567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aaa373b8edb4d61aa5c800b47d79f40'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.573324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1b1ab7a2-a15a-4c21-a61a-445b98df2d19 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:51.574836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1b1ab7a2-a15a-4c21-a61a-445b98df2d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:51.575805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aaa373b8edb4d61aa5c800b47d79f40'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.585260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1027/2064] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:51.587519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aaa373b8edb4d61aa5c800b47d79f40'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.589831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ab7a2-a15a-4c21-a61a-445b98df2d19 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:51.598399 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aaa373b8edb4d61aa5c800b47d79f40'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.599433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aaa373b8edb4d61aa5c800b47d79f40'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.602936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ab7a2-a15a-4c21-a61a-445b98df2d19 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:51.605971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1038/2065] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:51 2022] DELETE /identity/v3/users/1aaa373b8edb4d61aa5c800b47d79f40 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:51.606769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:51.608758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:51.684314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36824be-77d2-4da1-b0c4-d9dd3b118e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:51.684976 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36824be-77d2-4da1-b0c4-d9dd3b118e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.685258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36824be-77d2-4da1-b0c4-d9dd3b118e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.685533 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36824be-77d2-4da1-b0c4-d9dd3b118e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.686262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36824be-77d2-4da1-b0c4-d9dd3b118e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:51.686620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36824be-77d2-4da1-b0c4-d9dd3b118e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:51.686726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66817ee3-5680-48be-baec-38f1086a7ff5 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:51.688245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36824be-77d2-4da1-b0c4-d9dd3b118e8a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:51.690902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:51.691611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:51.692587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.692888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.693168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] PATH_INFO: `/v3/users/601150291fab4d6e83b24dba086294b2` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.694448 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=601150291fab4d6e83b24dba086294b2)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:51.696537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:51.698544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:51.712013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1028/2066] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 03:05:51.712013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d845c-8bce-4067-a696-56c907367fd2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.712013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d845c-8bce-4067-a696-56c907367fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.712013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d845c-8bce-4067-a696-56c907367fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.729636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9d0d845c-8bce-4067-a696-56c907367fd2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:51.730875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9d0d845c-8bce-4067-a696-56c907367fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:51.739613 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1029/2067] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:51.740508 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d845c-8bce-4067-a696-56c907367fd2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:51.741673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9d0d845c-8bce-4067-a696-56c907367fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:51.753944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601150291fab4d6e83b24dba086294b2'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.756040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d845c-8bce-4067-a696-56c907367fd2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:51.760536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6a9d5-7934-4a99-a8a8-a313b157c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:51.761205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a9d5-7934-4a99-a8a8-a313b157c382 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.761488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a9d5-7934-4a99-a8a8-a313b157c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.761765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a9d5-7934-4a99-a8a8-a313b157c382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.762460 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6a9d5-7934-4a99-a8a8-a313b157c382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:51.764421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6a9d5-7934-4a99-a8a8-a313b157c382 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:51.766561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601150291fab4d6e83b24dba086294b2'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.776539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601150291fab4d6e83b24dba086294b2'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.785040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601150291fab4d6e83b24dba086294b2'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.785746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601150291fab4d6e83b24dba086294b2'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:51.794717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1030/2068] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:51 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:51.794893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1039/2069] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:51 2022] DELETE /identity/v3/users/601150291fab4d6e83b24dba086294b2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:51.795024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6a9d5-7934-4a99-a8a8-a313b157c382 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:51.795024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-62f6a9d5-7934-4a99-a8a8-a313b157c382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:51.795823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:51.797108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:51.851202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6a9d5-7934-4a99-a8a8-a313b157c382 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:51.864175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cd919-d759-43fb-a13d-46e97e36d65c admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:51.869153 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0e675-0eaf-4cb4-8111-bfcb73ad45de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:51.869829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0e675-0eaf-4cb4-8111-bfcb73ad45de admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.870109 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0e675-0eaf-4cb4-8111-bfcb73ad45de admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.870390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0e675-0eaf-4cb4-8111-bfcb73ad45de admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.871325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0e675-0eaf-4cb4-8111-bfcb73ad45de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:51.873057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0e675-0eaf-4cb4-8111-bfcb73ad45de admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:51.899612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1040/2070] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:51 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:51.899612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f531282-172a-49df-9b4c-f80b08c75325 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.899612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f531282-172a-49df-9b4c-f80b08c75325 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.899612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f531282-172a-49df-9b4c-f80b08c75325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.903258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e933f33-5fd2-46a4-b0e8-14d562a41e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:51.903919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933f33-5fd2-46a4-b0e8-14d562a41e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.904200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933f33-5fd2-46a4-b0e8-14d562a41e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.904477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933f33-5fd2-46a4-b0e8-14d562a41e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.906302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0e933f33-5fd2-46a4-b0e8-14d562a41e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:51.917675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8f531282-172a-49df-9b4c-f80b08c75325 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:51.919134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8f531282-172a-49df-9b4c-f80b08c75325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:51.919387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e933f33-5fd2-46a4-b0e8-14d562a41e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:51.921101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e933f33-5fd2-46a4-b0e8-14d562a41e30 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:51.926951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1041/2071] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:51.930831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f531282-172a-49df-9b4c-f80b08c75325 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:51.931509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1031/2072] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:51.941345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f531282-172a-49df-9b4c-f80b08c75325 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:51.946521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c804e20-fbc8-474e-95d1-9ea647a52692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:51.947319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c804e20-fbc8-474e-95d1-9ea647a52692 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.947760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c804e20-fbc8-474e-95d1-9ea647a52692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.948035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e933f33-5fd2-46a4-b0e8-14d562a41e30 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:51.948158 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c804e20-fbc8-474e-95d1-9ea647a52692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.948824 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c804e20-fbc8-474e-95d1-9ea647a52692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:51.950530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c804e20-fbc8-474e-95d1-9ea647a52692 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:51.958229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e933f33-5fd2-46a4-b0e8-14d562a41e30 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:51.961931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1042/2073] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:51.962340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809bc48-55b5-4dda-9f03-60a3be3a90cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:51.963351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809bc48-55b5-4dda-9f03-60a3be3a90cc service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.963685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809bc48-55b5-4dda-9f03-60a3be3a90cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.964895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809bc48-55b5-4dda-9f03-60a3be3a90cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.966366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c804e20-fbc8-474e-95d1-9ea647a52692 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:51.975880 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809bc48-55b5-4dda-9f03-60a3be3a90cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:51.977555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809bc48-55b5-4dda-9f03-60a3be3a90cc service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:51.980054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c804e20-fbc8-474e-95d1-9ea647a52692 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:51.987300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5b45c-4c77-4ce9-a7eb-0c3ff69cb19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:51.987976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b45c-4c77-4ce9-a7eb-0c3ff69cb19e admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:51.988262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b45c-4c77-4ce9-a7eb-0c3ff69cb19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:51.988543 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b45c-4c77-4ce9-a7eb-0c3ff69cb19e admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:51.989281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5b45c-4c77-4ce9-a7eb-0c3ff69cb19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:51.990348 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1032/2074] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:51.993111 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5b45c-4c77-4ce9-a7eb-0c3ff69cb19e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:52.009653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1043/2075] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:52.014571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809bc48-55b5-4dda-9f03-60a3be3a90cc service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:52.025448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809bc48-55b5-4dda-9f03-60a3be3a90cc service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:52.030313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0192d0-2fa7-4dfe-bfe3-eb20f29652a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:52.031378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0192d0-2fa7-4dfe-bfe3-eb20f29652a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:52.031771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0192d0-2fa7-4dfe-bfe3-eb20f29652a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:52.032086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0192d0-2fa7-4dfe-bfe3-eb20f29652a7 admin admin] PATH_INFO: `/v3/projects/04188990d2db4ebd894bf9ba7f72988d/users/ea45f11a04224391a10274573d243a7b/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:52.050705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0192d0-2fa7-4dfe-bfe3-eb20f29652a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04188990d2db4ebd894bf9ba7f72988d, user_id=ea45f11a04224391a10274573d243a7b, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:52.053434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0192d0-2fa7-4dfe-bfe3-eb20f29652a7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:52.067012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1033/2076] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:52 2022] PUT /identity/v3/projects/04188990d2db4ebd894bf9ba7f72988d/users/ea45f11a04224391a10274573d243a7b/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:52.078288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51dfa-901c-4a37-a9d9-f3633e46485e None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:52.078650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51dfa-901c-4a37-a9d9-f3633e46485e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:52.078950 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51dfa-901c-4a37-a9d9-f3633e46485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:52.110496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d8a51dfa-901c-4a37-a9d9-f3633e46485e None None] MFA Rules not processed for user `ea45f11a04224391a10274573d243a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:52.111703 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d8a51dfa-901c-4a37-a9d9-f3633e46485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:52.143924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:52.203287 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1044/2077] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:52.214826 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0192d0-2fa7-4dfe-bfe3-eb20f29652a7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:52.216855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2c0192d0-2fa7-4dfe-bfe3-eb20f29652a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:52.298229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:52.304323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0192d0-2fa7-4dfe-bfe3-eb20f29652a7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:52.309629 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8872175-176e-4163-b427-7978db03246e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:52.310334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872175-176e-4163-b427-7978db03246e service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:52.311287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872175-176e-4163-b427-7978db03246e service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:52.311845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872175-176e-4163-b427-7978db03246e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:52.325537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8872175-176e-4163-b427-7978db03246e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:52.326776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8872175-176e-4163-b427-7978db03246e service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:52.343486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1034/2078] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:52.388954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a51dfa-901c-4a37-a9d9-f3633e46485e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:52.390659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d8a51dfa-901c-4a37-a9d9-f3633e46485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:52.444879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8872175-176e-4163-b427-7978db03246e service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:52.446277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e8872175-176e-4163-b427-7978db03246e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:52.516353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a51dfa-901c-4a37-a9d9-f3633e46485e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:52.523482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:52.524661 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:52.525255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:52.526138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] PATH_INFO: `/v3/projects/8fc414baf39940f2835af45437ff9069` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:52.527352 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc414baf39940f2835af45437ff9069)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:52.529666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:52.577443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8872175-176e-4163-b427-7978db03246e service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:52.582386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:52.583742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:52.584031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:52.584308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] PATH_INFO: `/v3/projects/96bcabc3935045f985adc882fab88391` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:52.585528 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96bcabc3935045f985adc882fab88391)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:52.587502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:52.595426 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc414baf39940f2835af45437ff9069', 'request_id': 'req-b7ee70c3-e609-4f47-a000-2b41db93ae57'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.601695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc414baf39940f2835af45437ff9069', 'request_id': 'req-b7ee70c3-e609-4f47-a000-2b41db93ae57'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.614527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc414baf39940f2835af45437ff9069', 'request_id': 'req-b7ee70c3-e609-4f47-a000-2b41db93ae57'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.635196 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] The token cache is being invalidate because project 8fc414baf39940f2835af45437ff9069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:52.635537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.636747 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.638800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1045/2079] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:52 2022] DELETE /identity/v3/projects/8fc414baf39940f2835af45437ff9069 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:52.642962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:52.644450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:52.658734 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96bcabc3935045f985adc882fab88391', 'request_id': 'req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.680789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96bcabc3935045f985adc882fab88391', 'request_id': 'req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.713086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96bcabc3935045f985adc882fab88391', 'request_id': 'req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.729615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee70c3-e609-4f47-a000-2b41db93ae57 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:52.733717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:52.737603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] The token cache is being invalidate because project 96bcabc3935045f985adc882fab88391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:52.738038 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.738758 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.740939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1035/2080] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:52 2022] DELETE /identity/v3/projects/96bcabc3935045f985adc882fab88391 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:52.745527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:52.756200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:52.824336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:52.825238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:52.825512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:52.825792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] PATH_INFO: `/v3/users/7195c891184a407994a1abcb813a7432` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:52.827044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7195c891184a407994a1abcb813a7432)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:52.829075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:52.869142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88735d01-0d4b-44e1-b1c8-d9b1c80d7168 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:52.876425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:52.876612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:52.876861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:52.877474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] PATH_INFO: `/v3/users/cd3d57553116402489929a0de3e6cde9` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:52.879057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3d57553116402489929a0de3e6cde9)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:52.881722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:52.886020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7195c891184a407994a1abcb813a7432'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.901118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7195c891184a407994a1abcb813a7432'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.910804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7195c891184a407994a1abcb813a7432'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.915781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:52.925944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7195c891184a407994a1abcb813a7432'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.927557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7195c891184a407994a1abcb813a7432'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.936377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1046/2081] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:52 2022] DELETE /identity/v3/users/7195c891184a407994a1abcb813a7432 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:52.951936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3d57553116402489929a0de3e6cde9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.974765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3d57553116402489929a0de3e6cde9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.975712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3d57553116402489929a0de3e6cde9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.984601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3d57553116402489929a0de3e6cde9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:52.985415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3d57553116402489929a0de3e6cde9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:53.003994 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1036/2082] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:52 2022] DELETE /identity/v3/users/cd3d57553116402489929a0de3e6cde9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:53.388809 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:53.390734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:53.570607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00960e4-5cef-4654-b675-3b27d05f5292 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:53.576254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:53.578477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:53.642352 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:53.683317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ae2b1-2228-49e4-9595-4373e74f0995 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:53.684034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:53.685494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:53.686003 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:53.686325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] PATH_INFO: `/v3/projects/4ac8a6cf29fe4e33bb9d17ffa1e21598` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:53.687864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac8a6cf29fe4e33bb9d17ffa1e21598)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:53.689858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:53.690123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:53.691070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:53.691456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:53.691641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] PATH_INFO: `/v3/projects/337d6a74bf214783b30931e84393b4a2` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:53.693016 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=337d6a74bf214783b30931e84393b4a2)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:53.698737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:53.759191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac8a6cf29fe4e33bb9d17ffa1e21598', 'request_id': 'req-5ed8afec-4f61-4949-bee5-1e7dc2c72057'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:53.765447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac8a6cf29fe4e33bb9d17ffa1e21598', 'request_id': 'req-5ed8afec-4f61-4949-bee5-1e7dc2c72057'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:53.775613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac8a6cf29fe4e33bb9d17ffa1e21598', 'request_id': 'req-5ed8afec-4f61-4949-bee5-1e7dc2c72057'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:53.784480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337d6a74bf214783b30931e84393b4a2', 'request_id': 'req-b8821c7f-564f-48e5-af71-2e9e2afbc33f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:53.789250 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337d6a74bf214783b30931e84393b4a2', 'request_id': 'req-b8821c7f-564f-48e5-af71-2e9e2afbc33f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:53.796187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] The token cache is being invalidate because project 4ac8a6cf29fe4e33bb9d17ffa1e21598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:53.796555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:53.797361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5ed8afec-4f61-4949-bee5-1e7dc2c72057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:53.799199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1047/2083] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:53 2022] DELETE /identity/v3/projects/4ac8a6cf29fe4e33bb9d17ffa1e21598 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:53.799345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337d6a74bf214783b30931e84393b4a2', 'request_id': 'req-b8821c7f-564f-48e5-af71-2e9e2afbc33f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:53.805707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15e4cf-4877-401e-8076-7a6dca247ff8 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:53.806611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15e4cf-4877-401e-8076-7a6dca247ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:53.806611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15e4cf-4877-401e-8076-7a6dca247ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:53.819084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] The token cache is being invalidate because project 337d6a74bf214783b30931e84393b4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:53.820884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:53.821676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b8821c7f-564f-48e5-af71-2e9e2afbc33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:53.827792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1037/2084] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:53 2022] DELETE /identity/v3/projects/337d6a74bf214783b30931e84393b4a2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:53.829047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-2f15e4cf-4877-401e-8076-7a6dca247ff8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:53.830293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2f15e4cf-4877-401e-8076-7a6dca247ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:53.830928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0e08-b913-4bf6-b780-c5158af8a7d0 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:53.831329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0e08-b913-4bf6-b780-c5158af8a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:53.831717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0e08-b913-4bf6-b780-c5158af8a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:53.867510 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-773d0e08-b913-4bf6-b780-c5158af8a7d0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:53.868539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-773d0e08-b913-4bf6-b780-c5158af8a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:53.901685 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1048/2085] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:53.904705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:53.910668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d98e96-5a54-4f52-9fa9-0532445033b8 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:53.911502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d98e96-5a54-4f52-9fa9-0532445033b8 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:53.911502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d98e96-5a54-4f52-9fa9-0532445033b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:53.934809 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-99d98e96-5a54-4f52-9fa9-0532445033b8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:53.936088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-99d98e96-5a54-4f52-9fa9-0532445033b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:53.945432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1049/2086] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:53.949783 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d98e96-5a54-4f52-9fa9-0532445033b8 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:53.961249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d98e96-5a54-4f52-9fa9-0532445033b8 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:53.963915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1038/2087] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:53.969730 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb5a53-bfe6-4c29-a82c-2f0fa5c8720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:53.970424 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5a53-bfe6-4c29-a82c-2f0fa5c8720b admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:53.970709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5a53-bfe6-4c29-a82c-2f0fa5c8720b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:53.971011 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5a53-bfe6-4c29-a82c-2f0fa5c8720b admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:53.972138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb5a53-bfe6-4c29-a82c-2f0fa5c8720b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:53.972457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb5a53-bfe6-4c29-a82c-2f0fa5c8720b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:53.974039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a166f19-8ad3-4a65-ae5b-4c220a689d7f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:53.974338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a166f19-8ad3-4a65-ae5b-4c220a689d7f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:53.974581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb5a53-bfe6-4c29-a82c-2f0fa5c8720b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:53.974673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a166f19-8ad3-4a65-ae5b-4c220a689d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:53.991070 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1050/2088] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 03:05:53.993472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3a166f19-8ad3-4a65-ae5b-4c220a689d7f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:53.993756 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb5a53-bfe6-4c29-a82c-2f0fa5c8720b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:53.995100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3a166f19-8ad3-4a65-ae5b-4c220a689d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:54.003217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1039/2089] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:54.007525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a166f19-8ad3-4a65-ae5b-4c220a689d7f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.007647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb5a53-bfe6-4c29-a82c-2f0fa5c8720b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.015725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9dc14-2382-4de7-a002-7c17f74ee928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.017394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9dc14-2382-4de7-a002-7c17f74ee928 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.017678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a166f19-8ad3-4a65-ae5b-4c220a689d7f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.017808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9dc14-2382-4de7-a002-7c17f74ee928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.018039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9dc14-2382-4de7-a002-7c17f74ee928 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.018870 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9dc14-2382-4de7-a002-7c17f74ee928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.021186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9dc14-2382-4de7-a002-7c17f74ee928 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.023002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6064d5f-1f00-4981-a8a8-00d4fcb59c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.023765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6064d5f-1f00-4981-a8a8-00d4fcb59c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.024124 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6064d5f-1f00-4981-a8a8-00d4fcb59c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.024418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6064d5f-1f00-4981-a8a8-00d4fcb59c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.025328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6064d5f-1f00-4981-a8a8-00d4fcb59c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:54.025618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6064d5f-1f00-4981-a8a8-00d4fcb59c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.027363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6064d5f-1f00-4981-a8a8-00d4fcb59c18 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.042523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1040/2090] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 03:05:54.047208 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6064d5f-1f00-4981-a8a8-00d4fcb59c18 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.064513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1051/2091] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:53 2022] POST /identity/v3/projects => generated 357 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:54.068293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9dc14-2382-4de7-a002-7c17f74ee928 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.071279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6064d5f-1f00-4981-a8a8-00d4fcb59c18 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.120359 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:54.157105 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1fefc-5324-48e8-a66c-4d62599625f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.157700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1fefc-5324-48e8-a66c-4d62599625f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.157983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1fefc-5324-48e8-a66c-4d62599625f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.158291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1fefc-5324-48e8-a66c-4d62599625f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.164211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1fefc-5324-48e8-a66c-4d62599625f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.167399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1fefc-5324-48e8-a66c-4d62599625f6 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.172243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9dc14-2382-4de7-a002-7c17f74ee928 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.178572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f6037-7ece-4c85-a170-c30218e246ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.179387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f6037-7ece-4c85-a170-c30218e246ea admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.179762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f6037-7ece-4c85-a170-c30218e246ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.180099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f6037-7ece-4c85-a170-c30218e246ea admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.180908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f6037-7ece-4c85-a170-c30218e246ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.182975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f6037-7ece-4c85-a170-c30218e246ea admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.204782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1041/2092] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:54 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:54.209241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1fefc-5324-48e8-a66c-4d62599625f6 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.211026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1052/2093] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:54 2022] POST /identity/v3/users => generated 279 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:54.215333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f6037-7ece-4c85-a170-c30218e246ea admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.227986 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f6037-7ece-4c85-a170-c30218e246ea admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.284771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1fefc-5324-48e8-a66c-4d62599625f6 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.289914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363cac9-1904-465b-976a-ec47bc7b6b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.290615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363cac9-1904-465b-976a-ec47bc7b6b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.291052 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363cac9-1904-465b-976a-ec47bc7b6b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.291326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363cac9-1904-465b-976a-ec47bc7b6b8e admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.292612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363cac9-1904-465b-976a-ec47bc7b6b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.294575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363cac9-1904-465b-976a-ec47bc7b6b8e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.311881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a005b3f-8c45-4a78-b76f-dda7c8f48a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.312561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a005b3f-8c45-4a78-b76f-dda7c8f48a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.312872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a005b3f-8c45-4a78-b76f-dda7c8f48a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.313171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a005b3f-8c45-4a78-b76f-dda7c8f48a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.313907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a005b3f-8c45-4a78-b76f-dda7c8f48a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.315798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a005b3f-8c45-4a78-b76f-dda7c8f48a24 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.319181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1042/2094] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:54 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:54.322793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363cac9-1904-465b-976a-ec47bc7b6b8e admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.332552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1053/2095] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:54.335954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a005b3f-8c45-4a78-b76f-dda7c8f48a24 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.341715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363cac9-1904-465b-976a-ec47bc7b6b8e admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.347367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b179db9-8a3f-4811-a147-7e22dc1d9876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.348047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b179db9-8a3f-4811-a147-7e22dc1d9876 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.348312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a005b3f-8c45-4a78-b76f-dda7c8f48a24 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.348413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b179db9-8a3f-4811-a147-7e22dc1d9876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.348596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b179db9-8a3f-4811-a147-7e22dc1d9876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.349365 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b179db9-8a3f-4811-a147-7e22dc1d9876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.351359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b179db9-8a3f-4811-a147-7e22dc1d9876 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.355311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6e21-0eff-4676-8027-8cbea266a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.356012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6e21-0eff-4676-8027-8cbea266a202 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.356297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6e21-0eff-4676-8027-8cbea266a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.356571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa6e21-0eff-4676-8027-8cbea266a202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.358734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa6e21-0eff-4676-8027-8cbea266a202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.360426 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa6e21-0eff-4676-8027-8cbea266a202 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.363098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1043/2096] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:54.369049 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b179db9-8a3f-4811-a147-7e22dc1d9876 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.374631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1054/2097] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:54.379104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6e21-0eff-4676-8027-8cbea266a202 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.383701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b179db9-8a3f-4811-a147-7e22dc1d9876 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.388918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56661465-ac64-4d62-8cb6-1e72eb92a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.389593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56661465-ac64-4d62-8cb6-1e72eb92a78e admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.389884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56661465-ac64-4d62-8cb6-1e72eb92a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.390165 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56661465-ac64-4d62-8cb6-1e72eb92a78e admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.390902 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56661465-ac64-4d62-8cb6-1e72eb92a78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.391130 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa6e21-0eff-4676-8027-8cbea266a202 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.392730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56661465-ac64-4d62-8cb6-1e72eb92a78e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.396698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7da8b-0547-41cb-92c0-c7e9c113b990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.397596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7da8b-0547-41cb-92c0-c7e9c113b990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.397880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7da8b-0547-41cb-92c0-c7e9c113b990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.398155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7da8b-0547-41cb-92c0-c7e9c113b990 admin admin] PATH_INFO: `/v3/projects/fe1175eee3304dcf93473e777ec79913/users/be15af3b9faa473990e974c4193f0360/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.407421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1044/2098] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:54.408820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56661465-ac64-4d62-8cb6-1e72eb92a78e admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.415765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7da8b-0547-41cb-92c0-c7e9c113b990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1175eee3304dcf93473e777ec79913, user_id=be15af3b9faa473990e974c4193f0360, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.416330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:54.418695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7da8b-0547-41cb-92c0-c7e9c113b990 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.420605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56661465-ac64-4d62-8cb6-1e72eb92a78e admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.427352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaee54-dfed-4250-b626-597b7446f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.428375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaee54-dfed-4250-b626-597b7446f509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.429029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaee54-dfed-4250-b626-597b7446f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.429029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaee54-dfed-4250-b626-597b7446f509 admin admin] PATH_INFO: `/v3/projects/f37d6ce5efb848478342a4e14ee418c2/users/aa0d45e043d54d899d54e36383eec141/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.433713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1055/2099] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:54 2022] PUT /identity/v3/projects/fe1175eee3304dcf93473e777ec79913/users/be15af3b9faa473990e974c4193f0360/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:54.444374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929b1e-cdf5-4ad1-8ccf-89499011f095 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.444774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929b1e-cdf5-4ad1-8ccf-89499011f095 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.445054 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929b1e-cdf5-4ad1-8ccf-89499011f095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.446751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaee54-dfed-4250-b626-597b7446f509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37d6ce5efb848478342a4e14ee418c2, user_id=aa0d45e043d54d899d54e36383eec141, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.449880 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaee54-dfed-4250-b626-597b7446f509 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.466938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1045/2100] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:54 2022] PUT /identity/v3/projects/f37d6ce5efb848478342a4e14ee418c2/users/aa0d45e043d54d899d54e36383eec141/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:54.473392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f3929b1e-cdf5-4ad1-8ccf-89499011f095 None None] MFA Rules not processed for user `be15af3b9faa473990e974c4193f0360`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:54.474595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f3929b1e-cdf5-4ad1-8ccf-89499011f095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:54.478549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450b38-787f-4708-8dc2-379e7f0944a7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.478847 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450b38-787f-4708-8dc2-379e7f0944a7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.479177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450b38-787f-4708-8dc2-379e7f0944a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.510150 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2d450b38-787f-4708-8dc2-379e7f0944a7 None None] MFA Rules not processed for user `aa0d45e043d54d899d54e36383eec141`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:54.511438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2d450b38-787f-4708-8dc2-379e7f0944a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:54.543770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1056/2101] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:54 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:54.576308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3929b1e-cdf5-4ad1-8ccf-89499011f095 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.577706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f3929b1e-cdf5-4ad1-8ccf-89499011f095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:54.579035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1046/2102] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:54.583126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:54.583380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d450b38-787f-4708-8dc2-379e7f0944a7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.640151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3929b1e-cdf5-4ad1-8ccf-89499011f095 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.644879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11148fb-3448-4c11-9396-0d2712ac1815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.645536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11148fb-3448-4c11-9396-0d2712ac1815 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.645808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11148fb-3448-4c11-9396-0d2712ac1815 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.646139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11148fb-3448-4c11-9396-0d2712ac1815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.647657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d450b38-787f-4708-8dc2-379e7f0944a7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.652258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9a665-6919-4db7-8b2f-e2805d8b08f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.652915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a665-6919-4db7-8b2f-e2805d8b08f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.653195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a665-6919-4db7-8b2f-e2805d8b08f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.653475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a665-6919-4db7-8b2f-e2805d8b08f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.654166 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9a665-6919-4db7-8b2f-e2805d8b08f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.654755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11148fb-3448-4c11-9396-0d2712ac1815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.656115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9a665-6919-4db7-8b2f-e2805d8b08f0 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.656213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11148fb-3448-4c11-9396-0d2712ac1815 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.666113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1057/2103] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:54 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:05:54.679840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11148fb-3448-4c11-9396-0d2712ac1815 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.690399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1047/2104] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:54 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:54.690616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11148fb-3448-4c11-9396-0d2712ac1815 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.694231 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9a665-6919-4db7-8b2f-e2805d8b08f0 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.750206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd61ed-f687-4481-8ea4-34e93095d79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.751707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd61ed-f687-4481-8ea4-34e93095d79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.751707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd61ed-f687-4481-8ea4-34e93095d79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.751886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd61ed-f687-4481-8ea4-34e93095d79a admin admin] PATH_INFO: `/v3/users/be15af3b9faa473990e974c4193f0360` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.753218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd61ed-f687-4481-8ea4-34e93095d79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be15af3b9faa473990e974c4193f0360)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.755256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd61ed-f687-4481-8ea4-34e93095d79a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.757332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:54.763198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9a665-6919-4db7-8b2f-e2805d8b08f0 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.769927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a5ad2-235c-4e16-8008-66f1135d5fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.770620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a5ad2-235c-4e16-8008-66f1135d5fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.770899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a5ad2-235c-4e16-8008-66f1135d5fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.771210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a5ad2-235c-4e16-8008-66f1135d5fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.771883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a5ad2-235c-4e16-8008-66f1135d5fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.773823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a5ad2-235c-4e16-8008-66f1135d5fb3 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.797771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1048/2105] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:54 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:54.808406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a5ad2-235c-4e16-8008-66f1135d5fb3 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.820794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-26bd61ed-f687-4481-8ea4-34e93095d79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be15af3b9faa473990e974c4193f0360'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:54.821343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a5ad2-235c-4e16-8008-66f1135d5fb3 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.826145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514eb6-3f64-47a8-973c-ce52ced224ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.826815 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514eb6-3f64-47a8-973c-ce52ced224ba admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.827134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514eb6-3f64-47a8-973c-ce52ced224ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.827413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514eb6-3f64-47a8-973c-ce52ced224ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.828143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76514eb6-3f64-47a8-973c-ce52ced224ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.830435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76514eb6-3f64-47a8-973c-ce52ced224ba admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.837635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-26bd61ed-f687-4481-8ea4-34e93095d79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be15af3b9faa473990e974c4193f0360'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:54.843534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1049/2106] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:54.847702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-26bd61ed-f687-4481-8ea4-34e93095d79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be15af3b9faa473990e974c4193f0360'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:54.847843 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514eb6-3f64-47a8-973c-ce52ced224ba admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.856017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-26bd61ed-f687-4481-8ea4-34e93095d79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be15af3b9faa473990e974c4193f0360'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:54.856738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-26bd61ed-f687-4481-8ea4-34e93095d79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be15af3b9faa473990e974c4193f0360'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:54.861588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514eb6-3f64-47a8-973c-ce52ced224ba admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.863333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1058/2107] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:05:54 2022] DELETE /identity/v3/users/be15af3b9faa473990e974c4193f0360 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:54.867596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6437a-18a5-4faa-bbce-634fdb2dc81f None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.867987 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6437a-18a5-4faa-bbce-634fdb2dc81f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.868328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6437a-18a5-4faa-bbce-634fdb2dc81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.888027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-62b6437a-18a5-4faa-bbce-634fdb2dc81f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:54.889926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-62b6437a-18a5-4faa-bbce-634fdb2dc81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:54.917010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:54.930401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dddbb2-3d8e-45d0-9375-473af7b86f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.931103 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dddbb2-3d8e-45d0-9375-473af7b86f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.931414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dddbb2-3d8e-45d0-9375-473af7b86f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.931690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dddbb2-3d8e-45d0-9375-473af7b86f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.932443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dddbb2-3d8e-45d0-9375-473af7b86f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.934082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dddbb2-3d8e-45d0-9375-473af7b86f8a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:54.951030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1050/2108] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:54.952479 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dddbb2-3d8e-45d0-9375-473af7b86f8a admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.954289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-05dddbb2-3d8e-45d0-9375-473af7b86f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:54.962977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1059/2109] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:54.967753 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dddbb2-3d8e-45d0-9375-473af7b86f8a admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:54.972770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aea479-a267-4463-a6eb-2e5ef700ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:54.973702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aea479-a267-4463-a6eb-2e5ef700ff3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:54.973808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6437a-18a5-4faa-bbce-634fdb2dc81f None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:54.974004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aea479-a267-4463-a6eb-2e5ef700ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:54.974277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aea479-a267-4463-a6eb-2e5ef700ff3c admin admin] PATH_INFO: `/v3/projects/e1fc35c760894f2eb868d36cab702033/users/2b4b5a1bccdf48aa9877c32d8d082e0f/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:54.975292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-62b6437a-18a5-4faa-bbce-634fdb2dc81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:54.991908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aea479-a267-4463-a6eb-2e5ef700ff3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1fc35c760894f2eb868d36cab702033, user_id=2b4b5a1bccdf48aa9877c32d8d082e0f, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:54.996225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aea479-a267-4463-a6eb-2e5ef700ff3c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:55.012697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1051/2110] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:54 2022] PUT /identity/v3/projects/e1fc35c760894f2eb868d36cab702033/users/2b4b5a1bccdf48aa9877c32d8d082e0f/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:05:55.024479 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d131d7-769e-4e03-9f77-75aae0d55e05 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.024809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d131d7-769e-4e03-9f77-75aae0d55e05 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.025126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d131d7-769e-4e03-9f77-75aae0d55e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.036102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6437a-18a5-4faa-bbce-634fdb2dc81f None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:55.056184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f2d131d7-769e-4e03-9f77-75aae0d55e05 None None] MFA Rules not processed for user `2b4b5a1bccdf48aa9877c32d8d082e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:55.057440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f2d131d7-769e-4e03-9f77-75aae0d55e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:55.091742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22fe8f-8af0-4cf2-8455-43317e87b5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:55.093019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22fe8f-8af0-4cf2-8455-43317e87b5fc service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.093627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22fe8f-8af0-4cf2-8455-43317e87b5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.093905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22fe8f-8af0-4cf2-8455-43317e87b5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.150650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1052/2111] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:55.155491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d131d7-769e-4e03-9f77-75aae0d55e05 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:55.167645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22fe8f-8af0-4cf2-8455-43317e87b5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:55.169200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22fe8f-8af0-4cf2-8455-43317e87b5fc service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:55.185196 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1060/2112] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:55.212654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:55.268065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d131d7-769e-4e03-9f77-75aae0d55e05 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:55.276523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb22646-0635-4127-903a-f5ec80e44c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:55.277206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb22646-0635-4127-903a-f5ec80e44c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.277922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb22646-0635-4127-903a-f5ec80e44c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.278210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb22646-0635-4127-903a-f5ec80e44c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.279290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb22646-0635-4127-903a-f5ec80e44c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:55.281496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb22646-0635-4127-903a-f5ec80e44c97 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:55.327461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1053/2113] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:55 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:05:55.327663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22fe8f-8af0-4cf2-8455-43317e87b5fc service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:55.336764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22fe8f-8af0-4cf2-8455-43317e87b5fc service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:55.374049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:55.416873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7309ff-4ad4-4278-931e-698849a2541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:55.417899 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7309ff-4ad4-4278-931e-698849a2541b admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.418133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7309ff-4ad4-4278-931e-698849a2541b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.418413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7309ff-4ad4-4278-931e-698849a2541b admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.419158 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7309ff-4ad4-4278-931e-698849a2541b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:55.421207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7309ff-4ad4-4278-931e-698849a2541b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:55.446627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1061/2114] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:55 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:55.450534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb22646-0635-4127-903a-f5ec80e44c97 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:55.461142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb22646-0635-4127-903a-f5ec80e44c97 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:55.467060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521baad-539a-4dc0-8b28-643a2c2d4a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:55.467733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521baad-539a-4dc0-8b28-643a2c2d4a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.468303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521baad-539a-4dc0-8b28-643a2c2d4a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.468410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521baad-539a-4dc0-8b28-643a2c2d4a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.469060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521baad-539a-4dc0-8b28-643a2c2d4a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:55.470855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521baad-539a-4dc0-8b28-643a2c2d4a85 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:55.490795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1054/2115] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:55.499043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7309ff-4ad4-4278-931e-698849a2541b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:55.516596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7309ff-4ad4-4278-931e-698849a2541b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:55.522208 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a82e3f-68d8-428f-8a2a-019d0cef6d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:55.523162 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a82e3f-68d8-428f-8a2a-019d0cef6d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.523446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a82e3f-68d8-428f-8a2a-019d0cef6d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.524012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a82e3f-68d8-428f-8a2a-019d0cef6d57 admin admin] PATH_INFO: `/v3/projects/2a21632bdb3c4c61938ad9f7db5441b2/users/5e9ffa4e99b04639951a86843d24520b/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.542001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a82e3f-68d8-428f-8a2a-019d0cef6d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a21632bdb3c4c61938ad9f7db5441b2, user_id=5e9ffa4e99b04639951a86843d24520b, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:55.545055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a82e3f-68d8-428f-8a2a-019d0cef6d57 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:55.560829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1062/2116] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:55 2022] PUT /identity/v3/projects/2a21632bdb3c4c61938ad9f7db5441b2/users/5e9ffa4e99b04639951a86843d24520b/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:55.564884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521baad-539a-4dc0-8b28-643a2c2d4a85 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:55.574511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a82e3f-68d8-428f-8a2a-019d0cef6d57 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:55.577236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521baad-539a-4dc0-8b28-643a2c2d4a85 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:55.579442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e5a82e3f-68d8-428f-8a2a-019d0cef6d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:55.658748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3d5e8-796c-4184-a307-413c7199ba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:55.659580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3d5e8-796c-4184-a307-413c7199ba5c admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.659951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3d5e8-796c-4184-a307-413c7199ba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.660294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3d5e8-796c-4184-a307-413c7199ba5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.661093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3d5e8-796c-4184-a307-413c7199ba5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:55.662776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3d5e8-796c-4184-a307-413c7199ba5c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:55.666732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a82e3f-68d8-428f-8a2a-019d0cef6d57 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:55.672847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:55.673660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.673935 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.674205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] PATH_INFO: `/v3/projects/fe1175eee3304dcf93473e777ec79913` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.675278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1055/2117] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:05:55.675772 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1175eee3304dcf93473e777ec79913)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:55.677765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:55.679417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3d5e8-796c-4184-a307-413c7199ba5c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:55.689266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3d5e8-796c-4184-a307-413c7199ba5c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:55.694067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6231472-111c-41a8-bd2c-f05a6c7bb303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:55.694907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6231472-111c-41a8-bd2c-f05a6c7bb303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.695218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6231472-111c-41a8-bd2c-f05a6c7bb303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.695494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6231472-111c-41a8-bd2c-f05a6c7bb303 admin admin] PATH_INFO: `/v3/projects/2a21632bdb3c4c61938ad9f7db5441b2/users/5e9ffa4e99b04639951a86843d24520b/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.697892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6231472-111c-41a8-bd2c-f05a6c7bb303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a21632bdb3c4c61938ad9f7db5441b2, user_id=5e9ffa4e99b04639951a86843d24520b, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:55.700843 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6231472-111c-41a8-bd2c-f05a6c7bb303 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:55.711835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1056/2118] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:55 2022] PUT /identity/v3/projects/2a21632bdb3c4c61938ad9f7db5441b2/users/5e9ffa4e99b04639951a86843d24520b/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:55.722656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f083f3a-b934-4db7-9016-49936ca6bed7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.722943 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f083f3a-b934-4db7-9016-49936ca6bed7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.723249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f083f3a-b934-4db7-9016-49936ca6bed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.728381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1175eee3304dcf93473e777ec79913', 'request_id': 'req-c4d82f3c-6a67-4370-bb23-448969fdd15e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:55.735409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1175eee3304dcf93473e777ec79913', 'request_id': 'req-c4d82f3c-6a67-4370-bb23-448969fdd15e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:55.743722 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1175eee3304dcf93473e777ec79913', 'request_id': 'req-c4d82f3c-6a67-4370-bb23-448969fdd15e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:55.752078 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9f083f3a-b934-4db7-9016-49936ca6bed7 None None] MFA Rules not processed for user `5e9ffa4e99b04639951a86843d24520b`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:55.753287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9f083f3a-b934-4db7-9016-49936ca6bed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:55.765062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] The token cache is being invalidate because project fe1175eee3304dcf93473e777ec79913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:05:55.765332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:55.765991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c4d82f3c-6a67-4370-bb23-448969fdd15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:05:55.767643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1063/2119] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:05:55 2022] DELETE /identity/v3/projects/fe1175eee3304dcf93473e777ec79913 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:55.773705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003258a-f9c0-4561-8b2c-ff9c60d58032 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.774061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003258a-f9c0-4561-8b2c-ff9c60d58032 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.774403 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003258a-f9c0-4561-8b2c-ff9c60d58032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.797520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8003258a-f9c0-4561-8b2c-ff9c60d58032 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:55.798725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8003258a-f9c0-4561-8b2c-ff9c60d58032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:55.822090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:55.839375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1057/2120] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:55.852378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f083f3a-b934-4db7-9016-49936ca6bed7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:55.853998 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9f083f3a-b934-4db7-9016-49936ca6bed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:55.866133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1064/2121] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:55.873754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be5a7-e1bf-4fc4-8602-a8aace9a1825 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.874015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:55.874100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be5a7-e1bf-4fc4-8602-a8aace9a1825 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.874301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be5a7-e1bf-4fc4-8602-a8aace9a1825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.895594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-046be5a7-e1bf-4fc4-8602-a8aace9a1825 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:55.897072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-046be5a7-e1bf-4fc4-8602-a8aace9a1825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:55.907473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1065/2122] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:55.911828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be5a7-e1bf-4fc4-8602-a8aace9a1825 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:55.921747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f083f3a-b934-4db7-9016-49936ca6bed7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:55.925080 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be5a7-e1bf-4fc4-8602-a8aace9a1825 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:55.925661 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60741c6-d06c-4a6c-9b84-b817af3d03a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:55.926319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60741c6-d06c-4a6c-9b84-b817af3d03a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.926617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60741c6-d06c-4a6c-9b84-b817af3d03a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.926878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60741c6-d06c-4a6c-9b84-b817af3d03a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.928765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e60741c6-d06c-4a6c-9b84-b817af3d03a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:55.933297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825a082-0343-4409-90ee-14e683bc9788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:55.933980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a082-0343-4409-90ee-14e683bc9788 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.934608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a082-0343-4409-90ee-14e683bc9788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.934906 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a082-0343-4409-90ee-14e683bc9788 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.935741 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825a082-0343-4409-90ee-14e683bc9788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:05:55.936141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825a082-0343-4409-90ee-14e683bc9788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:55.937735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825a082-0343-4409-90ee-14e683bc9788 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:55.952220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1066/2123] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 03:05:55.957202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825a082-0343-4409-90ee-14e683bc9788 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:55.969728 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825a082-0343-4409-90ee-14e683bc9788 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:55.975696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde63c6-e887-47dd-8fdd-c02ba8b1be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:55.976536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde63c6-e887-47dd-8fdd-c02ba8b1be01 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:55.976823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde63c6-e887-47dd-8fdd-c02ba8b1be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:55.977096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde63c6-e887-47dd-8fdd-c02ba8b1be01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:55.977829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde63c6-e887-47dd-8fdd-c02ba8b1be01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:55.980593 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde63c6-e887-47dd-8fdd-c02ba8b1be01 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:56.003809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60741c6-d06c-4a6c-9b84-b817af3d03a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:56.005285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60741c6-d06c-4a6c-9b84-b817af3d03a5 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:56.016312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1067/2124] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:05:55 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:56.016816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1058/2125] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:56.020412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60741c6-d06c-4a6c-9b84-b817af3d03a5 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:56.032784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60741c6-d06c-4a6c-9b84-b817af3d03a5 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:56.098695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26e8d-bfc5-41c0-8241-56707de687f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:56.099405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26e8d-bfc5-41c0-8241-56707de687f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:56.099688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26e8d-bfc5-41c0-8241-56707de687f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:56.099965 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26e8d-bfc5-41c0-8241-56707de687f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:56.100670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef26e8d-bfc5-41c0-8241-56707de687f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:56.102653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef26e8d-bfc5-41c0-8241-56707de687f7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:56.139020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1059/2126] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:05:56 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:05:56.142437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde63c6-e887-47dd-8fdd-c02ba8b1be01 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:56.154679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde63c6-e887-47dd-8fdd-c02ba8b1be01 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:56.160133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59f229-7803-4704-b659-abb49f63e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:56.160793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59f229-7803-4704-b659-abb49f63e927 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:56.161073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59f229-7803-4704-b659-abb49f63e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:56.161346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59f229-7803-4704-b659-abb49f63e927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:56.162135 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59f229-7803-4704-b659-abb49f63e927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:56.164182 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59f229-7803-4704-b659-abb49f63e927 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:56.176323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1068/2127] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:56.180820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26e8d-bfc5-41c0-8241-56707de687f7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:56.191727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26e8d-bfc5-41c0-8241-56707de687f7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:56.198832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d10a47-a15c-471a-8794-ea88b891e042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:56.199582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d10a47-a15c-471a-8794-ea88b891e042 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:56.200163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d10a47-a15c-471a-8794-ea88b891e042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:56.200283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d10a47-a15c-471a-8794-ea88b891e042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:56.200981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d10a47-a15c-471a-8794-ea88b891e042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:56.202563 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d10a47-a15c-471a-8794-ea88b891e042 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:56.216828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1060/2128] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:05:56.218431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59f229-7803-4704-b659-abb49f63e927 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:56.229991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59f229-7803-4704-b659-abb49f63e927 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:56.235077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cb65e-3c12-4b0f-9da9-77707647a321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:56.236282 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb65e-3c12-4b0f-9da9-77707647a321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:56.236597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb65e-3c12-4b0f-9da9-77707647a321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:56.236874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb65e-3c12-4b0f-9da9-77707647a321 admin admin] PATH_INFO: `/v3/projects/1f7803be5c2a4da0966ad063d4358f2c/users/254142727a204898ae81fb80aad4d438/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:56.253908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cb65e-3c12-4b0f-9da9-77707647a321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7803be5c2a4da0966ad063d4358f2c, user_id=254142727a204898ae81fb80aad4d438, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:56.256904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cb65e-3c12-4b0f-9da9-77707647a321 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:56.271808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1069/2129] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:05:56 2022] PUT /identity/v3/projects/1f7803be5c2a4da0966ad063d4358f2c/users/254142727a204898ae81fb80aad4d438/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:05:56.278609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2938-9d8e-45b4-8d1c-c2eaf234df83 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:56.279032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2938-9d8e-45b4-8d1c-c2eaf234df83 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:56.279352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2938-9d8e-45b4-8d1c-c2eaf234df83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:56.298771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-135c2938-9d8e-45b4-8d1c-c2eaf234df83 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:56.299831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-135c2938-9d8e-45b4-8d1c-c2eaf234df83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:56.373196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:56.395171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1061/2130] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:05:56.407281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cb65e-3c12-4b0f-9da9-77707647a321 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:56.411207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2a1cb65e-3c12-4b0f-9da9-77707647a321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:56.489955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cb65e-3c12-4b0f-9da9-77707647a321 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:56.494090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe0335-86a7-4d73-b944-adf22d47989c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:56.494767 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe0335-86a7-4d73-b944-adf22d47989c service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:56.495080 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe0335-86a7-4d73-b944-adf22d47989c service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:56.495355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe0335-86a7-4d73-b944-adf22d47989c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:56.504829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe0335-86a7-4d73-b944-adf22d47989c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:56.506289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe0335-86a7-4d73-b944-adf22d47989c service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:56.515837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1070/2131] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:57.247757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6728d9-a23c-4291-8be5-b7f931ec0d01 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:57.248251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6728d9-a23c-4291-8be5-b7f931ec0d01 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:57.248251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6728d9-a23c-4291-8be5-b7f931ec0d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:57.278000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5f6728d9-a23c-4291-8be5-b7f931ec0d01 None None] MFA Rules not processed for user `254142727a204898ae81fb80aad4d438`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:57.279645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5f6728d9-a23c-4291-8be5-b7f931ec0d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:57.362026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1062/2132] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:05:57.374816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe0335-86a7-4d73-b944-adf22d47989c service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:57.443299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe0335-86a7-4d73-b944-adf22d47989c service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:57.447610 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1c289-2b04-4869-8fbd-6d0df8579579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:57.448412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1c289-2b04-4869-8fbd-6d0df8579579 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:57.448699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1c289-2b04-4869-8fbd-6d0df8579579 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:57.449021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1c289-2b04-4869-8fbd-6d0df8579579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:57.456352 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:05:57.459380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1c289-2b04-4869-8fbd-6d0df8579579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:57.461032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1c289-2b04-4869-8fbd-6d0df8579579 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:57.483061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1071/2133] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:57.651870 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6728d9-a23c-4291-8be5-b7f931ec0d01 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:57.653306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5f6728d9-a23c-4291-8be5-b7f931ec0d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:57.667069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6728d9-a23c-4291-8be5-b7f931ec0d01 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:57.671240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859b0fa-a3e8-4520-a803-3d7a6d0032a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:57.671903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859b0fa-a3e8-4520-a803-3d7a6d0032a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:57.672178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859b0fa-a3e8-4520-a803-3d7a6d0032a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:57.672459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859b0fa-a3e8-4520-a803-3d7a6d0032a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:57.674575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0859b0fa-a3e8-4520-a803-3d7a6d0032a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:57.743186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859b0fa-a3e8-4520-a803-3d7a6d0032a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:57.744971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859b0fa-a3e8-4520-a803-3d7a6d0032a7 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:57.756705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1063/2134] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:58.460592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1c289-2b04-4869-8fbd-6d0df8579579 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:05:58.469383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1c289-2b04-4869-8fbd-6d0df8579579 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:05:58.473148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6750799-786b-48f2-b40e-54fc51c33348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:05:58.473818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750799-786b-48f2-b40e-54fc51c33348 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:58.474100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750799-786b-48f2-b40e-54fc51c33348 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:58.474375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6750799-786b-48f2-b40e-54fc51c33348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:58.542206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6750799-786b-48f2-b40e-54fc51c33348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:05:58.543834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6750799-786b-48f2-b40e-54fc51c33348 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:05:58.554948 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1072/2135] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:05:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:05:58.885636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aa5a1-567f-422f-9416-5f7eda189cd8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:05:58.886351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aa5a1-567f-422f-9416-5f7eda189cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:05:58.886351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aa5a1-567f-422f-9416-5f7eda189cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:05:58.903270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-871aa5a1-567f-422f-9416-5f7eda189cd8 None None] MFA Rules not processed for user `254142727a204898ae81fb80aad4d438`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:05:58.904486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-871aa5a1-567f-422f-9416-5f7eda189cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:05:58.911482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1064/2136] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:05:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:01.324802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89feb4f-679a-4c03-ab43-23a6a39c06b9 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:01.325418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89feb4f-679a-4c03-ab43-23a6a39c06b9 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:01.325510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89feb4f-679a-4c03-ab43-23a6a39c06b9 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:01.327340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1073/2137] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 03:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:06:01.356514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32be7e8-3745-4706-a01f-079186d01b04 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:01.356996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32be7e8-3745-4706-a01f-079186d01b04 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:01.357072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32be7e8-3745-4706-a01f-079186d01b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:01.386181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c32be7e8-3745-4706-a01f-079186d01b04 None None] MFA Rules not processed for user `5ae5f8f789424969bd575f7360847261`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:01.387833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c32be7e8-3745-4706-a01f-079186d01b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:01.435975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89feb4f-679a-4c03-ab43-23a6a39c06b9 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:01.438328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a89feb4f-679a-4c03-ab43-23a6a39c06b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:01.473027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89feb4f-679a-4c03-ab43-23a6a39c06b9 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:01.489443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be80f5b-72e2-4e6a-91db-30130e7d77fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:01.494626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80f5b-72e2-4e6a-91db-30130e7d77fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:01.494626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80f5b-72e2-4e6a-91db-30130e7d77fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:01.494626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80f5b-72e2-4e6a-91db-30130e7d77fe admin admin] PATH_INFO: `/v3/users/9d47131516614ef9adae65e8db11e650` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:01.499273 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be80f5b-72e2-4e6a-91db-30130e7d77fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d47131516614ef9adae65e8db11e650)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:01.501513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be80f5b-72e2-4e6a-91db-30130e7d77fe admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:01.520262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1065/2138] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 03:06:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:06:01.538918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32be7e8-3745-4706-a01f-079186d01b04 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:01.540752 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c32be7e8-3745-4706-a01f-079186d01b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:01.555672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32be7e8-3745-4706-a01f-079186d01b04 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:01.561809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845d5d8-4c93-447d-a854-71739533b17f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:01.562707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845d5d8-4c93-447d-a854-71739533b17f service placement] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:01.563019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845d5d8-4c93-447d-a854-71739533b17f service placement] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:01.564033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845d5d8-4c93-447d-a854-71739533b17f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:01.568456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5be80f5b-72e2-4e6a-91db-30130e7d77fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d47131516614ef9adae65e8db11e650'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:01.571932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:01.576110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845d5d8-4c93-447d-a854-71739533b17f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:01.578116 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845d5d8-4c93-447d-a854-71739533b17f service placement] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:01.581009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5be80f5b-72e2-4e6a-91db-30130e7d77fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d47131516614ef9adae65e8db11e650'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:01.589065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5be80f5b-72e2-4e6a-91db-30130e7d77fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d47131516614ef9adae65e8db11e650'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:01.589432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1066/2139] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:01.596036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5be80f5b-72e2-4e6a-91db-30130e7d77fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d47131516614ef9adae65e8db11e650'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:01.596682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5be80f5b-72e2-4e6a-91db-30130e7d77fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d47131516614ef9adae65e8db11e650'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:01.602958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1074/2140] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:06:01 2022] DELETE /identity/v3/users/9d47131516614ef9adae65e8db11e650 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:06:01.785819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845d5d8-4c93-447d-a854-71739533b17f service placement] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:01.803251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845d5d8-4c93-447d-a854-71739533b17f service placement] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:01.864387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:01.865261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:01.865547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:01.865831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] PATH_INFO: `/v3/projects/474e42e34ddb40eb8666eab99bd95a4b` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:01.867053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=474e42e34ddb40eb8666eab99bd95a4b)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:01.869017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:01.917788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474e42e34ddb40eb8666eab99bd95a4b', 'request_id': 'req-9efdffae-d118-43cd-8dcf-ab72daa72dff'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:01.923863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474e42e34ddb40eb8666eab99bd95a4b', 'request_id': 'req-9efdffae-d118-43cd-8dcf-ab72daa72dff'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:01.932266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474e42e34ddb40eb8666eab99bd95a4b', 'request_id': 'req-9efdffae-d118-43cd-8dcf-ab72daa72dff'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:01.943046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] The token cache is being invalidate because project 474e42e34ddb40eb8666eab99bd95a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:06:01.943343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:01.943966 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9efdffae-d118-43cd-8dcf-ab72daa72dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:01.945535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1067/2141] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:06:01 2022] DELETE /identity/v3/projects/474e42e34ddb40eb8666eab99bd95a4b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:06:01.950851 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594e4c-def6-41a6-861a-f1bdd7043eeb None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:01.951305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594e4c-def6-41a6-861a-f1bdd7043eeb None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:01.951584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594e4c-def6-41a6-861a-f1bdd7043eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:01.969493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-3c594e4c-def6-41a6-861a-f1bdd7043eeb None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:01.970837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3c594e4c-def6-41a6-861a-f1bdd7043eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:02.031475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1075/2142] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:06:02.039829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcad3ca-b7e7-4baa-95a8-638abd02a231 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:02.040190 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcad3ca-b7e7-4baa-95a8-638abd02a231 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:02.040532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcad3ca-b7e7-4baa-95a8-638abd02a231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:02.060698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-cdcad3ca-b7e7-4baa-95a8-638abd02a231 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:02.061924 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cdcad3ca-b7e7-4baa-95a8-638abd02a231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:02.071573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1068/2143] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:02.076463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c594e4c-def6-41a6-861a-f1bdd7043eeb None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:02.081762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:02.087425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c594e4c-def6-41a6-861a-f1bdd7043eeb None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:02.094569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebc844-35a5-4c24-910f-001035b13e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:02.095275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebc844-35a5-4c24-910f-001035b13e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:02.095745 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebc844-35a5-4c24-910f-001035b13e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:02.096508 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebc844-35a5-4c24-910f-001035b13e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:02.097621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebc844-35a5-4c24-910f-001035b13e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:06:02.098318 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebc844-35a5-4c24-910f-001035b13e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:02.101471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebc844-35a5-4c24-910f-001035b13e7c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:02.115149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1076/2144] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:06:02.119716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcad3ca-b7e7-4baa-95a8-638abd02a231 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:02.130823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcad3ca-b7e7-4baa-95a8-638abd02a231 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:02.138268 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed3b76-f257-4746-807e-bc5a21277cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:02.139306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed3b76-f257-4746-807e-bc5a21277cda admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:02.140097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed3b76-f257-4746-807e-bc5a21277cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:02.141307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed3b76-f257-4746-807e-bc5a21277cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:02.142655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed3b76-f257-4746-807e-bc5a21277cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:02.146287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed3b76-f257-4746-807e-bc5a21277cda admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:02.180786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1069/2145] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:06:02 2022] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:02.185032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebc844-35a5-4c24-910f-001035b13e7c admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:02.196503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebc844-35a5-4c24-910f-001035b13e7c admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:02.262593 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a1f6-01e8-4a72-8991-3c780d6ddbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:02.263314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a1f6-01e8-4a72-8991-3c780d6ddbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:02.263603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a1f6-01e8-4a72-8991-3c780d6ddbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:02.263882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3a1f6-01e8-4a72-8991-3c780d6ddbf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:02.264594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3a1f6-01e8-4a72-8991-3c780d6ddbf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:02.266705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3a1f6-01e8-4a72-8991-3c780d6ddbf6 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:02.298318 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1077/2146] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:06:02 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:02.302132 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed3b76-f257-4746-807e-bc5a21277cda admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:02.330184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed3b76-f257-4746-807e-bc5a21277cda admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:02.330184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae437b1-c4d4-4576-ba35-adebea433ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:02.331212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae437b1-c4d4-4576-ba35-adebea433ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:02.331633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae437b1-c4d4-4576-ba35-adebea433ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:02.332028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae437b1-c4d4-4576-ba35-adebea433ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:02.333228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae437b1-c4d4-4576-ba35-adebea433ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:02.335012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae437b1-c4d4-4576-ba35-adebea433ffa admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:02.357025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1070/2147] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:02.360723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a1f6-01e8-4a72-8991-3c780d6ddbf6 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:02.372324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3a1f6-01e8-4a72-8991-3c780d6ddbf6 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:02.392656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3aba0-a023-4c86-9ce9-e40030d72c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:02.393884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3aba0-a023-4c86-9ce9-e40030d72c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:02.394801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3aba0-a023-4c86-9ce9-e40030d72c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:02.395281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3aba0-a023-4c86-9ce9-e40030d72c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:02.396714 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3aba0-a023-4c86-9ce9-e40030d72c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:02.398734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3aba0-a023-4c86-9ce9-e40030d72c74 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:02.415034 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1078/2148] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:02.418810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae437b1-c4d4-4576-ba35-adebea433ffa admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:02.430917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae437b1-c4d4-4576-ba35-adebea433ffa admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:02.436029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc18a8-f0c7-4421-a73a-93d208ba6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:02.436929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc18a8-f0c7-4421-a73a-93d208ba6330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:02.437210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc18a8-f0c7-4421-a73a-93d208ba6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:02.437488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc18a8-f0c7-4421-a73a-93d208ba6330 admin admin] PATH_INFO: `/v3/projects/da0f89811c5a4ec3a7701ad0bf1de7c1/users/9fd251e1a49a4a5e817eec4df8794656/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:02.459984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc18a8-f0c7-4421-a73a-93d208ba6330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0f89811c5a4ec3a7701ad0bf1de7c1, user_id=9fd251e1a49a4a5e817eec4df8794656, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:02.462766 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc18a8-f0c7-4421-a73a-93d208ba6330 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:02.489249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1071/2149] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:06:02 2022] PUT /identity/v3/projects/da0f89811c5a4ec3a7701ad0bf1de7c1/users/9fd251e1a49a4a5e817eec4df8794656/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:02.499266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a149f-2abc-4006-8f86-b43318d8c3f0 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:02.499266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a149f-2abc-4006-8f86-b43318d8c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:02.499266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a149f-2abc-4006-8f86-b43318d8c3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:02.542442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-898a149f-2abc-4006-8f86-b43318d8c3f0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:02.544458 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-898a149f-2abc-4006-8f86-b43318d8c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:02.657988 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1079/2150] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:02.667971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc18a8-f0c7-4421-a73a-93d208ba6330 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:02.669931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cdfc18a8-f0c7-4421-a73a-93d208ba6330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:02.725317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:02.778799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc18a8-f0c7-4421-a73a-93d208ba6330 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:02.785481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae001a6-1c3d-4f5c-93f7-52273a06eb76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:02.787437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae001a6-1c3d-4f5c-93f7-52273a06eb76 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:02.787899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae001a6-1c3d-4f5c-93f7-52273a06eb76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:02.788297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae001a6-1c3d-4f5c-93f7-52273a06eb76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:02.802540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae001a6-1c3d-4f5c-93f7-52273a06eb76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:02.804203 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae001a6-1c3d-4f5c-93f7-52273a06eb76 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:02.823584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1072/2151] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:04.018684 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a149f-2abc-4006-8f86-b43318d8c3f0 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:04.021121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-898a149f-2abc-4006-8f86-b43318d8c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:04.034946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a149f-2abc-4006-8f86-b43318d8c3f0 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:04.041944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:04.043970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:04.044329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:04.045294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] PATH_INFO: `/v3/users/aa0d45e043d54d899d54e36383eec141` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:04.046669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0d45e043d54d899d54e36383eec141)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:04.064331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:04.145079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0d45e043d54d899d54e36383eec141'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:04.162634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:04.164946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0d45e043d54d899d54e36383eec141'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:04.181639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0d45e043d54d899d54e36383eec141'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:04.196021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0d45e043d54d899d54e36383eec141'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:04.197758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0d45e043d54d899d54e36383eec141'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:04.209527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1080/2152] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:06:04 2022] DELETE /identity/v3/users/aa0d45e043d54d899d54e36383eec141 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:04.213906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53822-89e8-458a-8310-ffca772aa138 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:04.214449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53822-89e8-458a-8310-ffca772aa138 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:04.215102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53822-89e8-458a-8310-ffca772aa138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:04.232952 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-21a53822-89e8-458a-8310-ffca772aa138 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:04.234273 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-21a53822-89e8-458a-8310-ffca772aa138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:04.315751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1073/2153] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:06:04.328733 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:04.330749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:04.397633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dab4bf-aa9c-46a8-8da5-c60d29b92ca5 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:04.402156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49f1b3-4289-426e-b62b-d84839b0f827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:04.403033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49f1b3-4289-426e-b62b-d84839b0f827 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:04.403220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49f1b3-4289-426e-b62b-d84839b0f827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:04.403463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49f1b3-4289-426e-b62b-d84839b0f827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:04.415581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49f1b3-4289-426e-b62b-d84839b0f827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:04.417119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49f1b3-4289-426e-b62b-d84839b0f827 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:04.428951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1081/2154] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:04.862579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53822-89e8-458a-8310-ffca772aa138 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:04.864791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-21a53822-89e8-458a-8310-ffca772aa138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:04.897681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53822-89e8-458a-8310-ffca772aa138 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:04.922434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:04.923444 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:04.923723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:04.923999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] PATH_INFO: `/v3/projects/f37d6ce5efb848478342a4e14ee418c2` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:04.925411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37d6ce5efb848478342a4e14ee418c2)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:04.936192 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:05.041264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37d6ce5efb848478342a4e14ee418c2', 'request_id': 'req-c8bea43d-4366-4877-b027-cfea9603511a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.051465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37d6ce5efb848478342a4e14ee418c2', 'request_id': 'req-c8bea43d-4366-4877-b027-cfea9603511a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.063349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37d6ce5efb848478342a4e14ee418c2', 'request_id': 'req-c8bea43d-4366-4877-b027-cfea9603511a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.080534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] The token cache is being invalidate because project f37d6ce5efb848478342a4e14ee418c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:06:05.080817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.081565 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.087551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1074/2155] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:06:04 2022] DELETE /identity/v3/projects/f37d6ce5efb848478342a4e14ee418c2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:05.091392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49f1b3-4289-426e-b62b-d84839b0f827 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:05.101724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49f1b3-4289-426e-b62b-d84839b0f827 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:05.165432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ef88a-76cd-4e92-93ee-5291cc8af72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:05.166269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ef88a-76cd-4e92-93ee-5291cc8af72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:05.166590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ef88a-76cd-4e92-93ee-5291cc8af72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:05.166868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ef88a-76cd-4e92-93ee-5291cc8af72f admin admin] PATH_INFO: `/v3/users/2b4b5a1bccdf48aa9877c32d8d082e0f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:05.168339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ef88a-76cd-4e92-93ee-5291cc8af72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4b5a1bccdf48aa9877c32d8d082e0f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:05.170520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ef88a-76cd-4e92-93ee-5291cc8af72f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:05.240381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a52ef88a-76cd-4e92-93ee-5291cc8af72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4b5a1bccdf48aa9877c32d8d082e0f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.255405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a52ef88a-76cd-4e92-93ee-5291cc8af72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4b5a1bccdf48aa9877c32d8d082e0f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.273891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a52ef88a-76cd-4e92-93ee-5291cc8af72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4b5a1bccdf48aa9877c32d8d082e0f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.275715 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:05.278863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:05.290693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a52ef88a-76cd-4e92-93ee-5291cc8af72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4b5a1bccdf48aa9877c32d8d082e0f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.291413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-a52ef88a-76cd-4e92-93ee-5291cc8af72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4b5a1bccdf48aa9877c32d8d082e0f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.302090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1082/2156] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:06:05 2022] DELETE /identity/v3/users/2b4b5a1bccdf48aa9877c32d8d082e0f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:05.308756 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bea43d-4366-4877-b027-cfea9603511a admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:05.379155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:05.413225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:05.414794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:05.415427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:05.415884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] PATH_INFO: `/v3/users/b7fdc1a9ba7d4cbf9a0f3cd1a938b814` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:05.418327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7fdc1a9ba7d4cbf9a0f3cd1a938b814)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:05.421583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:05.513912 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7fdc1a9ba7d4cbf9a0f3cd1a938b814'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.528043 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7fdc1a9ba7d4cbf9a0f3cd1a938b814'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.528796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7fdc1a9ba7d4cbf9a0f3cd1a938b814'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.536067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7fdc1a9ba7d4cbf9a0f3cd1a938b814'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.536797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7fdc1a9ba7d4cbf9a0f3cd1a938b814'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:05.570596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1075/2157] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:06:05 2022] DELETE /identity/v3/users/b7fdc1a9ba7d4cbf9a0f3cd1a938b814 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:05.575184 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d213bc-6221-4e4a-8530-6af2a4be5cb2 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:05.575474 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d213bc-6221-4e4a-8530-6af2a4be5cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:05.575752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d213bc-6221-4e4a-8530-6af2a4be5cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:05.582245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:05.604564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f6d213bc-6221-4e4a-8530-6af2a4be5cb2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:05.606404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f6d213bc-6221-4e4a-8530-6af2a4be5cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:05.707534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:05.709351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:05.756889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1083/2158] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:05.770320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d213bc-6221-4e4a-8530-6af2a4be5cb2 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:05.771901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f6d213bc-6221-4e4a-8530-6af2a4be5cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:05.853464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b4ea8-425a-48c1-81ec-6543d1e0570a admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:05.871835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:05.873435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:05.873720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:05.873997 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] PATH_INFO: `/v3/projects/e1fc35c760894f2eb868d36cab702033` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:05.877731 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1fc35c760894f2eb868d36cab702033)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:05.887532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:05.921377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d213bc-6221-4e4a-8530-6af2a4be5cb2 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:05.936418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3704d1f-0467-47cb-8620-9215f4bd51c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:05.937104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3704d1f-0467-47cb-8620-9215f4bd51c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:05.938795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3704d1f-0467-47cb-8620-9215f4bd51c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:05.939264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3704d1f-0467-47cb-8620-9215f4bd51c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:05.977591 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3704d1f-0467-47cb-8620-9215f4bd51c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:05.978711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3704d1f-0467-47cb-8620-9215f4bd51c9 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:05.999053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1fc35c760894f2eb868d36cab702033', 'request_id': 'req-05f9e722-c91b-41ab-82cb-21941ea6085c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:06.003676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1084/2159] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:06.011427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1fc35c760894f2eb868d36cab702033', 'request_id': 'req-05f9e722-c91b-41ab-82cb-21941ea6085c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:06.023076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1fc35c760894f2eb868d36cab702033', 'request_id': 'req-05f9e722-c91b-41ab-82cb-21941ea6085c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:06.034029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:06.042256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] The token cache is being invalidate because project e1fc35c760894f2eb868d36cab702033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:06:06.042666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:06.043450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:06.047027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1076/2160] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:06:05 2022] DELETE /identity/v3/projects/e1fc35c760894f2eb868d36cab702033 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:06.050748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3704d1f-0467-47cb-8620-9215f4bd51c9 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:06.064723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3704d1f-0467-47cb-8620-9215f4bd51c9 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:06.149520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:06.151439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:06.151986 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:06.152618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] PATH_INFO: `/v3/users/5e9ffa4e99b04639951a86843d24520b` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:06.154557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9ffa4e99b04639951a86843d24520b)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:06.158373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:06.242563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9ffa4e99b04639951a86843d24520b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:06.244986 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:06.283835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9ffa4e99b04639951a86843d24520b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:06.302478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9ffa4e99b04639951a86843d24520b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:06.312038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9ffa4e99b04639951a86843d24520b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:06.314700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9ffa4e99b04639951a86843d24520b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:06.334491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1085/2161] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:06:06 2022] DELETE /identity/v3/users/5e9ffa4e99b04639951a86843d24520b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:06.919872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:06.923187 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:06.940614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9e722-c91b-41ab-82cb-21941ea6085c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:07.044486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:07.045979 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:07.061589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:07.062570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.062887 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.063232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] PATH_INFO: `/v3/projects/dee952840ffa4cc48eff68c54afe6527` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.064693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee952840ffa4cc48eff68c54afe6527)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:07.067089 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:07.146688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61325eb7-0544-4283-9719-c70c6d36af94 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:07.148225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee952840ffa4cc48eff68c54afe6527', 'request_id': 'req-e24e4e9b-97be-4224-81e3-1f43f60dcc61'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:07.162084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee952840ffa4cc48eff68c54afe6527', 'request_id': 'req-e24e4e9b-97be-4224-81e3-1f43f60dcc61'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:07.202400 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee952840ffa4cc48eff68c54afe6527', 'request_id': 'req-e24e4e9b-97be-4224-81e3-1f43f60dcc61'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:07.218456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:07.219732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.220094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.220488 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] PATH_INFO: `/v3/projects/2a21632bdb3c4c61938ad9f7db5441b2` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.222133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a21632bdb3c4c61938ad9f7db5441b2)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:07.224681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:07.236083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] The token cache is being invalidate because project dee952840ffa4cc48eff68c54afe6527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:06:07.236371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:07.237321 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-e24e4e9b-97be-4224-81e3-1f43f60dcc61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:07.239711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1077/2162] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:06:06 2022] DELETE /identity/v3/projects/dee952840ffa4cc48eff68c54afe6527 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:07.245691 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcee60-5b49-4ebf-b1da-cdeef17a7b5f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.246053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcee60-5b49-4ebf-b1da-cdeef17a7b5f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.246970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcee60-5b49-4ebf-b1da-cdeef17a7b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.275165 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3ffcee60-5b49-4ebf-b1da-cdeef17a7b5f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:07.276823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3ffcee60-5b49-4ebf-b1da-cdeef17a7b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:07.308800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a21632bdb3c4c61938ad9f7db5441b2', 'request_id': 'req-c16e9a3f-b16a-459b-a632-0a675874e4ff'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:07.321188 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a21632bdb3c4c61938ad9f7db5441b2', 'request_id': 'req-c16e9a3f-b16a-459b-a632-0a675874e4ff'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:07.347990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a21632bdb3c4c61938ad9f7db5441b2', 'request_id': 'req-c16e9a3f-b16a-459b-a632-0a675874e4ff'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:07.363684 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] The token cache is being invalidate because project 2a21632bdb3c4c61938ad9f7db5441b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:06:07.364308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:07.365346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c16e9a3f-b16a-459b-a632-0a675874e4ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:07.373329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1078/2163] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:07.378046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55d88-98fa-449f-a182-d16a2e97392e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.378046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55d88-98fa-449f-a182-d16a2e97392e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.378046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55d88-98fa-449f-a182-d16a2e97392e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.378916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1086/2164] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:06:07 2022] DELETE /identity/v3/projects/2a21632bdb3c4c61938ad9f7db5441b2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:07.380773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e742c5-483a-4ea3-b0e0-16829f53b223 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.381202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e742c5-483a-4ea3-b0e0-16829f53b223 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.381647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e742c5-483a-4ea3-b0e0-16829f53b223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.394884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:07.407469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e2d55d88-98fa-449f-a182-d16a2e97392e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:07.412858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e2d55d88-98fa-449f-a182-d16a2e97392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:07.424123 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-36e742c5-483a-4ea3-b0e0-16829f53b223 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:07.427501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-36e742c5-483a-4ea3-b0e0-16829f53b223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:07.432283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1079/2165] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:06:07.436674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d55d88-98fa-449f-a182-d16a2e97392e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:07.447917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d55d88-98fa-449f-a182-d16a2e97392e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:07.453474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d78c7-90cc-4c4d-a715-c4e165694b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:07.454455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d78c7-90cc-4c4d-a715-c4e165694b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.454951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d78c7-90cc-4c4d-a715-c4e165694b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.455404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d78c7-90cc-4c4d-a715-c4e165694b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.456314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d78c7-90cc-4c4d-a715-c4e165694b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:06:07.456782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d78c7-90cc-4c4d-a715-c4e165694b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:07.464734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1087/2166] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:07.465596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d78c7-90cc-4c4d-a715-c4e165694b54 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:07.466509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762d898-2141-4a9a-b204-6a73b76b0842 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.466791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762d898-2141-4a9a-b204-6a73b76b0842 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.467096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762d898-2141-4a9a-b204-6a73b76b0842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.481879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1080/2167] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:06:07.487546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d78c7-90cc-4c4d-a715-c4e165694b54 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:07.504049 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d78c7-90cc-4c4d-a715-c4e165694b54 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:07.510410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f1c95-f198-4dec-81dd-c419ebf801e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:07.511543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1c95-f198-4dec-81dd-c419ebf801e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.511999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1c95-f198-4dec-81dd-c419ebf801e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.512562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1c95-f198-4dec-81dd-c419ebf801e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.513594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f1c95-f198-4dec-81dd-c419ebf801e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:07.516050 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f1c95-f198-4dec-81dd-c419ebf801e1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:07.521483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-b762d898-2141-4a9a-b204-6a73b76b0842 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:07.524427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b762d898-2141-4a9a-b204-6a73b76b0842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:07.525912 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:07.543147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1088/2168] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:06:07.548143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762d898-2141-4a9a-b204-6a73b76b0842 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:07.572172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762d898-2141-4a9a-b204-6a73b76b0842 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:07.579061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1081/2169] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:06:07 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:07.581117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f1c95-f198-4dec-81dd-c419ebf801e1 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:07.587158 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0d9e-2dc4-4b6a-9e66-a1516e6beb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:07.590506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0d9e-2dc4-4b6a-9e66-a1516e6beb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.590967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0d9e-2dc4-4b6a-9e66-a1516e6beb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.591429 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0d9e-2dc4-4b6a-9e66-a1516e6beb9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.593433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e0d9e-2dc4-4b6a-9e66-a1516e6beb9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:06:07.593956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e0d9e-2dc4-4b6a-9e66-a1516e6beb9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:07.596727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e0d9e-2dc4-4b6a-9e66-a1516e6beb9d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:07.629411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1089/2170] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:06:07.638319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0d9e-2dc4-4b6a-9e66-a1516e6beb9d admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:07.659626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0d9e-2dc4-4b6a-9e66-a1516e6beb9d admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:07.723066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f1c95-f198-4dec-81dd-c419ebf801e1 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:07.736962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920df806-5779-4163-9002-234319d665f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:07.737717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df806-5779-4163-9002-234319d665f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.738011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df806-5779-4163-9002-234319d665f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.738295 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df806-5779-4163-9002-234319d665f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.739790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920df806-5779-4163-9002-234319d665f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:07.742013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920df806-5779-4163-9002-234319d665f1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:07.776883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1082/2171] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:06:07 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:07.779906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920df806-5779-4163-9002-234319d665f1 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:07.780130 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c52e2e-e8a3-479c-9c74-69b224401d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:07.781037 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c52e2e-e8a3-479c-9c74-69b224401d58 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.792123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920df806-5779-4163-9002-234319d665f1 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:07.793666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c52e2e-e8a3-479c-9c74-69b224401d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.793992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c52e2e-e8a3-479c-9c74-69b224401d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.794753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c52e2e-e8a3-479c-9c74-69b224401d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:07.797529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a879c5c-3ef5-48ab-bdcc-3fc48f6fdd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:07.798509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a879c5c-3ef5-48ab-bdcc-3fc48f6fdd98 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.799219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a879c5c-3ef5-48ab-bdcc-3fc48f6fdd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.799720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a879c5c-3ef5-48ab-bdcc-3fc48f6fdd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.800638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a879c5c-3ef5-48ab-bdcc-3fc48f6fdd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:07.802474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a879c5c-3ef5-48ab-bdcc-3fc48f6fdd98 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:07.803656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c52e2e-e8a3-479c-9c74-69b224401d58 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:07.818707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1083/2172] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:07.820211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a879c5c-3ef5-48ab-bdcc-3fc48f6fdd98 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:07.832253 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a879c5c-3ef5-48ab-bdcc-3fc48f6fdd98 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:07.838183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f07a9a-12bb-46f9-95e9-d21290dacf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:07.839091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f07a9a-12bb-46f9-95e9-d21290dacf2d admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.839439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f07a9a-12bb-46f9-95e9-d21290dacf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.839714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f07a9a-12bb-46f9-95e9-d21290dacf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.840795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f07a9a-12bb-46f9-95e9-d21290dacf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:07.843951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f07a9a-12bb-46f9-95e9-d21290dacf2d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:07.853868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1090/2173] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:06:07 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:07.858567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c52e2e-e8a3-479c-9c74-69b224401d58 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:07.864540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1084/2174] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:07.865488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f07a9a-12bb-46f9-95e9-d21290dacf2d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:07.876547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f07a9a-12bb-46f9-95e9-d21290dacf2d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:07.957516 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81270-1aeb-4789-8bba-d6144a47ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:07.958467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81270-1aeb-4789-8bba-d6144a47ca00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:07.958977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81270-1aeb-4789-8bba-d6144a47ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:07.959451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81270-1aeb-4789-8bba-d6144a47ca00 admin admin] PATH_INFO: `/v3/projects/7b7cc6f9d63340788cd9098aabe4305d/users/6bb8d0097ccb42e89fa22cc84cd91522/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:07.989609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c81270-1aeb-4789-8bba-d6144a47ca00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7cc6f9d63340788cd9098aabe4305d, user_id=6bb8d0097ccb42e89fa22cc84cd91522, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:07.993305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c81270-1aeb-4789-8bba-d6144a47ca00 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:08.010747 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c52e2e-e8a3-479c-9c74-69b224401d58 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:08.015698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1085/2175] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:06:07 2022] PUT /identity/v3/projects/7b7cc6f9d63340788cd9098aabe4305d/users/6bb8d0097ccb42e89fa22cc84cd91522/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:08.028067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81270-1aeb-4789-8bba-d6144a47ca00 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:08.035593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-07c81270-1aeb-4789-8bba-d6144a47ca00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:08.106117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:08.108267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c2a29-36e8-41b0-b842-2d60d40f6aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:08.109126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2a29-36e8-41b0-b842-2d60d40f6aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.109414 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2a29-36e8-41b0-b842-2d60d40f6aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.109721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2a29-36e8-41b0-b842-2d60d40f6aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.110448 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c2a29-36e8-41b0-b842-2d60d40f6aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:08.112469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c2a29-36e8-41b0-b842-2d60d40f6aa5 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:08.133632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:08.135352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81270-1aeb-4789-8bba-d6144a47ca00 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:08.141996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:08.143215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.143656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.144034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] PATH_INFO: `/v3/users/ea45f11a04224391a10274573d243a7b` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.146367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea45f11a04224391a10274573d243a7b)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:08.148720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:08.153633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1091/2176] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:06:07 2022] POST /identity/v3/users => generated 292 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:08.155071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263e926-ecc8-4fe4-a020-f0fe6fb35a8b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.156085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263e926-ecc8-4fe4-a020-f0fe6fb35a8b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.157220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263e926-ecc8-4fe4-a020-f0fe6fb35a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.196676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-a263e926-ecc8-4fe4-a020-f0fe6fb35a8b None None] MFA Rules not processed for user `6bb8d0097ccb42e89fa22cc84cd91522`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:08.198001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a263e926-ecc8-4fe4-a020-f0fe6fb35a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:08.223654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea45f11a04224391a10274573d243a7b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:08.248031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea45f11a04224391a10274573d243a7b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:08.248031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea45f11a04224391a10274573d243a7b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:08.274679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea45f11a04224391a10274573d243a7b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:08.276316 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea45f11a04224391a10274573d243a7b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:08.280366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1092/2177] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:08.280366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263e926-ecc8-4fe4-a020-f0fe6fb35a8b None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:08.300433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263e926-ecc8-4fe4-a020-f0fe6fb35a8b None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:08.306748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3418692-9faf-403d-90d5-b5e285788dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:08.307544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3418692-9faf-403d-90d5-b5e285788dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.307902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3418692-9faf-403d-90d5-b5e285788dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.308205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3418692-9faf-403d-90d5-b5e285788dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.315627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3418692-9faf-403d-90d5-b5e285788dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:08.317655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3418692-9faf-403d-90d5-b5e285788dd9 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:08.322472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1086/2178] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:06:08 2022] DELETE /identity/v3/users/ea45f11a04224391a10274573d243a7b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:08.325679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:08.327740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:08.342147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1093/2179] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:08.342147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842280b6-b76a-45a5-9c28-5789ceab2b02 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.342147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842280b6-b76a-45a5-9c28-5789ceab2b02 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.343285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842280b6-b76a-45a5-9c28-5789ceab2b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.367803 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-842280b6-b76a-45a5-9c28-5789ceab2b02 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:08.369215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-842280b6-b76a-45a5-9c28-5789ceab2b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:08.442760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1094/2180] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:08.444013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842280b6-b76a-45a5-9c28-5789ceab2b02 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:08.449569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-842280b6-b76a-45a5-9c28-5789ceab2b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:08.466485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e9fc9-7523-4001-99f6-20d820329df6 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:08.469708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842280b6-b76a-45a5-9c28-5789ceab2b02 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:08.476761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed009c28-4ecc-4049-88b9-0fd293fe0bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:08.477316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911290d0-568c-48f8-84af-37d0183197df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:08.477451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed009c28-4ecc-4049-88b9-0fd293fe0bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.477983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed009c28-4ecc-4049-88b9-0fd293fe0bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.478276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed009c28-4ecc-4049-88b9-0fd293fe0bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.478910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911290d0-568c-48f8-84af-37d0183197df admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.479422 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911290d0-568c-48f8-84af-37d0183197df admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.479892 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911290d0-568c-48f8-84af-37d0183197df admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.481015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ed009c28-4ecc-4049-88b9-0fd293fe0bb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:08.481158 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911290d0-568c-48f8-84af-37d0183197df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:08.483859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911290d0-568c-48f8-84af-37d0183197df admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:08.507960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1095/2181] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:08.508452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911290d0-568c-48f8-84af-37d0183197df admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:08.513780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-911290d0-568c-48f8-84af-37d0183197df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:08.599067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed009c28-4ecc-4049-88b9-0fd293fe0bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:08.605932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed009c28-4ecc-4049-88b9-0fd293fe0bb6 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:08.619872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1087/2182] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:08.621204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed009c28-4ecc-4049-88b9-0fd293fe0bb6 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:08.634414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed009c28-4ecc-4049-88b9-0fd293fe0bb6 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:08.644965 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783afa7-4b17-41c8-9aa8-a89e62d67e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:08.647616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911290d0-568c-48f8-84af-37d0183197df admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:08.650054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783afa7-4b17-41c8-9aa8-a89e62d67e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.651437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783afa7-4b17-41c8-9aa8-a89e62d67e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.653196 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783afa7-4b17-41c8-9aa8-a89e62d67e6d admin admin] PATH_INFO: `/v3/projects/755442e8d90d48c89de9b82e6c776cda/users/c10f50c48cea4ded992ad55e8468351a/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.655920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf72b4-5c16-4fca-bc1f-981ddad7b6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:08.665173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf72b4-5c16-4fca-bc1f-981ddad7b6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.665547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf72b4-5c16-4fca-bc1f-981ddad7b6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.667776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf72b4-5c16-4fca-bc1f-981ddad7b6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.672550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:08.685338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783afa7-4b17-41c8-9aa8-a89e62d67e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=755442e8d90d48c89de9b82e6c776cda, user_id=c10f50c48cea4ded992ad55e8468351a, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:08.688439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783afa7-4b17-41c8-9aa8-a89e62d67e6d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:08.695507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf72b4-5c16-4fca-bc1f-981ddad7b6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:08.697614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf72b4-5c16-4fca-bc1f-981ddad7b6e9 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:08.718161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1088/2183] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:06:08 2022] PUT /identity/v3/projects/755442e8d90d48c89de9b82e6c776cda/users/c10f50c48cea4ded992ad55e8468351a/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:08.730454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783afa7-4b17-41c8-9aa8-a89e62d67e6d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:08.747335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c783afa7-4b17-41c8-9aa8-a89e62d67e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:08.750772 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1096/2184] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:08.753992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44f6a7-5ee7-40f9-ac3d-f4944dd2e407 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.754286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44f6a7-5ee7-40f9-ac3d-f4944dd2e407 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.754567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44f6a7-5ee7-40f9-ac3d-f4944dd2e407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.798294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:08.813226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-af44f6a7-5ee7-40f9-ac3d-f4944dd2e407 None None] MFA Rules not processed for user `c10f50c48cea4ded992ad55e8468351a`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:08.815096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-af44f6a7-5ee7-40f9-ac3d-f4944dd2e407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:08.845232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783afa7-4b17-41c8-9aa8-a89e62d67e6d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:08.853436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:08.854806 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.855182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.855527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] PATH_INFO: `/v3/users/6bb8d0097ccb42e89fa22cc84cd91522` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.859011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb8d0097ccb42e89fa22cc84cd91522)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:08.861984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:08.919402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1097/2185] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:08.921127 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861303d-a589-4e99-bb78-6d41fe102278 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:08.921495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861303d-a589-4e99-bb78-6d41fe102278 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:08.921917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861303d-a589-4e99-bb78-6d41fe102278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:08.945673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb8d0097ccb42e89fa22cc84cd91522'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:08.967624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4861303d-a589-4e99-bb78-6d41fe102278 None None] MFA Rules not processed for user `9fd251e1a49a4a5e817eec4df8794656`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:08.969599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb8d0097ccb42e89fa22cc84cd91522'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:08.970061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4861303d-a589-4e99-bb78-6d41fe102278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:08.971385 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb8d0097ccb42e89fa22cc84cd91522'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:08.981953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb8d0097ccb42e89fa22cc84cd91522'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:08.983455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb8d0097ccb42e89fa22cc84cd91522'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:09.019654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1089/2186] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:06:08 2022] DELETE /identity/v3/users/6bb8d0097ccb42e89fa22cc84cd91522 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:09.020567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:09.021974 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:09.116271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1098/2187] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:09.126738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51858d-847b-470d-8130-2af88de458ef None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:09.127094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51858d-847b-470d-8130-2af88de458ef None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:09.127326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51858d-847b-470d-8130-2af88de458ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:09.144746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a6490-b8fe-40e6-81f9-a6d1a5fcff8c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:09.148710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c40b2-3266-4fc3-bf1f-3f6700d7a0ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:09.149647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c40b2-3266-4fc3-bf1f-3f6700d7a0ee service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:09.149947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c40b2-3266-4fc3-bf1f-3f6700d7a0ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:09.150237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c40b2-3266-4fc3-bf1f-3f6700d7a0ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:09.152404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-7c51858d-847b-470d-8130-2af88de458ef None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:09.152909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f80c40b2-3266-4fc3-bf1f-3f6700d7a0ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:09.153758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7c51858d-847b-470d-8130-2af88de458ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:09.192758 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:09.250346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1099/2188] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:09.260907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c40b2-3266-4fc3-bf1f-3f6700d7a0ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:09.262865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c40b2-3266-4fc3-bf1f-3f6700d7a0ee service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:09.266551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51858d-847b-470d-8130-2af88de458ef None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:09.269315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7c51858d-847b-470d-8130-2af88de458ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:09.278531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1090/2189] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:09.293726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c40b2-3266-4fc3-bf1f-3f6700d7a0ee service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:09.295494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f80c40b2-3266-4fc3-bf1f-3f6700d7a0ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:09.369537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:09.387133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c40b2-3266-4fc3-bf1f-3f6700d7a0ee service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:09.392470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe20706-cf24-47e0-80df-49ebfea515b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:09.396061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20706-cf24-47e0-80df-49ebfea515b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:09.396459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20706-cf24-47e0-80df-49ebfea515b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:09.396787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20706-cf24-47e0-80df-49ebfea515b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:09.416828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe20706-cf24-47e0-80df-49ebfea515b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:09.419145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe20706-cf24-47e0-80df-49ebfea515b7 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:09.463435 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1091/2190] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:09.466529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe20706-cf24-47e0-80df-49ebfea515b7 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:09.480647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0fe20706-cf24-47e0-80df-49ebfea515b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:09.482957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51858d-847b-470d-8130-2af88de458ef None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:09.489988 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765f0fa-ad9c-4073-88ec-ad4076098f96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:09.490660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f0fa-ad9c-4073-88ec-ad4076098f96 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:09.491194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f0fa-ad9c-4073-88ec-ad4076098f96 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:09.491476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f0fa-ad9c-4073-88ec-ad4076098f96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:09.510510 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe20706-cf24-47e0-80df-49ebfea515b7 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:09.522609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:09.523659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:09.524952 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:09.525248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] PATH_INFO: `/v3/projects/04188990d2db4ebd894bf9ba7f72988d` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:09.527409 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=04188990d2db4ebd894bf9ba7f72988d)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:09.530336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:09.621581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765f0fa-ad9c-4073-88ec-ad4076098f96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:09.623821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765f0fa-ad9c-4073-88ec-ad4076098f96 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:09.634144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04188990d2db4ebd894bf9ba7f72988d', 'request_id': 'req-f1a688df-3d54-40bf-b24a-2df3f12e51cd'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:09.646503 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04188990d2db4ebd894bf9ba7f72988d', 'request_id': 'req-f1a688df-3d54-40bf-b24a-2df3f12e51cd'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:09.647925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1100/2191] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:09.660266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04188990d2db4ebd894bf9ba7f72988d', 'request_id': 'req-f1a688df-3d54-40bf-b24a-2df3f12e51cd'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:09.691021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] The token cache is being invalidate because project 04188990d2db4ebd894bf9ba7f72988d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:06:09.691422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:09.694348 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f1a688df-3d54-40bf-b24a-2df3f12e51cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:09.699026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1092/2192] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:06:09 2022] DELETE /identity/v3/projects/04188990d2db4ebd894bf9ba7f72988d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:09.705420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8f71a-1006-4c12-a5cf-42faef49bea9 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:09.706138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8f71a-1006-4c12-a5cf-42faef49bea9 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:09.706671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8f71a-1006-4c12-a5cf-42faef49bea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:09.750698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-16b8f71a-1006-4c12-a5cf-42faef49bea9 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:09.756444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-16b8f71a-1006-4c12-a5cf-42faef49bea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:09.906432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1101/2193] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:09.907995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da70ce4-9283-40fc-a5fd-491dc54518a9 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:09.908582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da70ce4-9283-40fc-a5fd-491dc54518a9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:09.909014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da70ce4-9283-40fc-a5fd-491dc54518a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:09.957176 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1da70ce4-9283-40fc-a5fd-491dc54518a9 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:09.958808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1da70ce4-9283-40fc-a5fd-491dc54518a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:09.983997 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1093/2194] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:06:09.988418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8f71a-1006-4c12-a5cf-42faef49bea9 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.000776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8f71a-1006-4c12-a5cf-42faef49bea9 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:10.007580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c139f1-7e12-490c-bff6-1e2569acd2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:10.007580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c139f1-7e12-490c-bff6-1e2569acd2cf admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.007876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c139f1-7e12-490c-bff6-1e2569acd2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.008534 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c139f1-7e12-490c-bff6-1e2569acd2cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.009589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c139f1-7e12-490c-bff6-1e2569acd2cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:06:10.010142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c139f1-7e12-490c-bff6-1e2569acd2cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:10.012225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c139f1-7e12-490c-bff6-1e2569acd2cf admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:10.033200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1102/2195] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:06:10.036356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da70ce4-9283-40fc-a5fd-491dc54518a9 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.057620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da70ce4-9283-40fc-a5fd-491dc54518a9 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:10.064999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b710c7-c9ab-4f39-b57b-18047da15a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:10.065706 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b710c7-c9ab-4f39-b57b-18047da15a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.066126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b710c7-c9ab-4f39-b57b-18047da15a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.066594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b710c7-c9ab-4f39-b57b-18047da15a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.067794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b710c7-c9ab-4f39-b57b-18047da15a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:10.071874 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b710c7-c9ab-4f39-b57b-18047da15a9a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:10.158541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1094/2196] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:06:10 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:10.163168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c139f1-7e12-490c-bff6-1e2569acd2cf admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.179363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c139f1-7e12-490c-bff6-1e2569acd2cf admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:10.187896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b710c7-c9ab-4f39-b57b-18047da15a9a admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.189634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-63b710c7-c9ab-4f39-b57b-18047da15a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:10.226517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:10.307285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:10.325172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b710c7-c9ab-4f39-b57b-18047da15a9a admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:10.334919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:10.335947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.336303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.336610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] PATH_INFO: `/v3/projects/7b7cc6f9d63340788cd9098aabe4305d` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.338098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7cc6f9d63340788cd9098aabe4305d)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:10.340481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:10.342523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201c496-84fb-4ccb-b6b0-db8cdfc2014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:10.343922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201c496-84fb-4ccb-b6b0-db8cdfc2014a admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.344219 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201c496-84fb-4ccb-b6b0-db8cdfc2014a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.344494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201c496-84fb-4ccb-b6b0-db8cdfc2014a admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.345276 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201c496-84fb-4ccb-b6b0-db8cdfc2014a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:10.347227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201c496-84fb-4ccb-b6b0-db8cdfc2014a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:10.379622 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1103/2197] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:06:10 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:10.383936 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201c496-84fb-4ccb-b6b0-db8cdfc2014a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.413570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201c496-84fb-4ccb-b6b0-db8cdfc2014a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:10.431930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7cc6f9d63340788cd9098aabe4305d', 'request_id': 'req-df565fdf-2401-4727-a904-763425b2161f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:10.440485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7cc6f9d63340788cd9098aabe4305d', 'request_id': 'req-df565fdf-2401-4727-a904-763425b2161f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:10.452981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7cc6f9d63340788cd9098aabe4305d', 'request_id': 'req-df565fdf-2401-4727-a904-763425b2161f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:10.480836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] The token cache is being invalidate because project 7b7cc6f9d63340788cd9098aabe4305d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:06:10.481186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:10.482033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-df565fdf-2401-4727-a904-763425b2161f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:10.484243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1095/2198] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:06:10 2022] DELETE /identity/v3/projects/7b7cc6f9d63340788cd9098aabe4305d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:10.490210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a02a06-8883-42c9-95ea-04c7847b3019 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.490210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a02a06-8883-42c9-95ea-04c7847b3019 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.490910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a02a06-8883-42c9-95ea-04c7847b3019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.520177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-33a02a06-8883-42c9-95ea-04c7847b3019 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:10.521802 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-33a02a06-8883-42c9-95ea-04c7847b3019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:10.529818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13d0a4-aadd-46cc-b9c8-ea23e79d0e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:10.530821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d0a4-aadd-46cc-b9c8-ea23e79d0e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.531151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d0a4-aadd-46cc-b9c8-ea23e79d0e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.531428 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d0a4-aadd-46cc-b9c8-ea23e79d0e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.532399 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13d0a4-aadd-46cc-b9c8-ea23e79d0e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:10.534084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13d0a4-aadd-46cc-b9c8-ea23e79d0e65 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:10.534946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1096/2199] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:10.543500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7da1-a663-47c4-9bfb-9a714c3a8ced None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.543915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7da1-a663-47c4-9bfb-9a714c3a8ced None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.544390 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7da1-a663-47c4-9bfb-9a714c3a8ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.567421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1104/2200] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:10.571680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13d0a4-aadd-46cc-b9c8-ea23e79d0e65 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.572785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3e5f7da1-a663-47c4-9bfb-9a714c3a8ced None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:10.574346 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3e5f7da1-a663-47c4-9bfb-9a714c3a8ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:10.578551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9f13d0a4-aadd-46cc-b9c8-ea23e79d0e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:10.597600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1097/2201] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:06:10.601456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f7da1-a663-47c4-9bfb-9a714c3a8ced None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.604460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13d0a4-aadd-46cc-b9c8-ea23e79d0e65 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:10.609775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f0b64-a861-4e47-a793-f4ab0487c4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:10.610565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f0b64-a861-4e47-a793-f4ab0487c4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.610899 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f0b64-a861-4e47-a793-f4ab0487c4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.611221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f0b64-a861-4e47-a793-f4ab0487c4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.611970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f0b64-a861-4e47-a793-f4ab0487c4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:10.613609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f0b64-a861-4e47-a793-f4ab0487c4f8 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:10.615658 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f7da1-a663-47c4-9bfb-9a714c3a8ced None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:10.623571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744a127-4d27-42ff-9392-c292623ceae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:10.624742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a127-4d27-42ff-9392-c292623ceae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.625159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a127-4d27-42ff-9392-c292623ceae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.625508 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744a127-4d27-42ff-9392-c292623ceae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.626330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744a127-4d27-42ff-9392-c292623ceae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:06:10.626707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744a127-4d27-42ff-9392-c292623ceae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:10.628521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744a127-4d27-42ff-9392-c292623ceae6 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:10.629833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1105/2202] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:10.630750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f0b64-a861-4e47-a793-f4ab0487c4f8 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.644035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f0b64-a861-4e47-a793-f4ab0487c4f8 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:10.646936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1098/2203] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:06:10.651397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744a127-4d27-42ff-9392-c292623ceae6 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.653552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025c653-f58e-4e6e-b4fd-37191faec35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:10.654565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025c653-f58e-4e6e-b4fd-37191faec35b admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.654912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025c653-f58e-4e6e-b4fd-37191faec35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.655456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025c653-f58e-4e6e-b4fd-37191faec35b admin admin] PATH_INFO: `/v3/projects/9020870092bb45f093719798cc7c8c58/users/b72ebcbe522d4ddb8673d2c01f4692c7/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.675547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025c653-f58e-4e6e-b4fd-37191faec35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9020870092bb45f093719798cc7c8c58, user_id=b72ebcbe522d4ddb8673d2c01f4692c7, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:10.676960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744a127-4d27-42ff-9392-c292623ceae6 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:10.678689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025c653-f58e-4e6e-b4fd-37191faec35b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:10.689457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0cf06-2c1a-4983-9252-4531002f3bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:10.690298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0cf06-2c1a-4983-9252-4531002f3bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.690654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0cf06-2c1a-4983-9252-4531002f3bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.691483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0cf06-2c1a-4983-9252-4531002f3bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.694402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0cf06-2c1a-4983-9252-4531002f3bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:10.699914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0cf06-2c1a-4983-9252-4531002f3bf4 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:10.714674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1106/2204] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:06:10 2022] PUT /identity/v3/projects/9020870092bb45f093719798cc7c8c58/users/b72ebcbe522d4ddb8673d2c01f4692c7/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:10.716357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf180-0b72-437c-9f50-7151a2d9541b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.716646 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf180-0b72-437c-9f50-7151a2d9541b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.716932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf180-0b72-437c-9f50-7151a2d9541b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.751277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-dd7cf180-0b72-437c-9f50-7151a2d9541b None None] MFA Rules not processed for user `b72ebcbe522d4ddb8673d2c01f4692c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:10.752332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-dd7cf180-0b72-437c-9f50-7151a2d9541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:10.763393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1099/2205] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:06:10 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:10.765062 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0cf06-2c1a-4983-9252-4531002f3bf4 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.845798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1107/2206] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:10.858753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cf180-0b72-437c-9f50-7151a2d9541b None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.863213 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0cf06-2c1a-4983-9252-4531002f3bf4 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:10.867633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-dd7cf180-0b72-437c-9f50-7151a2d9541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:10.870376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4513b6-78c5-43eb-843c-c549f35af228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:10.870898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4513b6-78c5-43eb-843c-c549f35af228 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.871236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4513b6-78c5-43eb-843c-c549f35af228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.871522 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4513b6-78c5-43eb-843c-c549f35af228 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.872291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4513b6-78c5-43eb-843c-c549f35af228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:10.874694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4513b6-78c5-43eb-843c-c549f35af228 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:10.885258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:10.914596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1100/2207] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:06:10 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:06:10.919210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4513b6-78c5-43eb-843c-c549f35af228 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:10.939744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:10.940282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4513b6-78c5-43eb-843c-c549f35af228 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:10.963445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c71ea9-520c-4aa2-a502-e814c60b4246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:10.964574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c71ea9-520c-4aa2-a502-e814c60b4246 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:10.967361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c71ea9-520c-4aa2-a502-e814c60b4246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:10.967729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c71ea9-520c-4aa2-a502-e814c60b4246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:10.968953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c71ea9-520c-4aa2-a502-e814c60b4246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:10.970944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c71ea9-520c-4aa2-a502-e814c60b4246 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:10.978365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cf180-0b72-437c-9f50-7151a2d9541b None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:11.007325 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1101/2208] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:11.011884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c71ea9-520c-4aa2-a502-e814c60b4246 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:11.043857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c71ea9-520c-4aa2-a502-e814c60b4246 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:11.057703 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b030a9-a0f0-478e-89b6-5a0b7f9e552d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:11.070290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b030a9-a0f0-478e-89b6-5a0b7f9e552d admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:11.070595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b030a9-a0f0-478e-89b6-5a0b7f9e552d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:11.070886 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b030a9-a0f0-478e-89b6-5a0b7f9e552d admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:11.075125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b030a9-a0f0-478e-89b6-5a0b7f9e552d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:11.077813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b030a9-a0f0-478e-89b6-5a0b7f9e552d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:11.086638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c414e-9c54-41d8-bb79-ca5af3783b10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '250c47daff26400c96a6b467d7cf5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:11.087492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c414e-9c54-41d8-bb79-ca5af3783b10 service glance] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:11.087792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c414e-9c54-41d8-bb79-ca5af3783b10 service glance] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:11.088043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c414e-9c54-41d8-bb79-ca5af3783b10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:11.097464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1102/2209] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:11.098978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b030a9-a0f0-478e-89b6-5a0b7f9e552d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:11.116863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b030a9-a0f0-478e-89b6-5a0b7f9e552d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:11.129864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e644d34-cbba-40c3-8b37-863410a9598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:11.131170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e644d34-cbba-40c3-8b37-863410a9598a admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:11.131686 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e644d34-cbba-40c3-8b37-863410a9598a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:11.132180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e644d34-cbba-40c3-8b37-863410a9598a admin admin] PATH_INFO: `/v3/projects/064b2783c0fe4cf288ad4629c941a0be/users/82e0e24e4f1c44e88b41f2c05fc254d5/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:11.155868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e644d34-cbba-40c3-8b37-863410a9598a admin admin] RBAC: Authorizing `identity:create_grant(project_id=064b2783c0fe4cf288ad4629c941a0be, user_id=82e0e24e4f1c44e88b41f2c05fc254d5, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:11.159665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e644d34-cbba-40c3-8b37-863410a9598a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:11.180244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1103/2210] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:06:11 2022] PUT /identity/v3/projects/064b2783c0fe4cf288ad4629c941a0be/users/82e0e24e4f1c44e88b41f2c05fc254d5/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:06:11.185747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d526-9afa-4711-abce-70d693bdf61e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:11.186739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d526-9afa-4711-abce-70d693bdf61e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:11.187807 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d526-9afa-4711-abce-70d693bdf61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:11.207541 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c414e-9c54-41d8-bb79-ca5af3783b10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:11.209493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7664d526-9afa-4711-abce-70d693bdf61e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:11.210263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c414e-9c54-41d8-bb79-ca5af3783b10 service glance] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:11.210869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7664d526-9afa-4711-abce-70d693bdf61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:11.231404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1108/2211] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:11.319935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1104/2212] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:11.344486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c414e-9c54-41d8-bb79-ca5af3783b10 service glance] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:11.348737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9f5c414e-9c54-41d8-bb79-ca5af3783b10 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:11.472912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c414e-9c54-41d8-bb79-ca5af3783b10 service glance] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:11.539416 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202ab61-28f4-4e9b-b250-042369ba57e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:11.540304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202ab61-28f4-4e9b-b250-042369ba57e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:11.540654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202ab61-28f4-4e9b-b250-042369ba57e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:11.541007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202ab61-28f4-4e9b-b250-042369ba57e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:11.564902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202ab61-28f4-4e9b-b250-042369ba57e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:11.566659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202ab61-28f4-4e9b-b250-042369ba57e8 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:11.589138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1109/2213] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:12.192758 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d90f3-08cb-4948-9034-4bfbf23f8582 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:12.193344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d90f3-08cb-4948-9034-4bfbf23f8582 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:12.194123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d90f3-08cb-4948-9034-4bfbf23f8582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:12.221643 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fd4d90f3-08cb-4948-9034-4bfbf23f8582 None None] MFA Rules not processed for user `9fd251e1a49a4a5e817eec4df8794656`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:12.223860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fd4d90f3-08cb-4948-9034-4bfbf23f8582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:12.266462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202ab61-28f4-4e9b-b250-042369ba57e8 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:12.268878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6202ab61-28f4-4e9b-b250-042369ba57e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:12.285045 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:12.302693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202ab61-28f4-4e9b-b250-042369ba57e8 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:12.324783 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:12.328291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:12.328771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:12.329388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] PATH_INFO: `/v3/users/c10f50c48cea4ded992ad55e8468351a` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:12.331484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10f50c48cea4ded992ad55e8468351a)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:12.335007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:12.352126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1105/2214] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:12.411325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10f50c48cea4ded992ad55e8468351a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:12.427133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10f50c48cea4ded992ad55e8468351a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:12.467432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10f50c48cea4ded992ad55e8468351a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:12.476838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10f50c48cea4ded992ad55e8468351a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:12.483168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10f50c48cea4ded992ad55e8468351a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:12.503657 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1110/2215] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:06:12 2022] DELETE /identity/v3/users/c10f50c48cea4ded992ad55e8468351a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:12.508139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47afa8-f88a-426f-a621-e21765858392 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:12.508454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47afa8-f88a-426f-a621-e21765858392 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:12.509050 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47afa8-f88a-426f-a621-e21765858392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:12.531791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5a47afa8-f88a-426f-a621-e21765858392 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:12.533184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5a47afa8-f88a-426f-a621-e21765858392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:12.640994 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:12.684253 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1106/2216] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:06:12.702341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:12.704427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:12.796496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b18aff-02db-4d80-a940-49f182d49631 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:12.801039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef37f3a-c9be-4aab-8a60-5018724560c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:12.801773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef37f3a-c9be-4aab-8a60-5018724560c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:12.802097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef37f3a-c9be-4aab-8a60-5018724560c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:12.803157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef37f3a-c9be-4aab-8a60-5018724560c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:12.817000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef37f3a-c9be-4aab-8a60-5018724560c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:12.818698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef37f3a-c9be-4aab-8a60-5018724560c2 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:12.872353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1111/2217] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:12.940127 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453d4d6-1faf-45ef-bb0c-c9a74fc13c44 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:12.940570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453d4d6-1faf-45ef-bb0c-c9a74fc13c44 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:12.940780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453d4d6-1faf-45ef-bb0c-c9a74fc13c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:13.027909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a453d4d6-1faf-45ef-bb0c-c9a74fc13c44 None None] MFA Rules not processed for user `82e0e24e4f1c44e88b41f2c05fc254d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:13.032154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a453d4d6-1faf-45ef-bb0c-c9a74fc13c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:13.212356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1107/2218] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:13.223762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef37f3a-c9be-4aab-8a60-5018724560c2 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:13.226816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5ef37f3a-c9be-4aab-8a60-5018724560c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:13.384204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef37f3a-c9be-4aab-8a60-5018724560c2 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:13.393509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05588f43-81ee-4abe-a3fe-64620c9c5c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:13.394191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588f43-81ee-4abe-a3fe-64620c9c5c1e service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:13.394479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588f43-81ee-4abe-a3fe-64620c9c5c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:13.394762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588f43-81ee-4abe-a3fe-64620c9c5c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:13.405459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05588f43-81ee-4abe-a3fe-64620c9c5c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:13.407684 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05588f43-81ee-4abe-a3fe-64620c9c5c1e service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:13.418518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1112/2219] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:13.460796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453d4d6-1faf-45ef-bb0c-c9a74fc13c44 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:13.462542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a453d4d6-1faf-45ef-bb0c-c9a74fc13c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:13.495283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453d4d6-1faf-45ef-bb0c-c9a74fc13c44 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:13.521759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:13.522880 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:13.523402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:13.523695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] PATH_INFO: `/v3/projects/755442e8d90d48c89de9b82e6c776cda` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:13.527330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=755442e8d90d48c89de9b82e6c776cda)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:13.532179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:13.664748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755442e8d90d48c89de9b82e6c776cda', 'request_id': 'req-776bea1e-d44a-470b-bfae-00e1692d83fe'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:13.677691 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755442e8d90d48c89de9b82e6c776cda', 'request_id': 'req-776bea1e-d44a-470b-bfae-00e1692d83fe'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:13.698691 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755442e8d90d48c89de9b82e6c776cda', 'request_id': 'req-776bea1e-d44a-470b-bfae-00e1692d83fe'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:13.716444 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] The token cache is being invalidate because project 755442e8d90d48c89de9b82e6c776cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:06:13.717029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:13.717995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-776bea1e-d44a-470b-bfae-00e1692d83fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:13.728244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1108/2220] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:06:13 2022] DELETE /identity/v3/projects/755442e8d90d48c89de9b82e6c776cda => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:13.733190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8f2b-d730-4190-8ab9-88b3ab0d9e54 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:13.734181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8f2b-d730-4190-8ab9-88b3ab0d9e54 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:13.734653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8f2b-d730-4190-8ab9-88b3ab0d9e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:13.798919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-aa0e8f2b-d730-4190-8ab9-88b3ab0d9e54 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:13.805233 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-aa0e8f2b-d730-4190-8ab9-88b3ab0d9e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:13.834999 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:13.941834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1113/2221] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:13.949638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5117-d1e9-4985-b156-2d9af7a03f0a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:13.949934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5117-d1e9-4985-b156-2d9af7a03f0a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:13.950218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5117-d1e9-4985-b156-2d9af7a03f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:13.992021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a79f5117-d1e9-4985-b156-2d9af7a03f0a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:13.993297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a79f5117-d1e9-4985-b156-2d9af7a03f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:14.013177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1109/2222] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:14.023508 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8f2b-d730-4190-8ab9-88b3ab0d9e54 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:14.044008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8f2b-d730-4190-8ab9-88b3ab0d9e54 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:14.059114 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13c81a-4f9d-4375-afca-0dc6cd6913df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:14.062084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13c81a-4f9d-4375-afca-0dc6cd6913df admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:14.062467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13c81a-4f9d-4375-afca-0dc6cd6913df admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:14.062718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13c81a-4f9d-4375-afca-0dc6cd6913df admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:14.065057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13c81a-4f9d-4375-afca-0dc6cd6913df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:06:14.066911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13c81a-4f9d-4375-afca-0dc6cd6913df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:14.071330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13c81a-4f9d-4375-afca-0dc6cd6913df admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:14.103737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5117-d1e9-4985-b156-2d9af7a03f0a None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:14.109320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1114/2223] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:06:14.117162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5117-d1e9-4985-b156-2d9af7a03f0a None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:14.134136 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3200c4-2af2-4cf0-ad54-ae41e3a6104e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:14.169413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3200c4-2af2-4cf0-ad54-ae41e3a6104e admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:14.172356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3200c4-2af2-4cf0-ad54-ae41e3a6104e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:14.190112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3200c4-2af2-4cf0-ad54-ae41e3a6104e admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:14.192623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3200c4-2af2-4cf0-ad54-ae41e3a6104e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:14.195882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3200c4-2af2-4cf0-ad54-ae41e3a6104e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:14.244495 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1110/2224] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:06:14 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:06:14.249291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13c81a-4f9d-4375-afca-0dc6cd6913df admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:14.271479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13c81a-4f9d-4375-afca-0dc6cd6913df admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:14.362671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404809f-fce4-4166-a7cd-e874f7c6f00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:14.363505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404809f-fce4-4166-a7cd-e874f7c6f00e admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:14.363843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404809f-fce4-4166-a7cd-e874f7c6f00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:14.364170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404809f-fce4-4166-a7cd-e874f7c6f00e admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:14.364899 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404809f-fce4-4166-a7cd-e874f7c6f00e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:14.367023 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404809f-fce4-4166-a7cd-e874f7c6f00e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:14.402898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1115/2225] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:06:14 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:06:14.406932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3200c4-2af2-4cf0-ad54-ae41e3a6104e admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:14.420818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3200c4-2af2-4cf0-ad54-ae41e3a6104e admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:14.427704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b953df4-d33a-45cb-bea6-f53633df6a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:14.429199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b953df4-d33a-45cb-bea6-f53633df6a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:14.430374 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b953df4-d33a-45cb-bea6-f53633df6a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:14.430894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b953df4-d33a-45cb-bea6-f53633df6a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:14.431879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b953df4-d33a-45cb-bea6-f53633df6a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:14.434407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b953df4-d33a-45cb-bea6-f53633df6a03 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:14.448217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1111/2226] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:14.452575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404809f-fce4-4166-a7cd-e874f7c6f00e admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:14.466043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404809f-fce4-4166-a7cd-e874f7c6f00e admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:14.472637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7817616-1fe7-4ea9-8ceb-5fe3628c5400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:14.473637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7817616-1fe7-4ea9-8ceb-5fe3628c5400 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:14.473934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7817616-1fe7-4ea9-8ceb-5fe3628c5400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:14.474216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7817616-1fe7-4ea9-8ceb-5fe3628c5400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:14.475082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7817616-1fe7-4ea9-8ceb-5fe3628c5400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:14.483502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7817616-1fe7-4ea9-8ceb-5fe3628c5400 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:14.490358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1116/2227] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:14.494951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b953df4-d33a-45cb-bea6-f53633df6a03 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:14.521625 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b953df4-d33a-45cb-bea6-f53633df6a03 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:14.526659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecf108-8ad1-4c75-bda6-00663d4848d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:14.527604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecf108-8ad1-4c75-bda6-00663d4848d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:14.527885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecf108-8ad1-4c75-bda6-00663d4848d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:14.528169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecf108-8ad1-4c75-bda6-00663d4848d9 admin admin] PATH_INFO: `/v3/projects/7744305ebe95413d9e5d24f9e4880ddf/users/15350929101e43aaa96446807e333438/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:14.548020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecf108-8ad1-4c75-bda6-00663d4848d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7744305ebe95413d9e5d24f9e4880ddf, user_id=15350929101e43aaa96446807e333438, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:14.552299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecf108-8ad1-4c75-bda6-00663d4848d9 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:14.564757 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:14.578343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1112/2228] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:06:14 2022] PUT /identity/v3/projects/7744305ebe95413d9e5d24f9e4880ddf/users/15350929101e43aaa96446807e333438/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:14.589661 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0f03d-60d0-422d-aa7b-e6a26fea6f5e None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:14.589962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0f03d-60d0-422d-aa7b-e6a26fea6f5e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:14.590394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0f03d-60d0-422d-aa7b-e6a26fea6f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:14.624636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-e4f0f03d-60d0-422d-aa7b-e6a26fea6f5e None None] MFA Rules not processed for user `15350929101e43aaa96446807e333438`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:14.626166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e4f0f03d-60d0-422d-aa7b-e6a26fea6f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:14.712549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1117/2229] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:14.726908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecf108-8ad1-4c75-bda6-00663d4848d9 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:14.729367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-10ecf108-8ad1-4c75-bda6-00663d4848d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:14.804285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecf108-8ad1-4c75-bda6-00663d4848d9 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:14.809657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cfcca-5ac2-4beb-9935-077c293d56ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '250c47daff26400c96a6b467d7cf5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:14.809657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cfcca-5ac2-4beb-9935-077c293d56ba service glance] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:14.809657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cfcca-5ac2-4beb-9935-077c293d56ba service glance] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:14.810469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cfcca-5ac2-4beb-9935-077c293d56ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:14.822434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cfcca-5ac2-4beb-9935-077c293d56ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:14.824131 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cfcca-5ac2-4beb-9935-077c293d56ba service glance] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:14.834344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1113/2230] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:15.206725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27dfe5-e5e2-427e-9507-faf4f5d8728e None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:15.207255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27dfe5-e5e2-427e-9507-faf4f5d8728e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:15.207332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27dfe5-e5e2-427e-9507-faf4f5d8728e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:15.227364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-1c27dfe5-e5e2-427e-9507-faf4f5d8728e None None] MFA Rules not processed for user `82e0e24e4f1c44e88b41f2c05fc254d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:15.228837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1c27dfe5-e5e2-427e-9507-faf4f5d8728e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:15.255355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:15.352928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1118/2231] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:20.340722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dece5d-44ad-43fc-bcc6-cf142d86b2e2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:20.341309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dece5d-44ad-43fc-bcc6-cf142d86b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:20.341309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dece5d-44ad-43fc-bcc6-cf142d86b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:20.358328 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c7dece5d-44ad-43fc-bcc6-cf142d86b2e2 None None] MFA Rules not processed for user `254142727a204898ae81fb80aad4d438`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:20.359568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c7dece5d-44ad-43fc-bcc6-cf142d86b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:20.417594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1114/2232] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:25.340319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=18 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:30.410323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=52 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:51.762063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27dfe5-e5e2-427e-9507-faf4f5d8728e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:51.763924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1c27dfe5-e5e2-427e-9507-faf4f5d8728e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:51.845705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27dfe5-e5e2-427e-9507-faf4f5d8728e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:51.851729 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:51.852649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:51.852989 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:51.853276 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] PATH_INFO: `/v3/users/b72ebcbe522d4ddb8673d2c01f4692c7` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:51.854544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72ebcbe522d4ddb8673d2c01f4692c7)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:51.856579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:51.908151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72ebcbe522d4ddb8673d2c01f4692c7'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:51.921211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72ebcbe522d4ddb8673d2c01f4692c7'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:51.929536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72ebcbe522d4ddb8673d2c01f4692c7'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:51.937346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72ebcbe522d4ddb8673d2c01f4692c7'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:51.938002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72ebcbe522d4ddb8673d2c01f4692c7'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:51.944074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1119/2233] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:06:51 2022] DELETE /identity/v3/users/b72ebcbe522d4ddb8673d2c01f4692c7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:51.948829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c2a0c-5858-4a44-b75b-6d4dc6484bc7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:51.949338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c2a0c-5858-4a44-b75b-6d4dc6484bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:51.949453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c2a0c-5858-4a44-b75b-6d4dc6484bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:51.968598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3b5c2a0c-5858-4a44-b75b-6d4dc6484bc7 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:51.969854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3b5c2a0c-5858-4a44-b75b-6d4dc6484bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:52.036200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1115/2234] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:52.046606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:52.048228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:52.126792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480959de-908a-46cd-94f8-25f5534f2d2e admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:52.130598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cb170-9dbe-4805-a562-2bf589ac8d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:52.131316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb170-9dbe-4805-a562-2bf589ac8d32 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:52.131566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb170-9dbe-4805-a562-2bf589ac8d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:52.131842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cb170-9dbe-4805-a562-2bf589ac8d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:52.143431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cb170-9dbe-4805-a562-2bf589ac8d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:52.145145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cb170-9dbe-4805-a562-2bf589ac8d32 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:52.156048 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1120/2235] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:52.504392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c2a0c-5858-4a44-b75b-6d4dc6484bc7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:52.508905 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3b5c2a0c-5858-4a44-b75b-6d4dc6484bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:52.544369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c2a0c-5858-4a44-b75b-6d4dc6484bc7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:52.549511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:52.550722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:52.551250 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:52.551737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] PATH_INFO: `/v3/projects/9020870092bb45f093719798cc7c8c58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:52.553224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9020870092bb45f093719798cc7c8c58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:52.555983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:52.606832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9020870092bb45f093719798cc7c8c58', 'request_id': 'req-c4258942-444f-4a0e-b1f5-fe07137f544f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:52.613386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9020870092bb45f093719798cc7c8c58', 'request_id': 'req-c4258942-444f-4a0e-b1f5-fe07137f544f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:52.622238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9020870092bb45f093719798cc7c8c58', 'request_id': 'req-c4258942-444f-4a0e-b1f5-fe07137f544f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:52.632727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] The token cache is being invalidate because project 9020870092bb45f093719798cc7c8c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:06:52.633012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:52.633677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c4258942-444f-4a0e-b1f5-fe07137f544f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:52.635266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1116/2236] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:06:52 2022] DELETE /identity/v3/projects/9020870092bb45f093719798cc7c8c58 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:52.640378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324da47d-9bd7-4f20-964a-56c2d9dc7a55 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:52.640667 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324da47d-9bd7-4f20-964a-56c2d9dc7a55 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:52.640944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324da47d-9bd7-4f20-964a-56c2d9dc7a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:52.659330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-324da47d-9bd7-4f20-964a-56c2d9dc7a55 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:52.660537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-324da47d-9bd7-4f20-964a-56c2d9dc7a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:52.679017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:52.726437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1121/2237] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:06:52.739585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce737-1bf3-4d95-995e-71cfc2ae0868 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:52.739969 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce737-1bf3-4d95-995e-71cfc2ae0868 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:52.740369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce737-1bf3-4d95-995e-71cfc2ae0868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:52.759764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-746ce737-1bf3-4d95-995e-71cfc2ae0868 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:52.760980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-746ce737-1bf3-4d95-995e-71cfc2ae0868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:52.770256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1117/2238] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:52.774612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324da47d-9bd7-4f20-964a-56c2d9dc7a55 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:52.784546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324da47d-9bd7-4f20-964a-56c2d9dc7a55 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:52.790286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287642a9-b93f-4024-8607-7c163fa0bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:52.790973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287642a9-b93f-4024-8607-7c163fa0bc31 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:52.791275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287642a9-b93f-4024-8607-7c163fa0bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:52.791547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287642a9-b93f-4024-8607-7c163fa0bc31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:52.792274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287642a9-b93f-4024-8607-7c163fa0bc31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:06:52.792573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287642a9-b93f-4024-8607-7c163fa0bc31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:52.794201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287642a9-b93f-4024-8607-7c163fa0bc31 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:52.807146 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1122/2239] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:06:52.812071 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ce737-1bf3-4d95-995e-71cfc2ae0868 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:52.822232 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ce737-1bf3-4d95-995e-71cfc2ae0868 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:52.828326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289503c-e24f-49f7-b094-a720e4e03416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:52.828961 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289503c-e24f-49f7-b094-a720e4e03416 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:52.829228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289503c-e24f-49f7-b094-a720e4e03416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:52.829516 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289503c-e24f-49f7-b094-a720e4e03416 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:52.830206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289503c-e24f-49f7-b094-a720e4e03416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:52.832298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289503c-e24f-49f7-b094-a720e4e03416 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:52.860926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1118/2240] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:06:52 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:52.865271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287642a9-b93f-4024-8607-7c163fa0bc31 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:52.876340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287642a9-b93f-4024-8607-7c163fa0bc31 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:52.941901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11498d90-784c-4eb8-9249-81cab057194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:52.942548 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11498d90-784c-4eb8-9249-81cab057194a admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:52.942851 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11498d90-784c-4eb8-9249-81cab057194a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:52.943274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11498d90-784c-4eb8-9249-81cab057194a admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:52.943902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11498d90-784c-4eb8-9249-81cab057194a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:52.945808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11498d90-784c-4eb8-9249-81cab057194a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:52.966488 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1123/2241] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:06:52 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:52.970629 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289503c-e24f-49f7-b094-a720e4e03416 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:52.981434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289503c-e24f-49f7-b094-a720e4e03416 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:52.986511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876dbd4-fc87-4070-b51b-28f7bb61b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:52.987206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876dbd4-fc87-4070-b51b-28f7bb61b7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:52.987494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876dbd4-fc87-4070-b51b-28f7bb61b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:52.987771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876dbd4-fc87-4070-b51b-28f7bb61b7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:52.988506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876dbd4-fc87-4070-b51b-28f7bb61b7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:52.990227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876dbd4-fc87-4070-b51b-28f7bb61b7c1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:53.002536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1119/2242] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:06:53.006865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11498d90-784c-4eb8-9249-81cab057194a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:53.017800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11498d90-784c-4eb8-9249-81cab057194a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:53.023031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad38bf-4daa-4ce9-9e91-e190c773143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:53.023638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad38bf-4daa-4ce9-9e91-e190c773143f admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:53.023919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad38bf-4daa-4ce9-9e91-e190c773143f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:53.024199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad38bf-4daa-4ce9-9e91-e190c773143f admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:53.024923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad38bf-4daa-4ce9-9e91-e190c773143f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:53.026525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad38bf-4daa-4ce9-9e91-e190c773143f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:53.036603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1124/2243] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:53.041361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876dbd4-fc87-4070-b51b-28f7bb61b7c1 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:53.051516 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876dbd4-fc87-4070-b51b-28f7bb61b7c1 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:53.056931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39fe6a-94f6-4119-80b5-2c2456b8dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:53.057819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39fe6a-94f6-4119-80b5-2c2456b8dab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:53.058099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39fe6a-94f6-4119-80b5-2c2456b8dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:53.058373 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39fe6a-94f6-4119-80b5-2c2456b8dab8 admin admin] PATH_INFO: `/v3/projects/b759b9cc0493468eab6e5138c879f798/users/9e18b149f81148d1b21556a5bb84177e/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:53.073360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39fe6a-94f6-4119-80b5-2c2456b8dab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b759b9cc0493468eab6e5138c879f798, user_id=9e18b149f81148d1b21556a5bb84177e, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:53.076108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39fe6a-94f6-4119-80b5-2c2456b8dab8 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:53.091992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1120/2244] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:06:53 2022] PUT /identity/v3/projects/b759b9cc0493468eab6e5138c879f798/users/9e18b149f81148d1b21556a5bb84177e/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:53.102344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310675-dbc5-41fe-9ac3-570395f2ca74 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:53.102631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310675-dbc5-41fe-9ac3-570395f2ca74 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:53.102905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310675-dbc5-41fe-9ac3-570395f2ca74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:53.131201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4a310675-dbc5-41fe-9ac3-570395f2ca74 None None] MFA Rules not processed for user `9e18b149f81148d1b21556a5bb84177e`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:53.132461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4a310675-dbc5-41fe-9ac3-570395f2ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:53.205150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1125/2245] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:53.215517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39fe6a-94f6-4119-80b5-2c2456b8dab8 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:53.217279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9d39fe6a-94f6-4119-80b5-2c2456b8dab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:53.244117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:53.301857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39fe6a-94f6-4119-80b5-2c2456b8dab8 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:53.305603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7d86f-72b2-4ebd-9c5b-29125efc5855 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:53.306263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d86f-72b2-4ebd-9c5b-29125efc5855 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:53.306547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d86f-72b2-4ebd-9c5b-29125efc5855 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:53.306824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d86f-72b2-4ebd-9c5b-29125efc5855 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:53.315759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7d86f-72b2-4ebd-9c5b-29125efc5855 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:53.317213 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7d86f-72b2-4ebd-9c5b-29125efc5855 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:53.327828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1121/2246] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:54.588201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a310675-dbc5-41fe-9ac3-570395f2ca74 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:54.590035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4a310675-dbc5-41fe-9ac3-570395f2ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:54.611301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:54.662075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a310675-dbc5-41fe-9ac3-570395f2ca74 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:54.667412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:54.668308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:54.668584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:54.668857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] PATH_INFO: `/v3/users/15350929101e43aaa96446807e333438` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:54.670070 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15350929101e43aaa96446807e333438)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:54.672056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:54.719080 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15350929101e43aaa96446807e333438'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:54.742421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15350929101e43aaa96446807e333438'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:54.751340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15350929101e43aaa96446807e333438'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:54.764351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15350929101e43aaa96446807e333438'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:54.765324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15350929101e43aaa96446807e333438'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:54.772690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1126/2247] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:06:54 2022] DELETE /identity/v3/users/15350929101e43aaa96446807e333438 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:54.777616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a6e03-f263-44c8-b05e-b5d67c3db668 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:54.778151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a6e03-f263-44c8-b05e-b5d67c3db668 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:54.778151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a6e03-f263-44c8-b05e-b5d67c3db668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:54.801129 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-443a6e03-f263-44c8-b05e-b5d67c3db668 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:54.802406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-443a6e03-f263-44c8-b05e-b5d67c3db668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:54.868058 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1122/2248] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:54.877974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:54.879596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:54.942071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96836b06-3b41-4469-ba04-cb3010871299 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:54.946399 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcf7af-d24f-4a72-b369-d3c0b51d50f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:54.947089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcf7af-d24f-4a72-b369-d3c0b51d50f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:54.947569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcf7af-d24f-4a72-b369-d3c0b51d50f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:54.948033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcf7af-d24f-4a72-b369-d3c0b51d50f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:54.958361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcf7af-d24f-4a72-b369-d3c0b51d50f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:54.960623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcf7af-d24f-4a72-b369-d3c0b51d50f5 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:54.970529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1127/2249] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:06:55.285487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a6e03-f263-44c8-b05e-b5d67c3db668 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:55.286953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-443a6e03-f263-44c8-b05e-b5d67c3db668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:55.300102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a6e03-f263-44c8-b05e-b5d67c3db668 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:55.305919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:55.306864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:55.307244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:55.307610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] PATH_INFO: `/v3/projects/7744305ebe95413d9e5d24f9e4880ddf` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:55.308948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7744305ebe95413d9e5d24f9e4880ddf)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:55.311429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:55.361280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7744305ebe95413d9e5d24f9e4880ddf', 'request_id': 'req-9c43ce32-7ac0-4dca-b440-a6cc88580141'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:55.367573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7744305ebe95413d9e5d24f9e4880ddf', 'request_id': 'req-9c43ce32-7ac0-4dca-b440-a6cc88580141'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:55.376972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7744305ebe95413d9e5d24f9e4880ddf', 'request_id': 'req-9c43ce32-7ac0-4dca-b440-a6cc88580141'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:55.387995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] The token cache is being invalidate because project 7744305ebe95413d9e5d24f9e4880ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:06:55.388287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:55.388916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-9c43ce32-7ac0-4dca-b440-a6cc88580141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:06:55.390536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1123/2250] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:06:55 2022] DELETE /identity/v3/projects/7744305ebe95413d9e5d24f9e4880ddf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:55.395759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3ac4f-7fc9-4ad5-a2da-e6c26c278cb0 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:55.396102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3ac4f-7fc9-4ad5-a2da-e6c26c278cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:55.396383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3ac4f-7fc9-4ad5-a2da-e6c26c278cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:55.414042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-bea3ac4f-7fc9-4ad5-a2da-e6c26c278cb0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:55.415288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-bea3ac4f-7fc9-4ad5-a2da-e6c26c278cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:55.448175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:55.480103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1128/2251] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:55.488211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2b80-e1c8-4684-9a3f-5be8af0f56ee None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:55.488501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2b80-e1c8-4684-9a3f-5be8af0f56ee None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:55.488784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2b80-e1c8-4684-9a3f-5be8af0f56ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:55.509347 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-d47c2b80-e1c8-4684-9a3f-5be8af0f56ee None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:55.510560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d47c2b80-e1c8-4684-9a3f-5be8af0f56ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:55.519845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1124/2252] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:55.524299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3ac4f-7fc9-4ad5-a2da-e6c26c278cb0 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:55.536438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3ac4f-7fc9-4ad5-a2da-e6c26c278cb0 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:55.544811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351a76a-d89d-4537-9194-8f548ae89e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:55.545506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351a76a-d89d-4537-9194-8f548ae89e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:55.545793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351a76a-d89d-4537-9194-8f548ae89e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:55.546167 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351a76a-d89d-4537-9194-8f548ae89e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:55.546846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351a76a-d89d-4537-9194-8f548ae89e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:06:55.547214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351a76a-d89d-4537-9194-8f548ae89e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:55.548913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351a76a-d89d-4537-9194-8f548ae89e6a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:55.562587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1129/2253] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:06:55.568668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c2b80-e1c8-4684-9a3f-5be8af0f56ee None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:55.578479 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c2b80-e1c8-4684-9a3f-5be8af0f56ee None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:55.583712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff1ad5-3b81-414e-b759-58e0ba31e577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:55.584075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff1ad5-3b81-414e-b759-58e0ba31e577 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:55.584357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff1ad5-3b81-414e-b759-58e0ba31e577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:55.584633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff1ad5-3b81-414e-b759-58e0ba31e577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:55.585498 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff1ad5-3b81-414e-b759-58e0ba31e577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:55.591092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff1ad5-3b81-414e-b759-58e0ba31e577 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:55.617465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1125/2254] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:06:55 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:06:55.621690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351a76a-d89d-4537-9194-8f548ae89e6a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:55.634698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351a76a-d89d-4537-9194-8f548ae89e6a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:55.695998 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359344-37f2-4986-bd33-63ab71950ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:55.696671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359344-37f2-4986-bd33-63ab71950ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:55.696953 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359344-37f2-4986-bd33-63ab71950ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:55.697227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a359344-37f2-4986-bd33-63ab71950ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:55.697943 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a359344-37f2-4986-bd33-63ab71950ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:55.699949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a359344-37f2-4986-bd33-63ab71950ff0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:55.720897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1130/2255] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:06:55 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:06:55.725107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff1ad5-3b81-414e-b759-58e0ba31e577 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:55.740030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff1ad5-3b81-414e-b759-58e0ba31e577 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:55.744996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cca01-c759-4cda-b432-dccd7528482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:55.745695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cca01-c759-4cda-b432-dccd7528482f admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:55.745977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cca01-c759-4cda-b432-dccd7528482f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:55.746250 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cca01-c759-4cda-b432-dccd7528482f admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:55.747003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cca01-c759-4cda-b432-dccd7528482f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:55.748697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871cca01-c759-4cda-b432-dccd7528482f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:55.759521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1126/2256] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:55.763864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359344-37f2-4986-bd33-63ab71950ff0 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:55.775279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a359344-37f2-4986-bd33-63ab71950ff0 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:55.779858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ef075-52f9-4fec-a5ce-2520f7ab8e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:55.780522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ef075-52f9-4fec-a5ce-2520f7ab8e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:55.780802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ef075-52f9-4fec-a5ce-2520f7ab8e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:55.781074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ef075-52f9-4fec-a5ce-2520f7ab8e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:55.781800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ef075-52f9-4fec-a5ce-2520f7ab8e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:55.783442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ef075-52f9-4fec-a5ce-2520f7ab8e8b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:55.802433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1131/2257] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:06:55.806723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cca01-c759-4cda-b432-dccd7528482f admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:55.817053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871cca01-c759-4cda-b432-dccd7528482f admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:55.823291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9531fa3-c011-4d0e-873a-115fb3a82309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:55.824553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9531fa3-c011-4d0e-873a-115fb3a82309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:55.825005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9531fa3-c011-4d0e-873a-115fb3a82309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:55.825354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9531fa3-c011-4d0e-873a-115fb3a82309 admin admin] PATH_INFO: `/v3/projects/0b33733a3b39461ab63ff7140128e7ce/users/49059d953be94de289fb763de046e445/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:55.827896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:06:55.843053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9531fa3-c011-4d0e-873a-115fb3a82309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b33733a3b39461ab63ff7140128e7ce, user_id=49059d953be94de289fb763de046e445, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:55.845735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9531fa3-c011-4d0e-873a-115fb3a82309 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:55.859604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1127/2258] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:06:55 2022] PUT /identity/v3/projects/0b33733a3b39461ab63ff7140128e7ce/users/49059d953be94de289fb763de046e445/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:06:55.870350 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d81c3-c3cf-4821-b2a1-9f03ba0b2e3b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:55.870671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d81c3-c3cf-4821-b2a1-9f03ba0b2e3b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:55.870951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d81c3-c3cf-4821-b2a1-9f03ba0b2e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:55.899719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-385d81c3-c3cf-4821-b2a1-9f03ba0b2e3b None None] MFA Rules not processed for user `49059d953be94de289fb763de046e445`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:06:55.900922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-385d81c3-c3cf-4821-b2a1-9f03ba0b2e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:55.967513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1132/2259] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:06:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:06:55.978641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9531fa3-c011-4d0e-873a-115fb3a82309 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:06:55.980437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e9531fa3-c011-4d0e-873a-115fb3a82309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:06:56.046357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9531fa3-c011-4d0e-873a-115fb3a82309 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:06:56.050397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c44613-f930-47b5-b74d-b226f936d8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:06:56.051077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c44613-f930-47b5-b74d-b226f936d8ab service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:06:56.051360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c44613-f930-47b5-b74d-b226f936d8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:06:56.061872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c44613-f930-47b5-b74d-b226f936d8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:06:56.073756 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c44613-f930-47b5-b74d-b226f936d8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:06:56.075289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c44613-f930-47b5-b74d-b226f936d8ab service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:06:56.085585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1128/2260] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:06:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:03.331631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54632-9992-4c03-8015-96cd28b4f141 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:03.332171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54632-9992-4c03-8015-96cd28b4f141 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:03.332171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54632-9992-4c03-8015-96cd28b4f141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:03.350888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-1dd54632-9992-4c03-8015-96cd28b4f141 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:03.352179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1dd54632-9992-4c03-8015-96cd28b4f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:03.386294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:03.412504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1133/2261] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:07:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:03.455721 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c44613-f930-47b5-b74d-b226f936d8ab service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:03.457410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-98c44613-f930-47b5-b74d-b226f936d8ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:03.527497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c44613-f930-47b5-b74d-b226f936d8ab service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:03.532851 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff69a1b-5d34-4396-b428-a6df2c2e411d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:03.533519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff69a1b-5d34-4396-b428-a6df2c2e411d service swift] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:03.534329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff69a1b-5d34-4396-b428-a6df2c2e411d service swift] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:03.534329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff69a1b-5d34-4396-b428-a6df2c2e411d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:03.543655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff69a1b-5d34-4396-b428-a6df2c2e411d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:03.545267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff69a1b-5d34-4396-b428-a6df2c2e411d service swift] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:03.553465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1129/2262] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:07:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:07:05.032834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54632-9992-4c03-8015-96cd28b4f141 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:05.034273 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1dd54632-9992-4c03-8015-96cd28b4f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:05.147531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54632-9992-4c03-8015-96cd28b4f141 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:05.156692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:05.158729 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:05.159157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:05.159814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] PATH_INFO: `/v3/users/9e18b149f81148d1b21556a5bb84177e` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:05.162446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e18b149f81148d1b21556a5bb84177e)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:05.166106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:05.273431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e18b149f81148d1b21556a5bb84177e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:05.300106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e18b149f81148d1b21556a5bb84177e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:05.314396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e18b149f81148d1b21556a5bb84177e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:05.325649 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e18b149f81148d1b21556a5bb84177e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:05.326967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e18b149f81148d1b21556a5bb84177e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:05.343791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1134/2263] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:07:05 2022] DELETE /identity/v3/users/9e18b149f81148d1b21556a5bb84177e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:07:05.347881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819005-ca74-4938-92fd-f1200fb4534f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:05.348446 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819005-ca74-4938-92fd-f1200fb4534f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:05.348446 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819005-ca74-4938-92fd-f1200fb4534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:05.383680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-d1819005-ca74-4938-92fd-f1200fb4534f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:05.385207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d1819005-ca74-4938-92fd-f1200fb4534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:05.474024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1130/2264] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:05.487176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:05.488776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:05.565541 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825988a-05bb-452f-8fe2-504acbf4bf0c admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:05.570519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61697fc7-3ad4-4884-af7c-b551db492599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:05.571926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61697fc7-3ad4-4884-af7c-b551db492599 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:05.572096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61697fc7-3ad4-4884-af7c-b551db492599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:05.572689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61697fc7-3ad4-4884-af7c-b551db492599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:05.585093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61697fc7-3ad4-4884-af7c-b551db492599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:05.586786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61697fc7-3ad4-4884-af7c-b551db492599 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:05.599409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1135/2265] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:05.929709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819005-ca74-4938-92fd-f1200fb4534f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:05.931397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d1819005-ca74-4938-92fd-f1200fb4534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:05.950256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819005-ca74-4938-92fd-f1200fb4534f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:05.955666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:05.956594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:05.956837 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:05.957133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] PATH_INFO: `/v3/projects/b759b9cc0493468eab6e5138c879f798` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:05.958540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b759b9cc0493468eab6e5138c879f798)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:05.960874 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:05.972257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:06.016353 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b759b9cc0493468eab6e5138c879f798', 'request_id': 'req-ac5552c8-6009-4681-a014-6346fd3ccdbf'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:06.024455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b759b9cc0493468eab6e5138c879f798', 'request_id': 'req-ac5552c8-6009-4681-a014-6346fd3ccdbf'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:06.067891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b759b9cc0493468eab6e5138c879f798', 'request_id': 'req-ac5552c8-6009-4681-a014-6346fd3ccdbf'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:06.085882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] The token cache is being invalidate because project b759b9cc0493468eab6e5138c879f798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:07:06.086523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:06.088082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ac5552c8-6009-4681-a014-6346fd3ccdbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:06.091651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1131/2266] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:07:05 2022] DELETE /identity/v3/projects/b759b9cc0493468eab6e5138c879f798 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:07:07.615795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61697fc7-3ad4-4884-af7c-b551db492599 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:07.617941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-61697fc7-3ad4-4884-af7c-b551db492599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:07.627091 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:07.633019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61697fc7-3ad4-4884-af7c-b551db492599 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:07.692854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:07.693758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:07.694036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:07.694309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] PATH_INFO: `/v3/users/49059d953be94de289fb763de046e445` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:07.695554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] RBAC: Authorizing `identity:delete_user(user_id=49059d953be94de289fb763de046e445)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:07.697538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:07.745682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49059d953be94de289fb763de046e445'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:07.761328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49059d953be94de289fb763de046e445'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:07.773941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49059d953be94de289fb763de046e445'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:07.794408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49059d953be94de289fb763de046e445'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:07.795486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49059d953be94de289fb763de046e445'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:07.816735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1136/2267] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:07:07 2022] DELETE /identity/v3/users/49059d953be94de289fb763de046e445 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:07:07.821061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdfa5f-c850-4a9e-9aa1-20ebfd8b403f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:07.821636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdfa5f-c850-4a9e-9aa1-20ebfd8b403f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:07.821736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdfa5f-c850-4a9e-9aa1-20ebfd8b403f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:07.843559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-35fdfa5f-c850-4a9e-9aa1-20ebfd8b403f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:07.844791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-35fdfa5f-c850-4a9e-9aa1-20ebfd8b403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:07.902564 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1132/2268] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:07.912584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:07.914121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:07.985515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd36904-c48b-4721-83d3-fbace2c1082f admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:07.989751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01463bff-412a-45b6-a256-0eb06449e6b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:07.990528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463bff-412a-45b6-a256-0eb06449e6b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:07.991081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463bff-412a-45b6-a256-0eb06449e6b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:07.991433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463bff-412a-45b6-a256-0eb06449e6b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:08.006014 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01463bff-412a-45b6-a256-0eb06449e6b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:08.007639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01463bff-412a-45b6-a256-0eb06449e6b1 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:08.037683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1137/2269] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:08.406700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdfa5f-c850-4a9e-9aa1-20ebfd8b403f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:08.408458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-35fdfa5f-c850-4a9e-9aa1-20ebfd8b403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:08.435256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdfa5f-c850-4a9e-9aa1-20ebfd8b403f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:08.441148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:08.442455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:08.442904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:08.444943 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] PATH_INFO: `/v3/projects/0b33733a3b39461ab63ff7140128e7ce` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:08.446700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b33733a3b39461ab63ff7140128e7ce)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:08.449046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:08.617110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b33733a3b39461ab63ff7140128e7ce', 'request_id': 'req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:08.625210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b33733a3b39461ab63ff7140128e7ce', 'request_id': 'req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:08.634730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b33733a3b39461ab63ff7140128e7ce', 'request_id': 'req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:08.650326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] The token cache is being invalidate because project 0b33733a3b39461ab63ff7140128e7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:07:08.650630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:08.651960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3693e21d-239f-4dcb-8160-64ab7c8f3ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:08.658866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f0d9e-4647-4b29-a6c4-a61c0de22799 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:08.659462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f0d9e-4647-4b29-a6c4-a61c0de22799 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:08.659550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f0d9e-4647-4b29-a6c4-a61c0de22799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:08.660904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1133/2270] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:07:08 2022] DELETE /identity/v3/projects/0b33733a3b39461ab63ff7140128e7ce => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:07:08.685158 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-977f0d9e-4647-4b29-a6c4-a61c0de22799 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:08.694334 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-977f0d9e-4647-4b29-a6c4-a61c0de22799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:08.728235 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:08.787526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1138/2271] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:08.790268 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2703b4-b585-447d-bbad-a409dbbcf35d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:08.790649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2703b4-b585-447d-bbad-a409dbbcf35d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:08.790887 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2703b4-b585-447d-bbad-a409dbbcf35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:08.818120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2d2703b4-b585-447d-bbad-a409dbbcf35d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:08.819343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2d2703b4-b585-447d-bbad-a409dbbcf35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:08.827745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1134/2272] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:08.832377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f0d9e-4647-4b29-a6c4-a61c0de22799 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:08.849841 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f0d9e-4647-4b29-a6c4-a61c0de22799 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:08.856865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3952661-f384-491a-8e11-d8d9812a281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:08.857769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3952661-f384-491a-8e11-d8d9812a281b admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:08.858115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3952661-f384-491a-8e11-d8d9812a281b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:08.858471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3952661-f384-491a-8e11-d8d9812a281b admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:08.859388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3952661-f384-491a-8e11-d8d9812a281b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:07:08.859823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3952661-f384-491a-8e11-d8d9812a281b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:08.861628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3952661-f384-491a-8e11-d8d9812a281b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:08.876505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1139/2273] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:07:08.881054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2703b4-b585-447d-bbad-a409dbbcf35d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:08.909140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2703b4-b585-447d-bbad-a409dbbcf35d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:08.915884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5301-a891-4936-9ed7-ef22eb1f6b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:08.916836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5301-a891-4936-9ed7-ef22eb1f6b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:08.917178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5301-a891-4936-9ed7-ef22eb1f6b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:08.917513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5301-a891-4936-9ed7-ef22eb1f6b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:08.918276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5301-a891-4936-9ed7-ef22eb1f6b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:08.920292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5301-a891-4936-9ed7-ef22eb1f6b0d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:08.937480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:08.959759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1135/2274] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:07:08 2022] POST /identity/v3/projects => generated 397 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:07:08.964481 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3952661-f384-491a-8e11-d8d9812a281b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:08.986563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3952661-f384-491a-8e11-d8d9812a281b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:09.084175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf97d8-0a19-4069-9f78-b84e96f35c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:09.085094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf97d8-0a19-4069-9f78-b84e96f35c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:09.085440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf97d8-0a19-4069-9f78-b84e96f35c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:09.085778 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf97d8-0a19-4069-9f78-b84e96f35c1b admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:09.086560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf97d8-0a19-4069-9f78-b84e96f35c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:09.089051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf97d8-0a19-4069-9f78-b84e96f35c1b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:09.117632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1140/2275] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:07:08 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:07:09.119015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5301-a891-4936-9ed7-ef22eb1f6b0d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:09.129511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5301-a891-4936-9ed7-ef22eb1f6b0d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:09.134656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26512-f7ba-4fa7-9b88-1a507e67dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:09.135558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26512-f7ba-4fa7-9b88-1a507e67dc1e admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:09.136572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26512-f7ba-4fa7-9b88-1a507e67dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:09.137051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26512-f7ba-4fa7-9b88-1a507e67dc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:09.137915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec26512-f7ba-4fa7-9b88-1a507e67dc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:09.139875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec26512-f7ba-4fa7-9b88-1a507e67dc1e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:09.158258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1136/2276] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:07:09.162764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf97d8-0a19-4069-9f78-b84e96f35c1b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:09.173308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf97d8-0a19-4069-9f78-b84e96f35c1b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:09.180699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf02689-949b-46b4-9d28-0d19f6cc6664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:09.181405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf02689-949b-46b4-9d28-0d19f6cc6664 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:09.181685 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf02689-949b-46b4-9d28-0d19f6cc6664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:09.181957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf02689-949b-46b4-9d28-0d19f6cc6664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:09.182696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf02689-949b-46b4-9d28-0d19f6cc6664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:09.184400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf02689-949b-46b4-9d28-0d19f6cc6664 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:09.198370 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1141/2277] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:07:09.199823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26512-f7ba-4fa7-9b88-1a507e67dc1e admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:09.215749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26512-f7ba-4fa7-9b88-1a507e67dc1e admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:09.221898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd579bf-f876-47c5-9043-3d37b3dadff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:09.224149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd579bf-f876-47c5-9043-3d37b3dadff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:09.224149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd579bf-f876-47c5-9043-3d37b3dadff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:09.224149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd579bf-f876-47c5-9043-3d37b3dadff2 admin admin] PATH_INFO: `/v3/projects/4c9b24ef3f1e44a9b63b529bb27cfb73/users/b20ad76693e44c59bdb8373b2b9ae0f0/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:09.244534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd579bf-f876-47c5-9043-3d37b3dadff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9b24ef3f1e44a9b63b529bb27cfb73, user_id=b20ad76693e44c59bdb8373b2b9ae0f0, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:09.247467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd579bf-f876-47c5-9043-3d37b3dadff2 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:09.267616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1137/2278] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:07:09 2022] PUT /identity/v3/projects/4c9b24ef3f1e44a9b63b529bb27cfb73/users/b20ad76693e44c59bdb8373b2b9ae0f0/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:07:09.276383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33c00-cab3-4886-bbef-19e39a1abc91 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:09.276725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33c00-cab3-4886-bbef-19e39a1abc91 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:09.277026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33c00-cab3-4886-bbef-19e39a1abc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:09.306105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-38d33c00-cab3-4886-bbef-19e39a1abc91 None None] MFA Rules not processed for user `b20ad76693e44c59bdb8373b2b9ae0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:09.307408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-38d33c00-cab3-4886-bbef-19e39a1abc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:09.418079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1142/2279] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:09.431428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd579bf-f876-47c5-9043-3d37b3dadff2 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:09.433237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cdd579bf-f876-47c5-9043-3d37b3dadff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:09.509393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd579bf-f876-47c5-9043-3d37b3dadff2 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:09.514129 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665c392-5142-449e-8636-0ae6e20be4d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:09.515069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665c392-5142-449e-8636-0ae6e20be4d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:09.515404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665c392-5142-449e-8636-0ae6e20be4d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:09.515911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665c392-5142-449e-8636-0ae6e20be4d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:09.528882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665c392-5142-449e-8636-0ae6e20be4d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:09.530348 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665c392-5142-449e-8636-0ae6e20be4d3 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:09.540492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1138/2280] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:15.836834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d33c00-cab3-4886-bbef-19e39a1abc91 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:15.858969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:16.024088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d33c00-cab3-4886-bbef-19e39a1abc91 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:16.029027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:16.029923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:16.030200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:16.030480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] PATH_INFO: `/v3/users/b20ad76693e44c59bdb8373b2b9ae0f0` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:16.031724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20ad76693e44c59bdb8373b2b9ae0f0)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:16.033700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:16.099892 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20ad76693e44c59bdb8373b2b9ae0f0'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:16.112713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20ad76693e44c59bdb8373b2b9ae0f0'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:16.122042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20ad76693e44c59bdb8373b2b9ae0f0'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:16.130353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20ad76693e44c59bdb8373b2b9ae0f0'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:16.131047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20ad76693e44c59bdb8373b2b9ae0f0'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:16.137531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1143/2281] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:07:15 2022] DELETE /identity/v3/users/b20ad76693e44c59bdb8373b2b9ae0f0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:07:16.142270 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff1501-c206-4289-b4f8-f9f9194f1649 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:16.142898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff1501-c206-4289-b4f8-f9f9194f1649 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:16.142898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff1501-c206-4289-b4f8-f9f9194f1649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:16.199981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-75ff1501-c206-4289-b4f8-f9f9194f1649 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:16.201813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-75ff1501-c206-4289-b4f8-f9f9194f1649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:16.286047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1139/2282] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:16.295405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:16.296926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:16.371175 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:16.409886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaadb7-f548-401d-baa3-c5310f95cd62 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:16.416840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be223cf-fe40-49fd-8e99-839d62bd5440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:16.417987 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be223cf-fe40-49fd-8e99-839d62bd5440 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:16.418286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be223cf-fe40-49fd-8e99-839d62bd5440 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:16.418563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be223cf-fe40-49fd-8e99-839d62bd5440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:16.430189 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be223cf-fe40-49fd-8e99-839d62bd5440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:16.431948 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be223cf-fe40-49fd-8e99-839d62bd5440 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:16.443990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1144/2283] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:16.793339 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff1501-c206-4289-b4f8-f9f9194f1649 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:16.795050 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-75ff1501-c206-4289-b4f8-f9f9194f1649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:16.814133 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff1501-c206-4289-b4f8-f9f9194f1649 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:16.820565 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:16.834718 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:16.835702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:16.836179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] PATH_INFO: `/v3/projects/4c9b24ef3f1e44a9b63b529bb27cfb73` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:16.838079 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c9b24ef3f1e44a9b63b529bb27cfb73)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:16.841418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:16.936318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:DELETE=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:16.957714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c9b24ef3f1e44a9b63b529bb27cfb73', 'request_id': 'req-56a9c770-aa17-416e-b2e8-c7be8015c24b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:16.966872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c9b24ef3f1e44a9b63b529bb27cfb73', 'request_id': 'req-56a9c770-aa17-416e-b2e8-c7be8015c24b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:16.978858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c9b24ef3f1e44a9b63b529bb27cfb73', 'request_id': 'req-56a9c770-aa17-416e-b2e8-c7be8015c24b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:16.995651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] The token cache is being invalidate because project 4c9b24ef3f1e44a9b63b529bb27cfb73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:07:16.995938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:16.996700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:16.998463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1140/2284] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:07:16 2022] DELETE /identity/v3/projects/4c9b24ef3f1e44a9b63b529bb27cfb73 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:07:19.520206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad8eb4-dc7a-4809-9acc-a95952917734 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:19.520847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad8eb4-dc7a-4809-9acc-a95952917734 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:19.520847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad8eb4-dc7a-4809-9acc-a95952917734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:19.567467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-a6ad8eb4-dc7a-4809-9acc-a95952917734 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:19.568726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a6ad8eb4-dc7a-4809-9acc-a95952917734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:19.644018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1145/2285] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Jun 26 03:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:19.672750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:19.674411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:19.788219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9c770-aa17-416e-b2e8-c7be8015c24b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:19.794683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ef368-af22-40aa-888d-d41e8f84ee2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:19.797882 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ef368-af22-40aa-888d-d41e8f84ee2c service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:19.798302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ef368-af22-40aa-888d-d41e8f84ee2c service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:19.798493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ef368-af22-40aa-888d-d41e8f84ee2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:19.808571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ef368-af22-40aa-888d-d41e8f84ee2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:19.810732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ef368-af22-40aa-888d-d41e8f84ee2c service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:19.836194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1141/2286] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:20.039678 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614966a7-3762-42ea-baef-555f80787a99 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:20.040069 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614966a7-3762-42ea-baef-555f80787a99 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:20.040255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614966a7-3762-42ea-baef-555f80787a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:20.078202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-614966a7-3762-42ea-baef-555f80787a99 None None] MFA Rules not processed for user `3e291616a6574581af9e778d5849ccca`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:20.079511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-614966a7-3762-42ea-baef-555f80787a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:20.152280 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1146/2287] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:24.297411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca2435-c491-4ec5-bf49-7682bc4311c2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:24.298105 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca2435-c491-4ec5-bf49-7682bc4311c2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:24.298448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca2435-c491-4ec5-bf49-7682bc4311c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:24.326522 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-92ca2435-c491-4ec5-bf49-7682bc4311c2 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:24.327846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-92ca2435-c491-4ec5-bf49-7682bc4311c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:24.400565 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1142/2288] 10.222.0.36 () {58 vars in 967 bytes} [Sun Jun 26 03:07:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:24.415559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614966a7-3762-42ea-baef-555f80787a99 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:24.417971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-614966a7-3762-42ea-baef-555f80787a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:24.488062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:24.514204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614966a7-3762-42ea-baef-555f80787a99 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:24.520874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa8dda-a953-49b0-abda-f4aca61b2067 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:24.521544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8dda-a953-49b0-abda-f4aca61b2067 service swift] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:24.521828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8dda-a953-49b0-abda-f4aca61b2067 service swift] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:24.522108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa8dda-a953-49b0-abda-f4aca61b2067 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:24.533172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa8dda-a953-49b0-abda-f4aca61b2067 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:24.534945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa8dda-a953-49b0-abda-f4aca61b2067 service swift] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:24.563176 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1147/2289] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:07:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:07:24.724706 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7083d-489e-48a2-aace-5bcdb201a6f6 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:24.725003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7083d-489e-48a2-aace-5bcdb201a6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:24.725287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7083d-489e-48a2-aace-5bcdb201a6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:24.773459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-35e7083d-489e-48a2-aace-5bcdb201a6f6 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:24.775622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-35e7083d-489e-48a2-aace-5bcdb201a6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:24.791787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1143/2290] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Jun 26 03:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:24.812676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa8dda-a953-49b0-abda-f4aca61b2067 service swift] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:24.814643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-defa8dda-a953-49b0-abda-f4aca61b2067 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:24.835328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa8dda-a953-49b0-abda-f4aca61b2067 service swift] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:24.841907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6fe44-0eb7-4e31-b201-e69dbfd51bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:24.842674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6fe44-0eb7-4e31-b201-e69dbfd51bfa service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:24.843105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6fe44-0eb7-4e31-b201-e69dbfd51bfa service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:24.843444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6fe44-0eb7-4e31-b201-e69dbfd51bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:24.869104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6fe44-0eb7-4e31-b201-e69dbfd51bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:24.871226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6fe44-0eb7-4e31-b201-e69dbfd51bfa service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:24.884976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1148/2291] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:26.664126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d65891-88fa-4a5e-99c8-4bc2939975bd None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:26.664537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d65891-88fa-4a5e-99c8-4bc2939975bd None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:26.664841 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d65891-88fa-4a5e-99c8-4bc2939975bd None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:26.666828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1144/2292] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 03:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:07:26.671884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a19af-181e-414d-998b-6992d9096245 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:26.672315 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a19af-181e-414d-998b-6992d9096245 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:26.672486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a19af-181e-414d-998b-6992d9096245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:26.726232 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-100a19af-181e-414d-998b-6992d9096245 None None] MFA Rules not processed for user `5ae5f8f789424969bd575f7360847261`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:26.727486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-100a19af-181e-414d-998b-6992d9096245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:26.757834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d65891-88fa-4a5e-99c8-4bc2939975bd None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:26.760164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-22d65891-88fa-4a5e-99c8-4bc2939975bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:26.781758 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d65891-88fa-4a5e-99c8-4bc2939975bd None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:26.788559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6d755-6502-4559-8d44-2c94af4beb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:26.789597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6d755-6502-4559-8d44-2c94af4beb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:26.789872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6d755-6502-4559-8d44-2c94af4beb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:26.790141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6d755-6502-4559-8d44-2c94af4beb80 admin admin] PATH_INFO: `/v3/users/254142727a204898ae81fb80aad4d438` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:26.791658 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6d755-6502-4559-8d44-2c94af4beb80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=254142727a204898ae81fb80aad4d438)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:26.793739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6d755-6502-4559-8d44-2c94af4beb80 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:26.818829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:26.821574 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1149/2293] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 03:07:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:26.838108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a19af-181e-414d-998b-6992d9096245 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:26.840723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-100a19af-181e-414d-998b-6992d9096245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:26.856075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-97f6d755-6502-4559-8d44-2c94af4beb80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254142727a204898ae81fb80aad4d438'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:26.858489 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a19af-181e-414d-998b-6992d9096245 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:26.863784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b115b-5e9f-4ea4-a4d6-da66b3f1ad1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:26.864523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b115b-5e9f-4ea4-a4d6-da66b3f1ad1e service placement] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:26.864876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b115b-5e9f-4ea4-a4d6-da66b3f1ad1e service placement] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:26.865218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b115b-5e9f-4ea4-a4d6-da66b3f1ad1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:26.870197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-97f6d755-6502-4559-8d44-2c94af4beb80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254142727a204898ae81fb80aad4d438'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:26.870957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-97f6d755-6502-4559-8d44-2c94af4beb80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254142727a204898ae81fb80aad4d438'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:26.874274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b115b-5e9f-4ea4-a4d6-da66b3f1ad1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:26.876031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b115b-5e9f-4ea4-a4d6-da66b3f1ad1e service placement] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:26.878243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-97f6d755-6502-4559-8d44-2c94af4beb80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254142727a204898ae81fb80aad4d438'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:26.878917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-97f6d755-6502-4559-8d44-2c94af4beb80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254142727a204898ae81fb80aad4d438'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:26.886273 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1150/2294] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:26.893900 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1145/2295] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:07:26 2022] DELETE /identity/v3/users/254142727a204898ae81fb80aad4d438 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:07:27.081356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b115b-5e9f-4ea4-a4d6-da66b3f1ad1e service placement] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:27.094030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b115b-5e9f-4ea4-a4d6-da66b3f1ad1e service placement] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:27.160936 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:27.162207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:27.162495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:27.162773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] PATH_INFO: `/v3/projects/1f7803be5c2a4da0966ad063d4358f2c` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:27.164157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7803be5c2a4da0966ad063d4358f2c)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:27.166202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:27.197403 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:27.222277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7803be5c2a4da0966ad063d4358f2c', 'request_id': 'req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:27.228826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7803be5c2a4da0966ad063d4358f2c', 'request_id': 'req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:27.238463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7803be5c2a4da0966ad063d4358f2c', 'request_id': 'req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:27.249662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] The token cache is being invalidate because project 1f7803be5c2a4da0966ad063d4358f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:07:27.249944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:27.250674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ed4e5e35-1216-4a5d-b60c-4cc6dec833fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:07:27.252293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1151/2296] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:07:27 2022] DELETE /identity/v3/projects/1f7803be5c2a4da0966ad063d4358f2c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:07:27.258776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899bf88-7653-4001-bd7f-ce12964a4478 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:27.259108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899bf88-7653-4001-bd7f-ce12964a4478 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:27.259391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899bf88-7653-4001-bd7f-ce12964a4478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:27.278765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5899bf88-7653-4001-bd7f-ce12964a4478 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:27.280022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5899bf88-7653-4001-bd7f-ce12964a4478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:27.340266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1146/2297] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:27.349220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869ebd-521c-4f9d-9262-09b495c8f033 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:27.349583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869ebd-521c-4f9d-9262-09b495c8f033 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:27.349860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14869ebd-521c-4f9d-9262-09b495c8f033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:27.368580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-14869ebd-521c-4f9d-9262-09b495c8f033 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:27.369783 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-14869ebd-521c-4f9d-9262-09b495c8f033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:27.378546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1152/2298] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:07:27.382869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899bf88-7653-4001-bd7f-ce12964a4478 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:27.393174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899bf88-7653-4001-bd7f-ce12964a4478 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:27.398520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25ef0a-a49c-4590-9bca-26173e25eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:27.399228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ef0a-a49c-4590-9bca-26173e25eecb admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:27.399652 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ef0a-a49c-4590-9bca-26173e25eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:27.399920 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25ef0a-a49c-4590-9bca-26173e25eecb admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:27.400681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25ef0a-a49c-4590-9bca-26173e25eecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:07:27.400989 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25ef0a-a49c-4590-9bca-26173e25eecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:27.402610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25ef0a-a49c-4590-9bca-26173e25eecb admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:27.415517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1147/2299] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:07:27.419837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14869ebd-521c-4f9d-9262-09b495c8f033 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:27.429527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14869ebd-521c-4f9d-9262-09b495c8f033 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:27.435503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b611a0-33ca-495a-8217-04f5c4ffb306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:27.436161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b611a0-33ca-495a-8217-04f5c4ffb306 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:27.436452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b611a0-33ca-495a-8217-04f5c4ffb306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:27.436731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b611a0-33ca-495a-8217-04f5c4ffb306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:27.437418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b611a0-33ca-495a-8217-04f5c4ffb306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:27.439499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b611a0-33ca-495a-8217-04f5c4ffb306 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:27.467757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1153/2300] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:07:27 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:07:27.472385 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25ef0a-a49c-4590-9bca-26173e25eecb admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:27.482597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25ef0a-a49c-4590-9bca-26173e25eecb admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:27.540017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf429-b2f1-41f4-872d-269a27ebe894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:27.540688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf429-b2f1-41f4-872d-269a27ebe894 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:27.540957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf429-b2f1-41f4-872d-269a27ebe894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:27.541226 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf429-b2f1-41f4-872d-269a27ebe894 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:27.541904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcf429-b2f1-41f4-872d-269a27ebe894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:27.544067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcf429-b2f1-41f4-872d-269a27ebe894 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:27.565791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1148/2301] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:07:27 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:07:27.570019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b611a0-33ca-495a-8217-04f5c4ffb306 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:27.580637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b611a0-33ca-495a-8217-04f5c4ffb306 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:27.585849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c46ca-32df-446e-8ee5-5fd2c796e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:27.586504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c46ca-32df-446e-8ee5-5fd2c796e975 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:27.586780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c46ca-32df-446e-8ee5-5fd2c796e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:27.587089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c46ca-32df-446e-8ee5-5fd2c796e975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:27.587799 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c46ca-32df-446e-8ee5-5fd2c796e975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:27.589424 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c46ca-32df-446e-8ee5-5fd2c796e975 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:27.599830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1154/2302] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:07:27.603619 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf429-b2f1-41f4-872d-269a27ebe894 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:27.613640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf429-b2f1-41f4-872d-269a27ebe894 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:27.618187 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46ee0d-9813-4826-873a-ce3dfc64f617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:27.618837 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46ee0d-9813-4826-873a-ce3dfc64f617 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:27.619146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46ee0d-9813-4826-873a-ce3dfc64f617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:27.619418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46ee0d-9813-4826-873a-ce3dfc64f617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:27.620146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46ee0d-9813-4826-873a-ce3dfc64f617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:27.621772 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46ee0d-9813-4826-873a-ce3dfc64f617 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:27.631574 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1149/2303] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:07:27.635740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c46ca-32df-446e-8ee5-5fd2c796e975 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:27.646092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c46ca-32df-446e-8ee5-5fd2c796e975 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:27.652309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca5afd-3421-4692-be8a-a0243990e8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:27.652470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca5afd-3421-4692-be8a-a0243990e8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:27.652671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca5afd-3421-4692-be8a-a0243990e8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:27.652953 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca5afd-3421-4692-be8a-a0243990e8e4 admin admin] PATH_INFO: `/v3/projects/389b33e30a0244d880981ad07e6aa089/users/a3276a47e989448f85cd720d1450baf5/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:27.670443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca5afd-3421-4692-be8a-a0243990e8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389b33e30a0244d880981ad07e6aa089, user_id=a3276a47e989448f85cd720d1450baf5, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:27.673166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca5afd-3421-4692-be8a-a0243990e8e4 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:27.689443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1155/2304] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:07:27 2022] PUT /identity/v3/projects/389b33e30a0244d880981ad07e6aa089/users/a3276a47e989448f85cd720d1450baf5/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:07:27.694748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315aa54-6c3f-4085-9be6-ba516fbc1102 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:27.695214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315aa54-6c3f-4085-9be6-ba516fbc1102 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:27.695365 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315aa54-6c3f-4085-9be6-ba516fbc1102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:27.701683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:27.716277 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0315aa54-6c3f-4085-9be6-ba516fbc1102 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:27.717488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0315aa54-6c3f-4085-9be6-ba516fbc1102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:27.779462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1150/2305] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:27.789800 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca5afd-3421-4692-be8a-a0243990e8e4 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:27.791910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-fbca5afd-3421-4692-be8a-a0243990e8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:27.851027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca5afd-3421-4692-be8a-a0243990e8e4 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:27.855241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645c7d-4135-4689-8486-3cad6a2fb828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:27.855881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645c7d-4135-4689-8486-3cad6a2fb828 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:27.856169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645c7d-4135-4689-8486-3cad6a2fb828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:27.856442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645c7d-4135-4689-8486-3cad6a2fb828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:27.866048 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35645c7d-4135-4689-8486-3cad6a2fb828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:27.867541 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35645c7d-4135-4689-8486-3cad6a2fb828 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:27.877631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1156/2306] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:31.096546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3883c5-8b39-494f-86bf-db877292975a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:31.097061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3883c5-8b39-494f-86bf-db877292975a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:31.097355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3883c5-8b39-494f-86bf-db877292975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:31.118631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fc3883c5-8b39-494f-86bf-db877292975a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:31.120462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fc3883c5-8b39-494f-86bf-db877292975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:31.131551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1151/2307] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Jun 26 03:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:31.153973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645c7d-4135-4689-8486-3cad6a2fb828 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:31.156741 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-35645c7d-4135-4689-8486-3cad6a2fb828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:31.239208 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:31.272573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645c7d-4135-4689-8486-3cad6a2fb828 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:31.278881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf0d4d-81e4-45be-b45c-7b79b8823c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:31.279823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf0d4d-81e4-45be-b45c-7b79b8823c0d service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:31.280106 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf0d4d-81e4-45be-b45c-7b79b8823c0d service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:31.280387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf0d4d-81e4-45be-b45c-7b79b8823c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:31.291127 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf0d4d-81e4-45be-b45c-7b79b8823c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:31.292756 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf0d4d-81e4-45be-b45c-7b79b8823c0d service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:31.304433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1157/2308] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:32.404591 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710426b8-096e-4410-a9ed-7f61d2b071bc None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:32.405107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710426b8-096e-4410-a9ed-7f61d2b071bc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:32.405107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710426b8-096e-4410-a9ed-7f61d2b071bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:32.434246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-710426b8-096e-4410-a9ed-7f61d2b071bc None None] MFA Rules not processed for user `a3276a47e989448f85cd720d1450baf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:32.435491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-710426b8-096e-4410-a9ed-7f61d2b071bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:32.538285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1152/2309] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:32.542971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf0d4d-81e4-45be-b45c-7b79b8823c0d service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:32.554834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf0d4d-81e4-45be-b45c-7b79b8823c0d service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:32.569442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9273-2644-4583-ab16-25aaf790c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:32.570207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9273-2644-4583-ab16-25aaf790c27d admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:32.570680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9273-2644-4583-ab16-25aaf790c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:32.571257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc9273-2644-4583-ab16-25aaf790c27d admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:32.572026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc9273-2644-4583-ab16-25aaf790c27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:32.575163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc9273-2644-4583-ab16-25aaf790c27d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:32.604762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1158/2310] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:07:32 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:07:32.609081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710426b8-096e-4410-a9ed-7f61d2b071bc None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:32.622278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710426b8-096e-4410-a9ed-7f61d2b071bc None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:32.681970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eef529-f582-4fc4-8f23-edb4464bc10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:32.682665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef529-f582-4fc4-8f23-edb4464bc10b admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:32.682950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef529-f582-4fc4-8f23-edb4464bc10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:32.683260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eef529-f582-4fc4-8f23-edb4464bc10b admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:32.683979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eef529-f582-4fc4-8f23-edb4464bc10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:32.685949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eef529-f582-4fc4-8f23-edb4464bc10b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:32.712212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1153/2311] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:07:32 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:07:32.713482 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9273-2644-4583-ab16-25aaf790c27d admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:32.724459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc9273-2644-4583-ab16-25aaf790c27d admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:32.729353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d88f6-5365-4e96-b704-3353cb4ad056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:32.730041 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d88f6-5365-4e96-b704-3353cb4ad056 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:32.730423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d88f6-5365-4e96-b704-3353cb4ad056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:32.730736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d88f6-5365-4e96-b704-3353cb4ad056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:32.731543 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d88f6-5365-4e96-b704-3353cb4ad056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:32.733321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d88f6-5365-4e96-b704-3353cb4ad056 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:32.745611 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1159/2312] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:07:32.749949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eef529-f582-4fc4-8f23-edb4464bc10b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:32.760613 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eef529-f582-4fc4-8f23-edb4464bc10b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:32.767891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c567d-8dda-48d0-90a7-ac784571c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:32.769588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c567d-8dda-48d0-90a7-ac784571c4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:32.769903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c567d-8dda-48d0-90a7-ac784571c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:32.770283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c567d-8dda-48d0-90a7-ac784571c4e5 admin admin] PATH_INFO: `/v3/projects/ca57fa350a464214982cfef398605083/users/9508c6c0bb6d461b91bb74036b81f600/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:32.785369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:32.790652 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c567d-8dda-48d0-90a7-ac784571c4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca57fa350a464214982cfef398605083, user_id=9508c6c0bb6d461b91bb74036b81f600, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:32.795210 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c567d-8dda-48d0-90a7-ac784571c4e5 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:32.816253 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1154/2313] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:07:32 2022] PUT /identity/v3/projects/ca57fa350a464214982cfef398605083/users/9508c6c0bb6d461b91bb74036b81f600/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:07:32.817507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d88f6-5365-4e96-b704-3353cb4ad056 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:32.828048 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d88f6-5365-4e96-b704-3353cb4ad056 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:32.894912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fcde4-202e-4e00-90b9-e18b36f6c881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:32.895712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fcde4-202e-4e00-90b9-e18b36f6c881 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:32.896059 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fcde4-202e-4e00-90b9-e18b36f6c881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:32.896409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fcde4-202e-4e00-90b9-e18b36f6c881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:32.897344 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fcde4-202e-4e00-90b9-e18b36f6c881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:32.899655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fcde4-202e-4e00-90b9-e18b36f6c881 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:32.912775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1160/2314] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:07:32.917281 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c567d-8dda-48d0-90a7-ac784571c4e5 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:32.933025 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c567d-8dda-48d0-90a7-ac784571c4e5 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:32.938013 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2cb6-b31e-4363-9552-0d3ee34008b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:32.939586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2cb6-b31e-4363-9552-0d3ee34008b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:32.940064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2cb6-b31e-4363-9552-0d3ee34008b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:32.940412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2cb6-b31e-4363-9552-0d3ee34008b7 admin admin] PATH_INFO: `/v3/projects/ca57fa350a464214982cfef398605083/users/9508c6c0bb6d461b91bb74036b81f600/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:32.942600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d2cb6-b31e-4363-9552-0d3ee34008b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca57fa350a464214982cfef398605083, user_id=9508c6c0bb6d461b91bb74036b81f600, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:32.945413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d2cb6-b31e-4363-9552-0d3ee34008b7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:32.966919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1155/2315] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:07:32 2022] PUT /identity/v3/projects/ca57fa350a464214982cfef398605083/users/9508c6c0bb6d461b91bb74036b81f600/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:07:36.289525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a58df-02a0-4108-94f2-78bcb297a508 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:36.290051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a58df-02a0-4108-94f2-78bcb297a508 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:36.290051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a58df-02a0-4108-94f2-78bcb297a508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:36.330295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f78a58df-02a0-4108-94f2-78bcb297a508 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:36.338550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f78a58df-02a0-4108-94f2-78bcb297a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:36.468119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1161/2316] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Jun 26 03:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:36.498598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2cb6-b31e-4363-9552-0d3ee34008b7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:36.643562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2cb6-b31e-4363-9552-0d3ee34008b7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:36.650455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abe975-af4a-4df7-904c-59d00143f3e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:36.652030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abe975-af4a-4df7-904c-59d00143f3e8 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:36.652350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abe975-af4a-4df7-904c-59d00143f3e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:36.652642 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abe975-af4a-4df7-904c-59d00143f3e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:36.672876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abe975-af4a-4df7-904c-59d00143f3e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:36.678289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abe975-af4a-4df7-904c-59d00143f3e8 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:36.703445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1156/2317] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:38.987826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8adf44-5fb7-457f-b0b8-bb7fdfd1c36d None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:38.988288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8adf44-5fb7-457f-b0b8-bb7fdfd1c36d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:38.988382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8adf44-5fb7-457f-b0b8-bb7fdfd1c36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:39.018058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6d8adf44-5fb7-457f-b0b8-bb7fdfd1c36d None None] MFA Rules not processed for user `9508c6c0bb6d461b91bb74036b81f600`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:39.020420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6d8adf44-5fb7-457f-b0b8-bb7fdfd1c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:39.084509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:39.137723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1162/2318] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:39.152336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abe975-af4a-4df7-904c-59d00143f3e8 service nova] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:39.165146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abe975-af4a-4df7-904c-59d00143f3e8 service nova] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:39.171770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879483c-7acc-44f7-a2e8-d3ad38ea9c83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:39.172458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879483c-7acc-44f7-a2e8-d3ad38ea9c83 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:39.172741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879483c-7acc-44f7-a2e8-d3ad38ea9c83 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:39.173023 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879483c-7acc-44f7-a2e8-d3ad38ea9c83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:39.251864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879483c-7acc-44f7-a2e8-d3ad38ea9c83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:39.253497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879483c-7acc-44f7-a2e8-d3ad38ea9c83 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:39.263883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1157/2319] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:40.533057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd498-97cd-4066-89f9-eff7ce2c9013 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:40.533568 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd498-97cd-4066-89f9-eff7ce2c9013 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:40.534183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd498-97cd-4066-89f9-eff7ce2c9013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:40.556966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-e05bd498-97cd-4066-89f9-eff7ce2c9013 None None] MFA Rules not processed for user `a3276a47e989448f85cd720d1450baf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:40.558548 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e05bd498-97cd-4066-89f9-eff7ce2c9013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:40.566594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1163/2320] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:07:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:41.636814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12591455-330f-4bf5-b34a-2261396452a5 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:41.637391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12591455-330f-4bf5-b34a-2261396452a5 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:41.637540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12591455-330f-4bf5-b34a-2261396452a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:41.659388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-12591455-330f-4bf5-b34a-2261396452a5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:41.660538 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-12591455-330f-4bf5-b34a-2261396452a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:41.677357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1158/2321] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Jun 26 03:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:41.701957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bd498-97cd-4066-89f9-eff7ce2c9013 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:41.704148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e05bd498-97cd-4066-89f9-eff7ce2c9013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:41.753519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bd498-97cd-4066-89f9-eff7ce2c9013 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:41.758959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3610b-71c9-4644-a433-d37cd3d18616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:41.759673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3610b-71c9-4644-a433-d37cd3d18616 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:41.760136 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3610b-71c9-4644-a433-d37cd3d18616 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:41.760411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3610b-71c9-4644-a433-d37cd3d18616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:41.771118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3610b-71c9-4644-a433-d37cd3d18616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:41.772690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3610b-71c9-4644-a433-d37cd3d18616 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:41.789861 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1164/2322] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:45.822743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444e35c-1748-4f37-b433-d04d743736f5 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:45.823589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444e35c-1748-4f37-b433-d04d743736f5 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:45.823781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444e35c-1748-4f37-b433-d04d743736f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:45.852550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0444e35c-1748-4f37-b433-d04d743736f5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:07:45.853812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0444e35c-1748-4f37-b433-d04d743736f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:45.863698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1159/2323] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Jun 26 03:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:07:45.888059 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3610b-71c9-4644-a433-d37cd3d18616 service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:45.900919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3610b-71c9-4644-a433-d37cd3d18616 service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:45.908759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9801b-9518-446e-adca-fe72e1ab630e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:45.909406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9801b-9518-446e-adca-fe72e1ab630e service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:45.909676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9801b-9518-446e-adca-fe72e1ab630e service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:45.909958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9801b-9518-446e-adca-fe72e1ab630e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:45.920244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9801b-9518-446e-adca-fe72e1ab630e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:45.921857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9801b-9518-446e-adca-fe72e1ab630e service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:45.931928 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1165/2324] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:07:55.847029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=83,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:55.927483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=36 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:07:58.508236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444e35c-1748-4f37-b433-d04d743736f5 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:07:58.509645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0444e35c-1748-4f37-b433-d04d743736f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:58.591067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444e35c-1748-4f37-b433-d04d743736f5 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:07:58.596403 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8eff8-975f-4409-ae71-c649079c2571 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:07:58.597059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8eff8-975f-4409-ae71-c649079c2571 service placement] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:07:58.597344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8eff8-975f-4409-ae71-c649079c2571 service placement] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:07:58.597621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8eff8-975f-4409-ae71-c649079c2571 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:07:58.599562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a5a8eff8-975f-4409-ae71-c649079c2571 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:07:58.611525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8eff8-975f-4409-ae71-c649079c2571 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:07:58.613128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8eff8-975f-4409-ae71-c649079c2571 service placement] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:07:58.623036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1160/2325] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:07:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:08:04.422971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891ae98-0f2c-4313-947f-979cb129be1f None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:04.423497 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891ae98-0f2c-4313-947f-979cb129be1f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:04.423589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891ae98-0f2c-4313-947f-979cb129be1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:04.443099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8891ae98-0f2c-4313-947f-979cb129be1f None None] MFA Rules not processed for user `82e0e24e4f1c44e88b41f2c05fc254d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:08:04.444754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8891ae98-0f2c-4313-947f-979cb129be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:08:04.531579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1166/2326] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:08:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:08:08.618823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=32 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:14.524685 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=25 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:16.790086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8eff8-975f-4409-ae71-c649079c2571 service placement] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:08:16.849983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8eff8-975f-4409-ae71-c649079c2571 service placement] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:08:16.856169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212d962-3bc2-49e1-89e5-96475a0c4b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:08:16.857999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212d962-3bc2-49e1-89e5-96475a0c4b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:16.858685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212d962-3bc2-49e1-89e5-96475a0c4b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:16.858970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212d962-3bc2-49e1-89e5-96475a0c4b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:16.873363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212d962-3bc2-49e1-89e5-96475a0c4b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:08:16.879152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212d962-3bc2-49e1-89e5-96475a0c4b98 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:08:16.891851 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1161/2327] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:08:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:08:23.355429 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096453ec-066c-4da8-a381-9bc3c35d7b4e None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:23.356024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096453ec-066c-4da8-a381-9bc3c35d7b4e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:23.356024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096453ec-066c-4da8-a381-9bc3c35d7b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:23.374678 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-096453ec-066c-4da8-a381-9bc3c35d7b4e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:08:23.375885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-096453ec-066c-4da8-a381-9bc3c35d7b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:08:23.383968 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1167/2328] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Jun 26 03:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:08:23.405539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212d962-3bc2-49e1-89e5-96475a0c4b98 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:08:23.418917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212d962-3bc2-49e1-89e5-96475a0c4b98 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:08:23.426118 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1528446-a821-4ae1-ab01-65fd7dac8b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:08:23.426760 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1528446-a821-4ae1-ab01-65fd7dac8b20 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:23.427081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1528446-a821-4ae1-ab01-65fd7dac8b20 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:23.427344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1528446-a821-4ae1-ab01-65fd7dac8b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:23.435874 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1528446-a821-4ae1-ab01-65fd7dac8b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:08:23.437466 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1528446-a821-4ae1-ab01-65fd7dac8b20 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:08:23.447636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1162/2329] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:08:27.689096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45dad-f9f3-467e-8188-f5499e98f19c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:27.689670 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45dad-f9f3-467e-8188-f5499e98f19c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:27.689670 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45dad-f9f3-467e-8188-f5499e98f19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:27.708486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ebb45dad-f9f3-467e-8188-f5499e98f19c None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:08:27.709687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ebb45dad-f9f3-467e-8188-f5499e98f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:08:27.720443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1168/2330] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Jun 26 03:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:08:27.746899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1528446-a821-4ae1-ab01-65fd7dac8b20 service nova] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:08:27.758628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1528446-a821-4ae1-ab01-65fd7dac8b20 service nova] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:08:27.765759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9c511-9906-42a5-a0ee-c5f50a2bd1fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:08:27.766423 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9c511-9906-42a5-a0ee-c5f50a2bd1fd service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:27.766710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9c511-9906-42a5-a0ee-c5f50a2bd1fd service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:27.767032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9c511-9906-42a5-a0ee-c5f50a2bd1fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:27.776022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9c511-9906-42a5-a0ee-c5f50a2bd1fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:08:27.777783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9c511-9906-42a5-a0ee-c5f50a2bd1fd service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:08:27.787631 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1163/2331] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:08:31.794455 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f206ce-6fa9-4ea7-8e36-b05f40c4f936 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:31.795028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f206ce-6fa9-4ea7-8e36-b05f40c4f936 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:31.795028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f206ce-6fa9-4ea7-8e36-b05f40c4f936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:31.814870 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-60f206ce-6fa9-4ea7-8e36-b05f40c4f936 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:08:31.816126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-60f206ce-6fa9-4ea7-8e36-b05f40c4f936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:08:31.825328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1169/2332] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Jun 26 03:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:08:31.848729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9c511-9906-42a5-a0ee-c5f50a2bd1fd service nova] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:08:31.860681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9c511-9906-42a5-a0ee-c5f50a2bd1fd service nova] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:08:31.867152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923f4d-d772-4894-883e-efb2c2e8126b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:08:31.867799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923f4d-d772-4894-883e-efb2c2e8126b service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:31.868058 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923f4d-d772-4894-883e-efb2c2e8126b service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:31.868361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923f4d-d772-4894-883e-efb2c2e8126b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:31.877740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923f4d-d772-4894-883e-efb2c2e8126b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:08:31.879393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923f4d-d772-4894-883e-efb2c2e8126b service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:08:31.889729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1164/2333] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:08:36.013333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3bed5-a24c-41a1-a021-38df30c6726d None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:36.013852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3bed5-a24c-41a1-a021-38df30c6726d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:36.013852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3bed5-a24c-41a1-a021-38df30c6726d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:36.032581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-27f3bed5-a24c-41a1-a021-38df30c6726d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:08:36.033789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-27f3bed5-a24c-41a1-a021-38df30c6726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:08:36.043274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1170/2334] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Jun 26 03:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:08:36.067864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923f4d-d772-4894-883e-efb2c2e8126b service nova] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:08:36.079691 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923f4d-d772-4894-883e-efb2c2e8126b service nova] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:08:36.086511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686384c9-9348-4cef-b56b-ca2a5c11d7a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:08:36.087281 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686384c9-9348-4cef-b56b-ca2a5c11d7a2 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:36.087543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686384c9-9348-4cef-b56b-ca2a5c11d7a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:36.087821 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686384c9-9348-4cef-b56b-ca2a5c11d7a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:36.096039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686384c9-9348-4cef-b56b-ca2a5c11d7a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:08:36.097623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686384c9-9348-4cef-b56b-ca2a5c11d7a2 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:08:36.106967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1165/2335] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:08:40.227601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eee9f-3574-4d57-825c-83f8027448f2 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:40.228112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eee9f-3574-4d57-825c-83f8027448f2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:40.228227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eee9f-3574-4d57-825c-83f8027448f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:40.247720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-3f1eee9f-3574-4d57-825c-83f8027448f2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:08:40.249036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3f1eee9f-3574-4d57-825c-83f8027448f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:08:40.258692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1171/2336] 10.222.0.23 () {58 vars in 1016 bytes} [Sun Jun 26 03:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:08:40.310313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686384c9-9348-4cef-b56b-ca2a5c11d7a2 service nova] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:08:40.316968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=51 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:40.323712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686384c9-9348-4cef-b56b-ca2a5c11d7a2 service nova] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:08:40.329633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff93d6-5df4-48f7-98cd-2c3b0646cd5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:08:40.330275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff93d6-5df4-48f7-98cd-2c3b0646cd5c service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:40.330555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff93d6-5df4-48f7-98cd-2c3b0646cd5c service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:40.330827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff93d6-5df4-48f7-98cd-2c3b0646cd5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:40.339158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff93d6-5df4-48f7-98cd-2c3b0646cd5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:08:40.340735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff93d6-5df4-48f7-98cd-2c3b0646cd5c service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:08:40.350830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1166/2337] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:08:50.242248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=15 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:50.346073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:08:59.057333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d5c51-615f-4ba8-83e8-2284a7d7a2df None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:59.057840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d5c51-615f-4ba8-83e8-2284a7d7a2df None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:59.057840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d5c51-615f-4ba8-83e8-2284a7d7a2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:59.108471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5c9d5c51-615f-4ba8-83e8-2284a7d7a2df None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:08:59.109932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5c9d5c51-615f-4ba8-83e8-2284a7d7a2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:08:59.174006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1172/2338] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:08:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:08:59.223594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff93d6-5df4-48f7-98cd-2c3b0646cd5c service nova] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:08:59.225044 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b0ff93d6-5df4-48f7-98cd-2c3b0646cd5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:08:59.318012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff93d6-5df4-48f7-98cd-2c3b0646cd5c service nova] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:08:59.322908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5d395-91d5-4359-a49e-9ea64fef830c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:08:59.323588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5d395-91d5-4359-a49e-9ea64fef830c service swift] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:08:59.323872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5d395-91d5-4359-a49e-9ea64fef830c service swift] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:08:59.324183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5d395-91d5-4359-a49e-9ea64fef830c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:08:59.332338 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5d395-91d5-4359-a49e-9ea64fef830c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:08:59.333975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5d395-91d5-4359-a49e-9ea64fef830c service swift] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:08:59.342671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1167/2339] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:08:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 26 03:09:09.171013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=40 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:09.339816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=41 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:14.434572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0bc31-4814-4aeb-80cd-f966b1d680d2 None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:14.435215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0bc31-4814-4aeb-80cd-f966b1d680d2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:14.435511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0bc31-4814-4aeb-80cd-f966b1d680d2 None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:14.436924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1173/2340] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 03:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:09:14.449488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56f82b-c3d8-494a-b1f9-f230274359dc None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:14.450095 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56f82b-c3d8-494a-b1f9-f230274359dc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:14.450214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56f82b-c3d8-494a-b1f9-f230274359dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:14.492836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fa56f82b-c3d8-494a-b1f9-f230274359dc None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:14.494707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fa56f82b-c3d8-494a-b1f9-f230274359dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:14.505688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1168/2341] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 03:09:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:14.518512 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0bc31-4814-4aeb-80cd-f966b1d680d2 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:14.520252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-77a0bc31-4814-4aeb-80cd-f966b1d680d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:14.622770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0bc31-4814-4aeb-80cd-f966b1d680d2 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:14.627238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55165ff0-bbba-4402-afc1-ca9ccab8cce4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '250c47daff26400c96a6b467d7cf5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:14.627923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55165ff0-bbba-4402-afc1-ca9ccab8cce4 service glance] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:14.628203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55165ff0-bbba-4402-afc1-ca9ccab8cce4 service glance] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:14.628481 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55165ff0-bbba-4402-afc1-ca9ccab8cce4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:14.640424 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55165ff0-bbba-4402-afc1-ca9ccab8cce4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:14.641946 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55165ff0-bbba-4402-afc1-ca9ccab8cce4 service glance] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:14.653970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1174/2342] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:09:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:09:14.730118 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6649041-296a-4ad3-a46a-eb1cc98152e8 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:14.730724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6649041-296a-4ad3-a46a-eb1cc98152e8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:14.731547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6649041-296a-4ad3-a46a-eb1cc98152e8 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:14.733828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1169/2343] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 03:09:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:09:14.739604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01719d-e9c2-4517-80fb-715479871c5c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:14.739894 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01719d-e9c2-4517-80fb-715479871c5c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:14.740203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01719d-e9c2-4517-80fb-715479871c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:14.760710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5b01719d-e9c2-4517-80fb-715479871c5c None None] MFA Rules not processed for user `4169682bfc5043a3a3d4c638dae2a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:14.761915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5b01719d-e9c2-4517-80fb-715479871c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:14.768699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1175/2344] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 03:09:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:14.780592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6649041-296a-4ad3-a46a-eb1cc98152e8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:14.792605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6649041-296a-4ad3-a46a-eb1cc98152e8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:14.796225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198a12a-0b6d-4b59-80b7-160ed5356f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:14.796868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198a12a-0b6d-4b59-80b7-160ed5356f7b service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:14.797179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198a12a-0b6d-4b59-80b7-160ed5356f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:14.797427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198a12a-0b6d-4b59-80b7-160ed5356f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:14.804775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198a12a-0b6d-4b59-80b7-160ed5356f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:14.806317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198a12a-0b6d-4b59-80b7-160ed5356f7b service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:14.814494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1170/2345] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:09:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:09:14.897116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583935f9-45ff-431f-80bd-e430f1fb37ff None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:14.897411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583935f9-45ff-431f-80bd-e430f1fb37ff None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:14.897693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583935f9-45ff-431f-80bd-e430f1fb37ff None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:14.899183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1176/2346] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 03:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:09:14.904900 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1edb-0204-43f3-9434-5efd108662ff None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:14.905309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1edb-0204-43f3-9434-5efd108662ff None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:14.905649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1edb-0204-43f3-9434-5efd108662ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:14.924873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b2fd1edb-0204-43f3-9434-5efd108662ff None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:14.926138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b2fd1edb-0204-43f3-9434-5efd108662ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:14.935966 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1171/2347] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 03:09:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:14.946680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583935f9-45ff-431f-80bd-e430f1fb37ff None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:14.959235 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583935f9-45ff-431f-80bd-e430f1fb37ff None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:14.962903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597de09e-59e7-4f85-90f6-57c80030ea30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:14.963656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597de09e-59e7-4f85-90f6-57c80030ea30 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:14.963943 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597de09e-59e7-4f85-90f6-57c80030ea30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:14.964221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597de09e-59e7-4f85-90f6-57c80030ea30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:14.975145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597de09e-59e7-4f85-90f6-57c80030ea30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:14.976626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597de09e-59e7-4f85-90f6-57c80030ea30 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:14.984985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1edb-0204-43f3-9434-5efd108662ff None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:14.986668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b2fd1edb-0204-43f3-9434-5efd108662ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:14.989902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1177/2348] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:09:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:09:15.005017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1edb-0204-43f3-9434-5efd108662ff None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:15.011445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658eaeb-089d-4ee7-b2fa-101d142089d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:15.012351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658eaeb-089d-4ee7-b2fa-101d142089d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:15.012637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658eaeb-089d-4ee7-b2fa-101d142089d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:15.012918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658eaeb-089d-4ee7-b2fa-101d142089d8 admin admin] PATH_INFO: `/v3/users/82e0e24e4f1c44e88b41f2c05fc254d5` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:15.014152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658eaeb-089d-4ee7-b2fa-101d142089d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e0e24e4f1c44e88b41f2c05fc254d5)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:15.016140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658eaeb-089d-4ee7-b2fa-101d142089d8 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:15.064928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3658eaeb-089d-4ee7-b2fa-101d142089d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e0e24e4f1c44e88b41f2c05fc254d5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:09:15.077099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3658eaeb-089d-4ee7-b2fa-101d142089d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e0e24e4f1c44e88b41f2c05fc254d5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:09:15.077811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3658eaeb-089d-4ee7-b2fa-101d142089d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e0e24e4f1c44e88b41f2c05fc254d5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:09:15.084607 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3658eaeb-089d-4ee7-b2fa-101d142089d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e0e24e4f1c44e88b41f2c05fc254d5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:09:15.085248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3658eaeb-089d-4ee7-b2fa-101d142089d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e0e24e4f1c44e88b41f2c05fc254d5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:09:15.099610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1172/2349] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:09:14 2022] DELETE /identity/v3/users/82e0e24e4f1c44e88b41f2c05fc254d5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:09:15.288592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597de09e-59e7-4f85-90f6-57c80030ea30 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:15.302615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597de09e-59e7-4f85-90f6-57c80030ea30 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:15.368243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:15.369211 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:15.369562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:15.369925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] PATH_INFO: `/v3/projects/064b2783c0fe4cf288ad4629c941a0be` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:15.371201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=064b2783c0fe4cf288ad4629c941a0be)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:15.373223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:15.426340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064b2783c0fe4cf288ad4629c941a0be', 'request_id': 'req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:09:15.433189 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064b2783c0fe4cf288ad4629c941a0be', 'request_id': 'req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:09:15.441762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064b2783c0fe4cf288ad4629c941a0be', 'request_id': 'req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:09:15.445778 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:15.454695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] The token cache is being invalidate because project 064b2783c0fe4cf288ad4629c941a0be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:09:15.455264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:09:15.456366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-caaf0ee5-2d49-4e3a-9ccc-cdbd221b1d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:09:15.458460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1178/2350] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:09:15 2022] DELETE /identity/v3/projects/064b2783c0fe4cf288ad4629c941a0be => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:09:15.465491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5347-2476-4a7a-931b-69a2009cfa5c None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:15.466043 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5347-2476-4a7a-931b-69a2009cfa5c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:15.466043 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5347-2476-4a7a-931b-69a2009cfa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:15.486070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-8e1d5347-2476-4a7a-931b-69a2009cfa5c None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:15.487310 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8e1d5347-2476-4a7a-931b-69a2009cfa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:15.569056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1173/2351] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:15.576990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abd61d-b168-4dc8-a6ce-e72b08613c32 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:15.577281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abd61d-b168-4dc8-a6ce-e72b08613c32 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:15.577563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abd61d-b168-4dc8-a6ce-e72b08613c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:15.608716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-65abd61d-b168-4dc8-a6ce-e72b08613c32 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:15.609952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-65abd61d-b168-4dc8-a6ce-e72b08613c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:15.618463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1179/2352] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:15.623543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d5347-2476-4a7a-931b-69a2009cfa5c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:15.635407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d5347-2476-4a7a-931b-69a2009cfa5c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:15.640988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060a53-a737-40c0-921c-cc4f47322329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:15.641690 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060a53-a737-40c0-921c-cc4f47322329 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:15.641972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060a53-a737-40c0-921c-cc4f47322329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:15.642254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060a53-a737-40c0-921c-cc4f47322329 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:15.643033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060a53-a737-40c0-921c-cc4f47322329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:09:15.643313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060a53-a737-40c0-921c-cc4f47322329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:15.645099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060a53-a737-40c0-921c-cc4f47322329 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:15.666811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1174/2353] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:09:15.668366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abd61d-b168-4dc8-a6ce-e72b08613c32 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:15.678188 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abd61d-b168-4dc8-a6ce-e72b08613c32 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:15.683621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1d1d4-7f73-4d22-a74c-75d71142c439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:15.684551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1d1d4-7f73-4d22-a74c-75d71142c439 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:15.685057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1d1d4-7f73-4d22-a74c-75d71142c439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:15.685542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1d1d4-7f73-4d22-a74c-75d71142c439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:15.686340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1d1d4-7f73-4d22-a74c-75d71142c439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:15.689339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1d1d4-7f73-4d22-a74c-75d71142c439 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:15.719973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1180/2354] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:09:15 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:09:15.724230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060a53-a737-40c0-921c-cc4f47322329 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:15.734872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060a53-a737-40c0-921c-cc4f47322329 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:15.755477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:15.806333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88570988-e242-4002-b387-6303f1595671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:15.807090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88570988-e242-4002-b387-6303f1595671 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:15.807479 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88570988-e242-4002-b387-6303f1595671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:15.807977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88570988-e242-4002-b387-6303f1595671 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:15.808776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88570988-e242-4002-b387-6303f1595671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:15.810775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88570988-e242-4002-b387-6303f1595671 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:15.834107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1175/2355] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:09:15 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:09:15.835705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1d1d4-7f73-4d22-a74c-75d71142c439 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:15.846485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1d1d4-7f73-4d22-a74c-75d71142c439 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:15.851819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bec66-b2c6-4817-b099-a266f83d7765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:15.852498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bec66-b2c6-4817-b099-a266f83d7765 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:15.852871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bec66-b2c6-4817-b099-a266f83d7765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:15.853099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bec66-b2c6-4817-b099-a266f83d7765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:15.853830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bec66-b2c6-4817-b099-a266f83d7765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:15.855518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bec66-b2c6-4817-b099-a266f83d7765 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:15.870579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1181/2356] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:09:15.875656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88570988-e242-4002-b387-6303f1595671 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:15.886515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88570988-e242-4002-b387-6303f1595671 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:15.892127 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19cd3b-8937-4a60-93b8-3193810eff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:15.892801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19cd3b-8937-4a60-93b8-3193810eff8d admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:15.893104 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19cd3b-8937-4a60-93b8-3193810eff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:15.893402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19cd3b-8937-4a60-93b8-3193810eff8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:15.894117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19cd3b-8937-4a60-93b8-3193810eff8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:15.895773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19cd3b-8937-4a60-93b8-3193810eff8d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:15.907055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1176/2357] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:09:15.911035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bec66-b2c6-4817-b099-a266f83d7765 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:15.921330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bec66-b2c6-4817-b099-a266f83d7765 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:15.926398 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a7d9-27bc-4f53-8225-d474bb097b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:15.927319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a7d9-27bc-4f53-8225-d474bb097b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:15.927615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a7d9-27bc-4f53-8225-d474bb097b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:15.927883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a7d9-27bc-4f53-8225-d474bb097b9b admin admin] PATH_INFO: `/v3/projects/c14a6c56310d41daae3669f22c130375/users/b8a91f886b7b43a38ac6d91dc7f301c1/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:15.943151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a7d9-27bc-4f53-8225-d474bb097b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14a6c56310d41daae3669f22c130375, user_id=b8a91f886b7b43a38ac6d91dc7f301c1, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:15.945897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a7d9-27bc-4f53-8225-d474bb097b9b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:15.959963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1182/2358] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:09:15 2022] PUT /identity/v3/projects/c14a6c56310d41daae3669f22c130375/users/b8a91f886b7b43a38ac6d91dc7f301c1/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:09:15.965370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822abdb3-ccaa-4a12-b09b-2f451db851b2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:15.965666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822abdb3-ccaa-4a12-b09b-2f451db851b2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:15.965952 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822abdb3-ccaa-4a12-b09b-2f451db851b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:15.984022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-822abdb3-ccaa-4a12-b09b-2f451db851b2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:15.985241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-822abdb3-ccaa-4a12-b09b-2f451db851b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:16.047474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1177/2359] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:16.054205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a7d9-27bc-4f53-8225-d474bb097b9b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:16.056438 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7987a7d9-27bc-4f53-8225-d474bb097b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:16.113920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a7d9-27bc-4f53-8225-d474bb097b9b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:16.117643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe10d5f-7173-4c8f-9f77-de3d8bf14bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:16.118294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe10d5f-7173-4c8f-9f77-de3d8bf14bad service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:16.118580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe10d5f-7173-4c8f-9f77-de3d8bf14bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:16.118859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe10d5f-7173-4c8f-9f77-de3d8bf14bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:16.128624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe10d5f-7173-4c8f-9f77-de3d8bf14bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:16.130118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe10d5f-7173-4c8f-9f77-de3d8bf14bad service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:16.142213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1183/2360] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:09:17.535389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4defd0-3fb2-4e22-ae14-df12a408bcd3 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:17.536313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4defd0-3fb2-4e22-ae14-df12a408bcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:17.536809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4defd0-3fb2-4e22-ae14-df12a408bcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:17.557686 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fa4defd0-3fb2-4e22-ae14-df12a408bcd3 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:17.559306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fa4defd0-3fb2-4e22-ae14-df12a408bcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:17.638325 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1178/2361] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:09:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:17.654617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe10d5f-7173-4c8f-9f77-de3d8bf14bad service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:17.657014 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-bfe10d5f-7173-4c8f-9f77-de3d8bf14bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:17.734312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe10d5f-7173-4c8f-9f77-de3d8bf14bad service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:17.740521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc09ac-3cd3-4422-b285-3d8ef999101d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:17.741195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc09ac-3cd3-4422-b285-3d8ef999101d service swift] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:17.741471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc09ac-3cd3-4422-b285-3d8ef999101d service swift] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:17.741743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc09ac-3cd3-4422-b285-3d8ef999101d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:17.755327 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc09ac-3cd3-4422-b285-3d8ef999101d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:17.755327 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc09ac-3cd3-4422-b285-3d8ef999101d service swift] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:17.770604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1184/2362] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:09:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:09:21.664925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a119c5-3714-42b1-9222-2531ce702ad8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:21.665571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a119c5-3714-42b1-9222-2531ce702ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:21.665571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a119c5-3714-42b1-9222-2531ce702ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:21.716286 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f4a119c5-3714-42b1-9222-2531ce702ad8 None None] MFA Rules not processed for user `b8a91f886b7b43a38ac6d91dc7f301c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:21.717581 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f4a119c5-3714-42b1-9222-2531ce702ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:21.753925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:21.807154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1179/2363] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:09:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:21.809185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc09ac-3cd3-4422-b285-3d8ef999101d service swift] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:21.821588 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc09ac-3cd3-4422-b285-3d8ef999101d service swift] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:21.828562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcea30d-b219-4ec6-b23f-3bd2c4fd2924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:21.829249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcea30d-b219-4ec6-b23f-3bd2c4fd2924 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:21.829530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcea30d-b219-4ec6-b23f-3bd2c4fd2924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:21.829808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcea30d-b219-4ec6-b23f-3bd2c4fd2924 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:21.830911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcea30d-b219-4ec6-b23f-3bd2c4fd2924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:21.833941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcea30d-b219-4ec6-b23f-3bd2c4fd2924 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:21.862596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:21.877418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1185/2364] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:09:21 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:09:21.881160 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a119c5-3714-42b1-9222-2531ce702ad8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:21.893626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a119c5-3714-42b1-9222-2531ce702ad8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:21.959221 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2f3e7-8999-4105-99d7-fe4af7ec9b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:21.960003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2f3e7-8999-4105-99d7-fe4af7ec9b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:21.960349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2f3e7-8999-4105-99d7-fe4af7ec9b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:21.960720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2f3e7-8999-4105-99d7-fe4af7ec9b35 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:21.961542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2f3e7-8999-4105-99d7-fe4af7ec9b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:21.963741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2f3e7-8999-4105-99d7-fe4af7ec9b35 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:21.998830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1180/2365] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:09:21 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:09:22.002784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcea30d-b219-4ec6-b23f-3bd2c4fd2924 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:22.018661 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcea30d-b219-4ec6-b23f-3bd2c4fd2924 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:22.043984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0dffa-4ceb-4318-a636-91bb25be7208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:22.044781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0dffa-4ceb-4318-a636-91bb25be7208 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:22.045139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0dffa-4ceb-4318-a636-91bb25be7208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:22.045507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0dffa-4ceb-4318-a636-91bb25be7208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:22.046394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0dffa-4ceb-4318-a636-91bb25be7208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:22.048372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0dffa-4ceb-4318-a636-91bb25be7208 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:22.060225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1186/2366] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:09:22.064496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2f3e7-8999-4105-99d7-fe4af7ec9b35 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:22.085912 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2f3e7-8999-4105-99d7-fe4af7ec9b35 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:22.091488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923314e-ee51-477a-af56-87ac588c2433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:22.092421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923314e-ee51-477a-af56-87ac588c2433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:22.092685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923314e-ee51-477a-af56-87ac588c2433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:22.092968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923314e-ee51-477a-af56-87ac588c2433 admin admin] PATH_INFO: `/v3/projects/19412ee60feb4875acb4cc54ee631ecf/users/4d79624e84794b4c89423e2a02519494/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:22.116153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923314e-ee51-477a-af56-87ac588c2433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19412ee60feb4875acb4cc54ee631ecf, user_id=4d79624e84794b4c89423e2a02519494, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:22.119003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923314e-ee51-477a-af56-87ac588c2433 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:22.135597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1181/2367] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:09:22 2022] PUT /identity/v3/projects/19412ee60feb4875acb4cc54ee631ecf/users/4d79624e84794b4c89423e2a02519494/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:09:22.139651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0dffa-4ceb-4318-a636-91bb25be7208 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:22.151354 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0dffa-4ceb-4318-a636-91bb25be7208 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:22.223102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90104fe5-45c7-4e10-9cbe-52d666739b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:22.223807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90104fe5-45c7-4e10-9cbe-52d666739b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:22.224090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90104fe5-45c7-4e10-9cbe-52d666739b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:22.224366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90104fe5-45c7-4e10-9cbe-52d666739b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:22.225116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90104fe5-45c7-4e10-9cbe-52d666739b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:22.226855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90104fe5-45c7-4e10-9cbe-52d666739b22 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:22.243718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1187/2368] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:09:22.245287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923314e-ee51-477a-af56-87ac588c2433 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:22.256326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923314e-ee51-477a-af56-87ac588c2433 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:22.261228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f4a12-bd39-461d-ae29-a27c9376ab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:22.262147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f4a12-bd39-461d-ae29-a27c9376ab64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:22.262425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f4a12-bd39-461d-ae29-a27c9376ab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:22.262851 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f4a12-bd39-461d-ae29-a27c9376ab64 admin admin] PATH_INFO: `/v3/projects/19412ee60feb4875acb4cc54ee631ecf/users/4d79624e84794b4c89423e2a02519494/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:22.264956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f4a12-bd39-461d-ae29-a27c9376ab64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19412ee60feb4875acb4cc54ee631ecf, user_id=4d79624e84794b4c89423e2a02519494, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:22.269301 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f4a12-bd39-461d-ae29-a27c9376ab64 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:22.286388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1182/2369] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:09:22 2022] PUT /identity/v3/projects/19412ee60feb4875acb4cc54ee631ecf/users/4d79624e84794b4c89423e2a02519494/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:09:28.932885 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cb527-1815-4ee6-8f97-3a9406cf58ed None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:28.933443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cb527-1815-4ee6-8f97-3a9406cf58ed None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:28.933443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cb527-1815-4ee6-8f97-3a9406cf58ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:28.978024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-316cb527-1815-4ee6-8f97-3a9406cf58ed None None] MFA Rules not processed for user `4d79624e84794b4c89423e2a02519494`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:28.979713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-316cb527-1815-4ee6-8f97-3a9406cf58ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:29.071878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1188/2370] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:09:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:29.078406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f4a12-bd39-461d-ae29-a27c9376ab64 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:29.080696 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-018f4a12-bd39-461d-ae29-a27c9376ab64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:29.144204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f4a12-bd39-461d-ae29-a27c9376ab64 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:29.148180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acef75-88fa-49be-b559-0176f4a5b5dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '250c47daff26400c96a6b467d7cf5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:29.148895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acef75-88fa-49be-b559-0176f4a5b5dc service glance] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:29.149183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acef75-88fa-49be-b559-0176f4a5b5dc service glance] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:29.149450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acef75-88fa-49be-b559-0176f4a5b5dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:29.193674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:29.214137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acef75-88fa-49be-b559-0176f4a5b5dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:29.215790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acef75-88fa-49be-b559-0176f4a5b5dc service glance] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:29.225632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1183/2371] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:09:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:09:29.326771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994ade-06f9-4c51-a9b8-dd393f1421f4 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:29.327091 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994ade-06f9-4c51-a9b8-dd393f1421f4 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:29.327749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994ade-06f9-4c51-a9b8-dd393f1421f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:29.347330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ea994ade-06f9-4c51-a9b8-dd393f1421f4 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:29.348550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ea994ade-06f9-4c51-a9b8-dd393f1421f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:29.405680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1189/2372] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:09:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:29.419085 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acef75-88fa-49be-b559-0176f4a5b5dc service glance] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:29.497261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acef75-88fa-49be-b559-0176f4a5b5dc service glance] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:29.504473 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81659e06-663b-4c25-93ff-c81eb58e869f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:29.505154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81659e06-663b-4c25-93ff-c81eb58e869f service swift] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:29.505437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81659e06-663b-4c25-93ff-c81eb58e869f service swift] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:29.505729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81659e06-663b-4c25-93ff-c81eb58e869f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:29.515628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81659e06-663b-4c25-93ff-c81eb58e869f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:29.517263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81659e06-663b-4c25-93ff-c81eb58e869f service swift] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:29.527033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1184/2373] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:09:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:09:37.696680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e566-00fc-4a4c-ad2f-e4729f4366b0 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:37.697277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e566-00fc-4a4c-ad2f-e4729f4366b0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:37.697277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e566-00fc-4a4c-ad2f-e4729f4366b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:37.715584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-55a4e566-00fc-4a4c-ad2f-e4729f4366b0 None None] MFA Rules not processed for user `3e291616a6574581af9e778d5849ccca`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:37.716904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-55a4e566-00fc-4a4c-ad2f-e4729f4366b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:37.726687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:37.790066 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1190/2374] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:09:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:38.989148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad24b93-5b97-4c8d-86c2-764c82e12a30 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:38.989719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad24b93-5b97-4c8d-86c2-764c82e12a30 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:38.989719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad24b93-5b97-4c8d-86c2-764c82e12a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:39.007974 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-6ad24b93-5b97-4c8d-86c2-764c82e12a30 None None] MFA Rules not processed for user `b8a91f886b7b43a38ac6d91dc7f301c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:39.009164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6ad24b93-5b97-4c8d-86c2-764c82e12a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:39.016806 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1185/2375] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:09:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:40.247413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334aca-c82e-4718-9ea7-45a7185db0a0 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:40.247944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334aca-c82e-4718-9ea7-45a7185db0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:40.247944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334aca-c82e-4718-9ea7-45a7185db0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:40.266842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-0e334aca-c82e-4718-9ea7-45a7185db0a0 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:40.268471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-0e334aca-c82e-4718-9ea7-45a7185db0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:40.277492 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1191/2376] 10.222.0.36 () {58 vars in 967 bytes} [Sun Jun 26 03:09:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:40.290320 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad24b93-5b97-4c8d-86c2-764c82e12a30 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:40.302451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad24b93-5b97-4c8d-86c2-764c82e12a30 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:40.308018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41970fa-7c10-4f27-bbba-b514317fac9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:40.308655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41970fa-7c10-4f27-bbba-b514317fac9b service swift] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:40.308933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41970fa-7c10-4f27-bbba-b514317fac9b service swift] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:40.309213 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41970fa-7c10-4f27-bbba-b514317fac9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:40.317566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41970fa-7c10-4f27-bbba-b514317fac9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:40.319184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41970fa-7c10-4f27-bbba-b514317fac9b service swift] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:40.327293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1186/2377] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:09:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:09:44.235431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f720-b6c9-4fe3-837a-3dc1d825c3d3 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:44.236402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f720-b6c9-4fe3-837a-3dc1d825c3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:44.236902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724f720-b6c9-4fe3-837a-3dc1d825c3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:44.256934 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-2724f720-b6c9-4fe3-837a-3dc1d825c3d3 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:09:44.258331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2724f720-b6c9-4fe3-837a-3dc1d825c3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:44.265685 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1192/2378] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:09:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:09:44.279542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41970fa-7c10-4f27-bbba-b514317fac9b service swift] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:44.291827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41970fa-7c10-4f27-bbba-b514317fac9b service swift] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:44.297400 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd98df-c12a-4505-a73a-8f7febe701db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:44.298309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd98df-c12a-4505-a73a-8f7febe701db service swift] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:44.298593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd98df-c12a-4505-a73a-8f7febe701db service swift] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:44.298863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd98df-c12a-4505-a73a-8f7febe701db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:44.308999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd98df-c12a-4505-a73a-8f7febe701db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:44.310626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd98df-c12a-4505-a73a-8f7febe701db service swift] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:44.320540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1187/2379] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:09:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:09:47.583637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724f720-b6c9-4fe3-837a-3dc1d825c3d3 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:47.652912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724f720-b6c9-4fe3-837a-3dc1d825c3d3 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:47.656662 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaa6d5-960d-4cf0-b502-fa5bc0db7643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:47.657323 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa6d5-960d-4cf0-b502-fa5bc0db7643 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:47.657976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa6d5-960d-4cf0-b502-fa5bc0db7643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:47.658258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa6d5-960d-4cf0-b502-fa5bc0db7643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:47.660615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7bdaa6d5-960d-4cf0-b502-fa5bc0db7643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:47.677289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd98df-c12a-4505-a73a-8f7febe701db service swift] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:47.679082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3fdd98df-c12a-4505-a73a-8f7febe701db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:47.690963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd98df-c12a-4505-a73a-8f7febe701db service swift] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:47.695030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856b958-bb22-4161-bddf-083e49c54213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:47.695735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856b958-bb22-4161-bddf-083e49c54213 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:47.696087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856b958-bb22-4161-bddf-083e49c54213 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:47.696432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856b958-bb22-4161-bddf-083e49c54213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:47.699420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4856b958-bb22-4161-bddf-083e49c54213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:47.745538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaa6d5-960d-4cf0-b502-fa5bc0db7643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:47.747509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaa6d5-960d-4cf0-b502-fa5bc0db7643 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:47.762715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1193/2380] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:09:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:09:47.788726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856b958-bb22-4161-bddf-083e49c54213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:47.790971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856b958-bb22-4161-bddf-083e49c54213 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:47.807552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1188/2381] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:09:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:09:57.756509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=78 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:57.798292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:09:59.630569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaa6d5-960d-4cf0-b502-fa5bc0db7643 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:09:59.633972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7bdaa6d5-960d-4cf0-b502-fa5bc0db7643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:59.656125 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaa6d5-960d-4cf0-b502-fa5bc0db7643 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:09:59.663422 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a39e58-c4f5-4ae9-a0c2-25bd3d380435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:09:59.664079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a39e58-c4f5-4ae9-a0c2-25bd3d380435 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:09:59.664349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a39e58-c4f5-4ae9-a0c2-25bd3d380435 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:09:59.664620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a39e58-c4f5-4ae9-a0c2-25bd3d380435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:09:59.666776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a2a39e58-c4f5-4ae9-a0c2-25bd3d380435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:09:59.731182 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a39e58-c4f5-4ae9-a0c2-25bd3d380435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:09:59.732828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a39e58-c4f5-4ae9-a0c2-25bd3d380435 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:09:59.742194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1194/2382] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:09:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:10:09.737742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=28 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:14.062246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856b958-bb22-4161-bddf-083e49c54213 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:10:14.071454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856b958-bb22-4161-bddf-083e49c54213 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:10:14.075986 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43334e3b-1a02-4f0b-9d11-7f54f761c0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:10:14.076635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43334e3b-1a02-4f0b-9d11-7f54f761c0ee service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:10:14.076915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43334e3b-1a02-4f0b-9d11-7f54f761c0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:10:14.077191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43334e3b-1a02-4f0b-9d11-7f54f761c0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:10:14.087083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43334e3b-1a02-4f0b-9d11-7f54f761c0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:10:14.088457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43334e3b-1a02-4f0b-9d11-7f54f761c0ee service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:10:14.098241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1189/2383] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:10:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:10:15.788333 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a39e58-c4f5-4ae9-a0c2-25bd3d380435 service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:10:15.798831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a39e58-c4f5-4ae9-a0c2-25bd3d380435 service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:10:15.803454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6595b2-4ccc-42e7-8fee-f66d8f88c3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:10:15.804120 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6595b2-4ccc-42e7-8fee-f66d8f88c3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:10:15.804406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6595b2-4ccc-42e7-8fee-f66d8f88c3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:10:15.804718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6595b2-4ccc-42e7-8fee-f66d8f88c3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:10:15.806713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-0a6595b2-4ccc-42e7-8fee-f66d8f88c3a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:10:15.820940 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6595b2-4ccc-42e7-8fee-f66d8f88c3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:10:15.824004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6595b2-4ccc-42e7-8fee-f66d8f88c3a5 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:10:15.838086 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1195/2384] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:10:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:10:24.094096 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=6 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:25.832620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=6 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:10:51.021283 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43334e3b-1a02-4f0b-9d11-7f54f761c0ee service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:10:51.023512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-43334e3b-1a02-4f0b-9d11-7f54f761c0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:10:51.113628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43334e3b-1a02-4f0b-9d11-7f54f761c0ee service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:10:51.117526 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da875a4-ea62-4d41-a0f6-0c89aef25580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:10:51.118176 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da875a4-ea62-4d41-a0f6-0c89aef25580 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:10:51.118456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da875a4-ea62-4d41-a0f6-0c89aef25580 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:10:51.118734 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da875a4-ea62-4d41-a0f6-0c89aef25580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:10:51.120672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4da875a4-ea62-4d41-a0f6-0c89aef25580 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:10:51.132309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da875a4-ea62-4d41-a0f6-0c89aef25580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:10:51.133892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da875a4-ea62-4d41-a0f6-0c89aef25580 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:10:51.143245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1190/2385] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:10:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:10:54.335411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6595b2-4ccc-42e7-8fee-f66d8f88c3a5 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:10:54.337630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-0a6595b2-4ccc-42e7-8fee-f66d8f88c3a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:10:54.356544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6595b2-4ccc-42e7-8fee-f66d8f88c3a5 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:10:54.366903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b94da1-9c8b-447e-b09c-89db63290e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:10:54.368130 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b94da1-9c8b-447e-b09c-89db63290e71 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:10:54.368458 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b94da1-9c8b-447e-b09c-89db63290e71 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:10:54.368954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b94da1-9c8b-447e-b09c-89db63290e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:10:54.371978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-16b94da1-9c8b-447e-b09c-89db63290e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:10:54.385345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b94da1-9c8b-447e-b09c-89db63290e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:10:54.392164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b94da1-9c8b-447e-b09c-89db63290e71 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:10:54.407088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1196/2386] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:10:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:00.994343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199a55c-649b-4637-a164-d238a0735034 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:00.994850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199a55c-649b-4637-a164-d238a0735034 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:00.995130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199a55c-649b-4637-a164-d238a0735034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:01.012928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2199a55c-649b-4637-a164-d238a0735034 None None] MFA Rules not processed for user `9fd251e1a49a4a5e817eec4df8794656`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:01.014042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2199a55c-649b-4637-a164-d238a0735034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:01.074155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1191/2387] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:01.481774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b94da1-9c8b-447e-b09c-89db63290e71 service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:01.491404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b94da1-9c8b-447e-b09c-89db63290e71 service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:01.499579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dce28-9fef-47f9-ae73-174106a3b3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:01.500249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dce28-9fef-47f9-ae73-174106a3b3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:01.500549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dce28-9fef-47f9-ae73-174106a3b3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:01.500827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dce28-9fef-47f9-ae73-174106a3b3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:01.502798 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8b7dce28-9fef-47f9-ae73-174106a3b3d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:01.513451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dce28-9fef-47f9-ae73-174106a3b3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:01.514933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dce28-9fef-47f9-ae73-174106a3b3d8 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:01.523258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1197/2388] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:01.972670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199a55c-649b-4637-a164-d238a0735034 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:01.974478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2199a55c-649b-4637-a164-d238a0735034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:02.060456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199a55c-649b-4637-a164-d238a0735034 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:02.065651 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1aca3-68b1-433b-9b50-ecb336cb787d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:02.066300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1aca3-68b1-433b-9b50-ecb336cb787d service placement] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:02.066568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1aca3-68b1-433b-9b50-ecb336cb787d service placement] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:02.066844 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1aca3-68b1-433b-9b50-ecb336cb787d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:02.068691 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-86c1aca3-68b1-433b-9b50-ecb336cb787d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:02.080137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1aca3-68b1-433b-9b50-ecb336cb787d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:02.081734 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1aca3-68b1-433b-9b50-ecb336cb787d service placement] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:02.091928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1192/2389] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:06.859219 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dce28-9fef-47f9-ae73-174106a3b3d8 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:06.876614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dce28-9fef-47f9-ae73-174106a3b3d8 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:06.884058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9e0fb-5a17-4d26-858b-500dcc7e0834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:06.884738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9e0fb-5a17-4d26-858b-500dcc7e0834 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:06.885020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9e0fb-5a17-4d26-858b-500dcc7e0834 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:06.885297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9e0fb-5a17-4d26-858b-500dcc7e0834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:06.887225 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-42a9e0fb-5a17-4d26-858b-500dcc7e0834 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:06.903117 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9e0fb-5a17-4d26-858b-500dcc7e0834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:06.905814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9e0fb-5a17-4d26-858b-500dcc7e0834 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:06.919573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1198/2390] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:10.181531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1aca3-68b1-433b-9b50-ecb336cb787d service placement] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:10.194289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1aca3-68b1-433b-9b50-ecb336cb787d service placement] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:10.200976 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901dc9-ffed-48b0-a4d0-1ea2d335c972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:10.201639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901dc9-ffed-48b0-a4d0-1ea2d335c972 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:10.201974 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901dc9-ffed-48b0-a4d0-1ea2d335c972 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:10.202260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901dc9-ffed-48b0-a4d0-1ea2d335c972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:10.204399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-28901dc9-ffed-48b0-a4d0-1ea2d335c972 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:10.216554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28901dc9-ffed-48b0-a4d0-1ea2d335c972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:10.218189 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28901dc9-ffed-48b0-a4d0-1ea2d335c972 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:10.227975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1193/2391] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:14.066709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9e0fb-5a17-4d26-858b-500dcc7e0834 service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:14.079707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9e0fb-5a17-4d26-858b-500dcc7e0834 service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:14.085806 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a02c7-9b4f-483d-b278-5b96553541cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:14.086751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a02c7-9b4f-483d-b278-5b96553541cb service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:14.087188 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a02c7-9b4f-483d-b278-5b96553541cb service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:14.087561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a02c7-9b4f-483d-b278-5b96553541cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:14.091296 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b66a02c7-9b4f-483d-b278-5b96553541cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:14.105020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a02c7-9b4f-483d-b278-5b96553541cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:14.106760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a02c7-9b4f-483d-b278-5b96553541cb service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:14.118743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1199/2392] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:18.546215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901dc9-ffed-48b0-a4d0-1ea2d335c972 service nova] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:18.550851 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:18.557482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901dc9-ffed-48b0-a4d0-1ea2d335c972 service nova] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:18.561894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec0aab-5420-4545-b46a-4accc1b1b6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:18.562572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec0aab-5420-4545-b46a-4accc1b1b6af service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:18.562854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec0aab-5420-4545-b46a-4accc1b1b6af service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:18.563176 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec0aab-5420-4545-b46a-4accc1b1b6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:18.565137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-93ec0aab-5420-4545-b46a-4accc1b1b6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:18.636072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec0aab-5420-4545-b46a-4accc1b1b6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:18.637724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec0aab-5420-4545-b46a-4accc1b1b6af service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:18.649559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1194/2393] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:18.934969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca365d-9780-4159-a1a5-5f701b96e1fc None None] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:18.935714 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca365d-9780-4159-a1a5-5f701b96e1fc None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:18.935714 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca365d-9780-4159-a1a5-5f701b96e1fc None None] PATH_INFO: `/` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:18.937156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1200/2394] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 03:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:11:18.944175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3059a94-e029-47d3-9afb-1d8c4536725e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:18.944469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3059a94-e029-47d3-9afb-1d8c4536725e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:18.944809 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3059a94-e029-47d3-9afb-1d8c4536725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:18.965340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c3059a94-e029-47d3-9afb-1d8c4536725e None None] MFA Rules not processed for user `4169682bfc5043a3a3d4c638dae2a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:18.966741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c3059a94-e029-47d3-9afb-1d8c4536725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:18.974813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1195/2395] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 03:11:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:18.996505 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca365d-9780-4159-a1a5-5f701b96e1fc None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:19.003884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=25 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:19.012363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca365d-9780-4159-a1a5-5f701b96e1fc None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:19.016746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d662a-f4a2-48c2-813b-a6276e51b22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:19.017402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d662a-f4a2-48c2-813b-a6276e51b22a service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:19.017687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d662a-f4a2-48c2-813b-a6276e51b22a service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:19.017955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d662a-f4a2-48c2-813b-a6276e51b22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:19.026768 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d662a-f4a2-48c2-813b-a6276e51b22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:19.028594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d662a-f4a2-48c2-813b-a6276e51b22a service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:19.038614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1201/2396] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:19.214527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e232ab3-0331-4893-8ff0-1ecb46ad6bd1 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:19.215169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e232ab3-0331-4893-8ff0-1ecb46ad6bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:19.215169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e232ab3-0331-4893-8ff0-1ecb46ad6bd1 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:19.216805 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1196/2397] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 03:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:11:19.233572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad362c7d-7ef7-45f7-b274-995c5b0f4963 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:19.233866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad362c7d-7ef7-45f7-b274-995c5b0f4963 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:19.234143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad362c7d-7ef7-45f7-b274-995c5b0f4963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:19.265476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ad362c7d-7ef7-45f7-b274-995c5b0f4963 None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:19.266904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ad362c7d-7ef7-45f7-b274-995c5b0f4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:19.277815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1202/2398] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 03:11:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:19.297215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e232ab3-0331-4893-8ff0-1ecb46ad6bd1 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:19.309800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e232ab3-0331-4893-8ff0-1ecb46ad6bd1 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:19.313814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf290dc-ba74-43d8-b2ac-d1fddbf4d7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:19.314881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf290dc-ba74-43d8-b2ac-d1fddbf4d7ee service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:19.315152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf290dc-ba74-43d8-b2ac-d1fddbf4d7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:19.315492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf290dc-ba74-43d8-b2ac-d1fddbf4d7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:19.330749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf290dc-ba74-43d8-b2ac-d1fddbf4d7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:19.332396 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf290dc-ba74-43d8-b2ac-d1fddbf4d7ee service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:19.349215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1197/2399] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:22.321721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62e16-c26e-4b20-a444-6257ca5e3ad7 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:22.322361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62e16-c26e-4b20-a444-6257ca5e3ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:22.322361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62e16-c26e-4b20-a444-6257ca5e3ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:22.340508 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-b8e62e16-c26e-4b20-a444-6257ca5e3ad7 None None] MFA Rules not processed for user `62f614b02ced4c4fae0fc0853ed66431`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:22.342099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b8e62e16-c26e-4b20-a444-6257ca5e3ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:22.353039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1203/2400] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:11:22.802185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf290dc-ba74-43d8-b2ac-d1fddbf4d7ee service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:22.811793 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf290dc-ba74-43d8-b2ac-d1fddbf4d7ee service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:22.816148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c468b-4759-40b9-8f81-44c16e781379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:22.816894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c468b-4759-40b9-8f81-44c16e781379 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:22.817272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c468b-4759-40b9-8f81-44c16e781379 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:22.817608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c468b-4759-40b9-8f81-44c16e781379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:22.819554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-de5c468b-4759-40b9-8f81-44c16e781379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:22.829946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c468b-4759-40b9-8f81-44c16e781379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:22.831502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c468b-4759-40b9-8f81-44c16e781379 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:22.840452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1198/2401] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:23.531562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62e16-c26e-4b20-a444-6257ca5e3ad7 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:23.534312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b8e62e16-c26e-4b20-a444-6257ca5e3ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:23.554031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c468b-4759-40b9-8f81-44c16e781379 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:23.556137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-de5c468b-4759-40b9-8f81-44c16e781379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:23.574088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62e16-c26e-4b20-a444-6257ca5e3ad7 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:23.579262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c468b-4759-40b9-8f81-44c16e781379 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:23.585499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4cfa3-5b9a-4679-928a-a0115b1dd76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:23.586440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4cfa3-5b9a-4679-928a-a0115b1dd76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:23.586951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4cfa3-5b9a-4679-928a-a0115b1dd76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:23.587360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4cfa3-5b9a-4679-928a-a0115b1dd76e admin admin] PATH_INFO: `/v3/users/3e291616a6574581af9e778d5849ccca` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:23.588386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ca0b8-5f66-4a0d-95a5-ea3623101213 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:23.589044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca0b8-5f66-4a0d-95a5-ea3623101213 service placement] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:23.589383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca0b8-5f66-4a0d-95a5-ea3623101213 service placement] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:23.589574 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ca0b8-5f66-4a0d-95a5-ea3623101213 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:23.590820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4cfa3-5b9a-4679-928a-a0115b1dd76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e291616a6574581af9e778d5849ccca)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:23.592817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4cfa3-5b9a-4679-928a-a0115b1dd76e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:23.596467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8e6ca0b8-5f66-4a0d-95a5-ea3623101213 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:23.614346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ca0b8-5f66-4a0d-95a5-ea3623101213 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:23.616075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ca0b8-5f66-4a0d-95a5-ea3623101213 service placement] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:23.632690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1204/2402] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:23.658473 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-10b4cfa3-5b9a-4679-928a-a0115b1dd76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e291616a6574581af9e778d5849ccca'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:23.676177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-10b4cfa3-5b9a-4679-928a-a0115b1dd76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e291616a6574581af9e778d5849ccca'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:23.677023 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-10b4cfa3-5b9a-4679-928a-a0115b1dd76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e291616a6574581af9e778d5849ccca'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:23.685037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-10b4cfa3-5b9a-4679-928a-a0115b1dd76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e291616a6574581af9e778d5849ccca'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:23.686069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-10b4cfa3-5b9a-4679-928a-a0115b1dd76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e291616a6574581af9e778d5849ccca'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:23.700363 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1199/2403] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:23 2022] DELETE /identity/v3/users/3e291616a6574581af9e778d5849ccca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:23.876654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ca0b8-5f66-4a0d-95a5-ea3623101213 service placement] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:23.887655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ca0b8-5f66-4a0d-95a5-ea3623101213 service placement] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:23.947277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:23.948157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:23.948441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:23.948718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] PATH_INFO: `/v3/projects/d807f48dee60483680b007e0be286979` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:23.949932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d807f48dee60483680b007e0be286979)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:23.951902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.001251 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd807f48dee60483680b007e0be286979', 'request_id': 'req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:24.007240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd807f48dee60483680b007e0be286979', 'request_id': 'req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:24.016244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd807f48dee60483680b007e0be286979', 'request_id': 'req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:24.026615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] The token cache is being invalidate because project d807f48dee60483680b007e0be286979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:24.026902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:24.027562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cdd99d80-28de-4fb2-bfc2-fedfc40461d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:24.029099 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1205/2404] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:23 2022] DELETE /identity/v3/projects/d807f48dee60483680b007e0be286979 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:24.034417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d69bb-aea1-4d79-b4ab-0f788941674d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.034917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d69bb-aea1-4d79-b4ab-0f788941674d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.035049 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d69bb-aea1-4d79-b4ab-0f788941674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.053040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-711d69bb-aea1-4d79-b4ab-0f788941674d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:24.054282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-711d69bb-aea1-4d79-b4ab-0f788941674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:24.086143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:24.120759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1200/2405] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:24.132475 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b467f-13a0-4e29-8914-bb718ca24619 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.132765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b467f-13a0-4e29-8914-bb718ca24619 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.133044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b467f-13a0-4e29-8914-bb718ca24619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.151707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d51b467f-13a0-4e29-8914-bb718ca24619 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:24.152901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d51b467f-13a0-4e29-8914-bb718ca24619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:24.161450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1206/2406] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:24.165712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d69bb-aea1-4d79-b4ab-0f788941674d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:24.175832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d69bb-aea1-4d79-b4ab-0f788941674d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:24.180977 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431054-d15d-4815-ace5-40ccc0dd5719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:24.181632 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431054-d15d-4815-ace5-40ccc0dd5719 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.181918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431054-d15d-4815-ace5-40ccc0dd5719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.182219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55431054-d15d-4815-ace5-40ccc0dd5719 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.182950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55431054-d15d-4815-ace5-40ccc0dd5719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:11:24.183300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55431054-d15d-4815-ace5-40ccc0dd5719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:24.184922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55431054-d15d-4815-ace5-40ccc0dd5719 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.196540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1201/2407] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:11:24.200856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b467f-13a0-4e29-8914-bb718ca24619 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:24.210753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b467f-13a0-4e29-8914-bb718ca24619 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:24.216665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d430e-95b8-4812-9825-418aaea1f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:24.217322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d430e-95b8-4812-9825-418aaea1f28c admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.217600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d430e-95b8-4812-9825-418aaea1f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.217872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d430e-95b8-4812-9825-418aaea1f28c admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.218563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d430e-95b8-4812-9825-418aaea1f28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:24.220850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d430e-95b8-4812-9825-418aaea1f28c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.259490 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1207/2408] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:24 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:24.263918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431054-d15d-4815-ace5-40ccc0dd5719 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:24.274944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55431054-d15d-4815-ace5-40ccc0dd5719 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:24.332171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b129c-af66-492a-9326-b1407f9bad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:24.332915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b129c-af66-492a-9326-b1407f9bad5c admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.333204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b129c-af66-492a-9326-b1407f9bad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.333543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b129c-af66-492a-9326-b1407f9bad5c admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.334307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b129c-af66-492a-9326-b1407f9bad5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:24.336506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b129c-af66-492a-9326-b1407f9bad5c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.358262 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1202/2409] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:24 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:11:24.362459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d430e-95b8-4812-9825-418aaea1f28c admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:24.373340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d430e-95b8-4812-9825-418aaea1f28c admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:24.378935 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb4d9-cd39-4719-b05f-6de7a231781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:24.379674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb4d9-cd39-4719-b05f-6de7a231781e admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.380016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb4d9-cd39-4719-b05f-6de7a231781e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.380362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb4d9-cd39-4719-b05f-6de7a231781e admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.381180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eb4d9-cd39-4719-b05f-6de7a231781e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:24.382884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eb4d9-cd39-4719-b05f-6de7a231781e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.394071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1208/2410] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:24.398311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b129c-af66-492a-9326-b1407f9bad5c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:24.408812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b129c-af66-492a-9326-b1407f9bad5c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:24.413766 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cdcd6-3a7b-4f3e-8006-2bb089642701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:24.422829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cdcd6-3a7b-4f3e-8006-2bb089642701 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.422829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cdcd6-3a7b-4f3e-8006-2bb089642701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.422829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cdcd6-3a7b-4f3e-8006-2bb089642701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.422829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cdcd6-3a7b-4f3e-8006-2bb089642701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:24.422829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cdcd6-3a7b-4f3e-8006-2bb089642701 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.427848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1203/2411] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:11:24.433262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb4d9-cd39-4719-b05f-6de7a231781e admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:24.439844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:24.443522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb4d9-cd39-4719-b05f-6de7a231781e admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:24.450390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae4174-2bf2-4d1d-aa26-b58e81ee9c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:24.451558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae4174-2bf2-4d1d-aa26-b58e81ee9c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.452047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae4174-2bf2-4d1d-aa26-b58e81ee9c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.452394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae4174-2bf2-4d1d-aa26-b58e81ee9c46 admin admin] PATH_INFO: `/v3/projects/b1d7bcb50ec041e0ab5e450f349041e6/users/1d0e6aaeaf2245418e20b3a7d4eda653/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.467666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae4174-2bf2-4d1d-aa26-b58e81ee9c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d7bcb50ec041e0ab5e450f349041e6, user_id=1d0e6aaeaf2245418e20b3a7d4eda653, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:24.470330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae4174-2bf2-4d1d-aa26-b58e81ee9c46 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.484298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1209/2412] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:24 2022] PUT /identity/v3/projects/b1d7bcb50ec041e0ab5e450f349041e6/users/1d0e6aaeaf2245418e20b3a7d4eda653/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:24.494685 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82c4a5-2852-4c5a-a659-a18ef159606f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.495021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82c4a5-2852-4c5a-a659-a18ef159606f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.495314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82c4a5-2852-4c5a-a659-a18ef159606f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.523401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-8e82c4a5-2852-4c5a-a659-a18ef159606f None None] MFA Rules not processed for user `1d0e6aaeaf2245418e20b3a7d4eda653`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:24.524607 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8e82c4a5-2852-4c5a-a659-a18ef159606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:24.591496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1204/2413] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:11:24.599765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae4174-2bf2-4d1d-aa26-b58e81ee9c46 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:24.672971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae4174-2bf2-4d1d-aa26-b58e81ee9c46 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:24.678541 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f20ab-3236-4826-9345-532865e073b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:24.679468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f20ab-3236-4826-9345-532865e073b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.679980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f20ab-3236-4826-9345-532865e073b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.680311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f20ab-3236-4826-9345-532865e073b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.681309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f20ab-3236-4826-9345-532865e073b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:24.684357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f20ab-3236-4826-9345-532865e073b7 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.715395 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1210/2414] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:24 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:24.719495 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82c4a5-2852-4c5a-a659-a18ef159606f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:24.731040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82c4a5-2852-4c5a-a659-a18ef159606f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:24.761514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:24.792798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b5ac4-03df-4142-80db-3532c5b58f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:24.793491 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b5ac4-03df-4142-80db-3532c5b58f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.793785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b5ac4-03df-4142-80db-3532c5b58f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.794081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b5ac4-03df-4142-80db-3532c5b58f9b admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.794878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b5ac4-03df-4142-80db-3532c5b58f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:24.796966 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b5ac4-03df-4142-80db-3532c5b58f9b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.820996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1205/2415] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:24 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:11:24.825043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f20ab-3236-4826-9345-532865e073b7 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:24.836005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f20ab-3236-4826-9345-532865e073b7 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:24.840925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bedb72-c76f-4062-b90f-1cb5d86359ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:24.841643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bedb72-c76f-4062-b90f-1cb5d86359ec admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.841879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bedb72-c76f-4062-b90f-1cb5d86359ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.842171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bedb72-c76f-4062-b90f-1cb5d86359ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.843042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bedb72-c76f-4062-b90f-1cb5d86359ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:24.844677 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bedb72-c76f-4062-b90f-1cb5d86359ec admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.855698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1211/2416] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:24.859985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b5ac4-03df-4142-80db-3532c5b58f9b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:24.870147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b5ac4-03df-4142-80db-3532c5b58f9b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:24.874819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971e0d0-d9df-4451-a5eb-284e9feaa140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:24.875748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e0d0-d9df-4451-a5eb-284e9feaa140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.876031 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e0d0-d9df-4451-a5eb-284e9feaa140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.876308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971e0d0-d9df-4451-a5eb-284e9feaa140 admin admin] PATH_INFO: `/v3/projects/d0e81c214e624c989cbd3793a4d06fe1/users/65b8a724756f4a9ea621219997060d3e/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.890889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971e0d0-d9df-4451-a5eb-284e9feaa140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e81c214e624c989cbd3793a4d06fe1, user_id=65b8a724756f4a9ea621219997060d3e, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:24.893604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971e0d0-d9df-4451-a5eb-284e9feaa140 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.908192 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1206/2417] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:24 2022] PUT /identity/v3/projects/d0e81c214e624c989cbd3793a4d06fe1/users/65b8a724756f4a9ea621219997060d3e/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:24.912186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bedb72-c76f-4062-b90f-1cb5d86359ec admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:24.922392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bedb72-c76f-4062-b90f-1cb5d86359ec admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:24.985691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ab7a8-fbe0-4603-91a9-d1662cfc33b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:24.986338 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab7a8-fbe0-4603-91a9-d1662cfc33b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:24.986642 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab7a8-fbe0-4603-91a9-d1662cfc33b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:24.986931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab7a8-fbe0-4603-91a9-d1662cfc33b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:24.987687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ab7a8-fbe0-4603-91a9-d1662cfc33b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:24.989306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ab7a8-fbe0-4603-91a9-d1662cfc33b0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:24.999132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1212/2418] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:25.003402 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971e0d0-d9df-4451-a5eb-284e9feaa140 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:25.013845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971e0d0-d9df-4451-a5eb-284e9feaa140 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:25.018701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cea45-7da2-44cf-80ff-27ae1b8763dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:25.019615 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cea45-7da2-44cf-80ff-27ae1b8763dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:25.019892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cea45-7da2-44cf-80ff-27ae1b8763dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:25.020167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cea45-7da2-44cf-80ff-27ae1b8763dd admin admin] PATH_INFO: `/v3/projects/d0e81c214e624c989cbd3793a4d06fe1/users/65b8a724756f4a9ea621219997060d3e/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:25.022205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cea45-7da2-44cf-80ff-27ae1b8763dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e81c214e624c989cbd3793a4d06fe1, user_id=65b8a724756f4a9ea621219997060d3e, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:25.024866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cea45-7da2-44cf-80ff-27ae1b8763dd admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:25.039846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1207/2419] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:25 2022] PUT /identity/v3/projects/d0e81c214e624c989cbd3793a4d06fe1/users/65b8a724756f4a9ea621219997060d3e/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:25.050834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d1dd9-e1df-4d5a-9107-6e0b76fe5e30 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:25.051160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d1dd9-e1df-4d5a-9107-6e0b76fe5e30 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:25.051442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d1dd9-e1df-4d5a-9107-6e0b76fe5e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:25.079764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d05d1dd9-e1df-4d5a-9107-6e0b76fe5e30 None None] MFA Rules not processed for user `65b8a724756f4a9ea621219997060d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:25.080988 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d05d1dd9-e1df-4d5a-9107-6e0b76fe5e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:25.123113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:25.155568 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1213/2420] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:25.167523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cea45-7da2-44cf-80ff-27ae1b8763dd admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:25.170015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7c9cea45-7da2-44cf-80ff-27ae1b8763dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:25.235143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cea45-7da2-44cf-80ff-27ae1b8763dd admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:25.239901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4622403-53fa-4c26-aa7e-883a89feb393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:25.240562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4622403-53fa-4c26-aa7e-883a89feb393 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:25.240848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4622403-53fa-4c26-aa7e-883a89feb393 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:25.241128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4622403-53fa-4c26-aa7e-883a89feb393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:25.262019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4622403-53fa-4c26-aa7e-883a89feb393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:25.264560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4622403-53fa-4c26-aa7e-883a89feb393 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:25.277590 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1208/2421] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:25.342011 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d1dd9-e1df-4d5a-9107-6e0b76fe5e30 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:25.343518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d05d1dd9-e1df-4d5a-9107-6e0b76fe5e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:25.355463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d1dd9-e1df-4d5a-9107-6e0b76fe5e30 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:25.359019 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb7369-bbf2-45f2-817c-79a2f08aeb39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:25.359663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb7369-bbf2-45f2-817c-79a2f08aeb39 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:25.359944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb7369-bbf2-45f2-817c-79a2f08aeb39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:25.360221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb7369-bbf2-45f2-817c-79a2f08aeb39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:25.422272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb7369-bbf2-45f2-817c-79a2f08aeb39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:25.423778 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb7369-bbf2-45f2-817c-79a2f08aeb39 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:25.434084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1214/2422] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:28.804168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4622403-53fa-4c26-aa7e-883a89feb393 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:28.868533 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4622403-53fa-4c26-aa7e-883a89feb393 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:28.873562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:28.874492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:28.874760 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:28.875067 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] PATH_INFO: `/v3/users/1d0e6aaeaf2245418e20b3a7d4eda653` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:28.876304 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0e6aaeaf2245418e20b3a7d4eda653)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:28.878313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:28.909859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:28.932273 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0e6aaeaf2245418e20b3a7d4eda653'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:28.944688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0e6aaeaf2245418e20b3a7d4eda653'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:28.945289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0e6aaeaf2245418e20b3a7d4eda653'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:28.952455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0e6aaeaf2245418e20b3a7d4eda653'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:28.953130 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0e6aaeaf2245418e20b3a7d4eda653'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:28.967153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1209/2423] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:28 2022] DELETE /identity/v3/users/1d0e6aaeaf2245418e20b3a7d4eda653 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:28.972057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fe6d2-6486-4707-bcb9-9f4a6315ea3e None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:28.972539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fe6d2-6486-4707-bcb9-9f4a6315ea3e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:28.972645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fe6d2-6486-4707-bcb9-9f4a6315ea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:28.990250 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-929fe6d2-6486-4707-bcb9-9f4a6315ea3e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:28.991580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-929fe6d2-6486-4707-bcb9-9f4a6315ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:29.055249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1215/2424] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:29.064972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:29.066611 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:29.124391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc24d0-2561-4295-83b2-a78173e162df admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:29.128404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eebcae-e2ec-4748-8f7f-b1282c1b5855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:29.129048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eebcae-e2ec-4748-8f7f-b1282c1b5855 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:29.129332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eebcae-e2ec-4748-8f7f-b1282c1b5855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:29.129609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eebcae-e2ec-4748-8f7f-b1282c1b5855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:29.139019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eebcae-e2ec-4748-8f7f-b1282c1b5855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:29.141350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eebcae-e2ec-4748-8f7f-b1282c1b5855 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:29.153493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1210/2425] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:29.465625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fe6d2-6486-4707-bcb9-9f4a6315ea3e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:29.467316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-929fe6d2-6486-4707-bcb9-9f4a6315ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:29.480453 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fe6d2-6486-4707-bcb9-9f4a6315ea3e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:29.486328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:29.487415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:29.487764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:29.488134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] PATH_INFO: `/v3/projects/b1d7bcb50ec041e0ab5e450f349041e6` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:29.489612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1d7bcb50ec041e0ab5e450f349041e6)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:29.491847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:29.545717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d7bcb50ec041e0ab5e450f349041e6', 'request_id': 'req-1438f58e-073a-426f-be77-69e2eca4100c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:29.552206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d7bcb50ec041e0ab5e450f349041e6', 'request_id': 'req-1438f58e-073a-426f-be77-69e2eca4100c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:29.560589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d7bcb50ec041e0ab5e450f349041e6', 'request_id': 'req-1438f58e-073a-426f-be77-69e2eca4100c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:29.567159 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:29.571896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] The token cache is being invalidate because project b1d7bcb50ec041e0ab5e450f349041e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:29.572491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:29.573914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:29.575901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1216/2426] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:29 2022] DELETE /identity/v3/projects/b1d7bcb50ec041e0ab5e450f349041e6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:29.580051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eebcae-e2ec-4748-8f7f-b1282c1b5855 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:29.590042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eebcae-e2ec-4748-8f7f-b1282c1b5855 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:29.649640 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a4073-dbba-4016-a49b-cbd0a9e9c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:29.650518 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a4073-dbba-4016-a49b-cbd0a9e9c4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:29.650804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a4073-dbba-4016-a49b-cbd0a9e9c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:29.651117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a4073-dbba-4016-a49b-cbd0a9e9c4c2 admin admin] PATH_INFO: `/v3/users/65b8a724756f4a9ea621219997060d3e` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:29.652532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a4073-dbba-4016-a49b-cbd0a9e9c4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b8a724756f4a9ea621219997060d3e)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:29.654856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a4073-dbba-4016-a49b-cbd0a9e9c4c2 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:29.705641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-126a4073-dbba-4016-a49b-cbd0a9e9c4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b8a724756f4a9ea621219997060d3e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:29.707947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:29.721526 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-126a4073-dbba-4016-a49b-cbd0a9e9c4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b8a724756f4a9ea621219997060d3e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:29.722274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-126a4073-dbba-4016-a49b-cbd0a9e9c4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b8a724756f4a9ea621219997060d3e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:29.729703 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-126a4073-dbba-4016-a49b-cbd0a9e9c4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b8a724756f4a9ea621219997060d3e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:29.730470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-126a4073-dbba-4016-a49b-cbd0a9e9c4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b8a724756f4a9ea621219997060d3e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:29.744329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1211/2427] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:29 2022] DELETE /identity/v3/users/65b8a724756f4a9ea621219997060d3e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:30.062538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:30.064187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:30.078204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438f58e-073a-426f-be77-69e2eca4100c admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:30.150433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:30.151507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.151865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.152203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] PATH_INFO: `/v3/projects/d0e81c214e624c989cbd3793a4d06fe1` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.153453 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e81c214e624c989cbd3793a4d06fe1)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:30.155815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:30.215618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e81c214e624c989cbd3793a4d06fe1', 'request_id': 'req-2c40a289-50f0-4e75-995a-0f927a48dc02'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:30.222676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e81c214e624c989cbd3793a4d06fe1', 'request_id': 'req-2c40a289-50f0-4e75-995a-0f927a48dc02'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:30.232289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e81c214e624c989cbd3793a4d06fe1', 'request_id': 'req-2c40a289-50f0-4e75-995a-0f927a48dc02'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:30.243286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] The token cache is being invalidate because project d0e81c214e624c989cbd3793a4d06fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:30.243974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:30.244634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2c40a289-50f0-4e75-995a-0f927a48dc02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:30.247051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1217/2428] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:30 2022] DELETE /identity/v3/projects/d0e81c214e624c989cbd3793a4d06fe1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:30.251957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1350ac-b03d-4690-83ff-d3321e780feb None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.252474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1350ac-b03d-4690-83ff-d3321e780feb None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.252587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1350ac-b03d-4690-83ff-d3321e780feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.271234 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-8b1350ac-b03d-4690-83ff-d3321e780feb None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:30.273308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8b1350ac-b03d-4690-83ff-d3321e780feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:30.331387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1212/2429] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:11:30.339363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1bc15-805a-4009-82ad-e1217ef72f6a None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.339644 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1bc15-805a-4009-82ad-e1217ef72f6a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.340040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1bc15-805a-4009-82ad-e1217ef72f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.357987 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-eea1bc15-805a-4009-82ad-e1217ef72f6a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:30.359222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-eea1bc15-805a-4009-82ad-e1217ef72f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:30.367706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1218/2430] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:30.371990 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1350ac-b03d-4690-83ff-d3321e780feb None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:30.381581 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1350ac-b03d-4690-83ff-d3321e780feb None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:30.386216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d8d5-b7b7-4886-91c7-9d6ead62cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:30.386874 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d8d5-b7b7-4886-91c7-9d6ead62cdcf admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.387185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d8d5-b7b7-4886-91c7-9d6ead62cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.387458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d8d5-b7b7-4886-91c7-9d6ead62cdcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.388214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995d8d5-b7b7-4886-91c7-9d6ead62cdcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:11:30.388519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995d8d5-b7b7-4886-91c7-9d6ead62cdcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:30.390119 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995d8d5-b7b7-4886-91c7-9d6ead62cdcf admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:30.401778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1213/2431] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:11:30.406469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1bc15-805a-4009-82ad-e1217ef72f6a None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:30.415709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1bc15-805a-4009-82ad-e1217ef72f6a None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:30.420456 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e5fe4-3b06-436c-b664-f5cf67c2b13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:30.421101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5fe4-3b06-436c-b664-f5cf67c2b13b admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.421378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5fe4-3b06-436c-b664-f5cf67c2b13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.421651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5fe4-3b06-436c-b664-f5cf67c2b13b admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.422328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e5fe4-3b06-436c-b664-f5cf67c2b13b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:30.424268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e5fe4-3b06-436c-b664-f5cf67c2b13b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:30.452702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1219/2432] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:30 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:30.457236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d8d5-b7b7-4886-91c7-9d6ead62cdcf admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:30.468087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d8d5-b7b7-4886-91c7-9d6ead62cdcf admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:30.531681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c19a4-7fc1-43fb-b415-cabd63b0f7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:30.532364 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c19a4-7fc1-43fb-b415-cabd63b0f7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.532650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c19a4-7fc1-43fb-b415-cabd63b0f7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.532932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c19a4-7fc1-43fb-b415-cabd63b0f7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.533627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c19a4-7fc1-43fb-b415-cabd63b0f7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:30.535628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c19a4-7fc1-43fb-b415-cabd63b0f7f8 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:30.555988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1214/2433] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:30 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:30.560677 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e5fe4-3b06-436c-b664-f5cf67c2b13b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:30.573452 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e5fe4-3b06-436c-b664-f5cf67c2b13b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:30.578827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dfa30-dafa-4d56-b95f-686c55cce16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:30.579532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dfa30-dafa-4d56-b95f-686c55cce16f admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.579810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dfa30-dafa-4d56-b95f-686c55cce16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.580085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dfa30-dafa-4d56-b95f-686c55cce16f admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.580807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dfa30-dafa-4d56-b95f-686c55cce16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:30.582433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dfa30-dafa-4d56-b95f-686c55cce16f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:30.596281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1220/2434] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:30.597587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c19a4-7fc1-43fb-b415-cabd63b0f7f8 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:30.608156 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c19a4-7fc1-43fb-b415-cabd63b0f7f8 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:30.614819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e962d52-6971-4a91-99c1-a01916e2ae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:30.615539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962d52-6971-4a91-99c1-a01916e2ae15 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.615819 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962d52-6971-4a91-99c1-a01916e2ae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.616094 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962d52-6971-4a91-99c1-a01916e2ae15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.616865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e962d52-6971-4a91-99c1-a01916e2ae15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:30.618513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e962d52-6971-4a91-99c1-a01916e2ae15 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:30.630242 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1215/2435] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:30.633833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dfa30-dafa-4d56-b95f-686c55cce16f admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:30.644127 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dfa30-dafa-4d56-b95f-686c55cce16f admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:30.648812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248a1e6-f115-4362-8b66-6a034a087460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:30.649819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248a1e6-f115-4362-8b66-6a034a087460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.650142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248a1e6-f115-4362-8b66-6a034a087460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.650421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248a1e6-f115-4362-8b66-6a034a087460 admin admin] PATH_INFO: `/v3/projects/7d40f667748a43e1af46e0eabe869df6/users/c52acbcf9fda401f9f74e03746fd2242/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.666242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248a1e6-f115-4362-8b66-6a034a087460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d40f667748a43e1af46e0eabe869df6, user_id=c52acbcf9fda401f9f74e03746fd2242, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:30.668877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248a1e6-f115-4362-8b66-6a034a087460 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:30.682592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1221/2436] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:30 2022] PUT /identity/v3/projects/7d40f667748a43e1af46e0eabe869df6/users/c52acbcf9fda401f9f74e03746fd2242/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:30.693777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edb564-a93e-46c5-ae41-ab9d06b7e556 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.694047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edb564-a93e-46c5-ae41-ab9d06b7e556 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.694347 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edb564-a93e-46c5-ae41-ab9d06b7e556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.723470 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-17edb564-a93e-46c5-ae41-ab9d06b7e556 None None] MFA Rules not processed for user `c52acbcf9fda401f9f74e03746fd2242`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:30.724698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-17edb564-a93e-46c5-ae41-ab9d06b7e556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:30.744458 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:30.791915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1216/2437] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:30.798295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248a1e6-f115-4362-8b66-6a034a087460 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:30.826763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:30.871426 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248a1e6-f115-4362-8b66-6a034a087460 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:30.876802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903bd4-8351-4679-a487-8164013fbbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:30.877454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903bd4-8351-4679-a487-8164013fbbde admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.877733 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903bd4-8351-4679-a487-8164013fbbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.878007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903bd4-8351-4679-a487-8164013fbbde admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.878687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c903bd4-8351-4679-a487-8164013fbbde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:30.880666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c903bd4-8351-4679-a487-8164013fbbde admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:30.912429 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1222/2438] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:30 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:30.923306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edb564-a93e-46c5-ae41-ab9d06b7e556 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:30.934716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edb564-a93e-46c5-ae41-ab9d06b7e556 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:30.990437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be54ae8-569b-4cce-b9f5-359ee0a7a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:30.991149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be54ae8-569b-4cce-b9f5-359ee0a7a60b admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:30.991429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be54ae8-569b-4cce-b9f5-359ee0a7a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:30.991698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be54ae8-569b-4cce-b9f5-359ee0a7a60b admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:30.992432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be54ae8-569b-4cce-b9f5-359ee0a7a60b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:30.994408 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be54ae8-569b-4cce-b9f5-359ee0a7a60b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:31.016786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1217/2439] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:30 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:31.020998 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903bd4-8351-4679-a487-8164013fbbde admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:31.032570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903bd4-8351-4679-a487-8164013fbbde admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:31.037607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e0682-e8df-4c4c-8ddf-7e8a61357e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:31.038309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e0682-e8df-4c4c-8ddf-7e8a61357e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:31.038583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e0682-e8df-4c4c-8ddf-7e8a61357e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:31.038857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e0682-e8df-4c4c-8ddf-7e8a61357e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:31.039734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e0682-e8df-4c4c-8ddf-7e8a61357e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:31.041360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e0682-e8df-4c4c-8ddf-7e8a61357e47 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:31.052832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1223/2440] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:31.056812 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be54ae8-569b-4cce-b9f5-359ee0a7a60b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:31.067152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be54ae8-569b-4cce-b9f5-359ee0a7a60b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:31.071802 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5a2e9-70f8-4600-8c1d-9897cee205b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:31.072692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5a2e9-70f8-4600-8c1d-9897cee205b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:31.072967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5a2e9-70f8-4600-8c1d-9897cee205b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:31.073233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5a2e9-70f8-4600-8c1d-9897cee205b2 admin admin] PATH_INFO: `/v3/projects/9051609981d94788a617da9f85f4ca52/users/19f81913658a4cc99499ececc0d418e3/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:31.088158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5a2e9-70f8-4600-8c1d-9897cee205b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9051609981d94788a617da9f85f4ca52, user_id=19f81913658a4cc99499ececc0d418e3, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:31.090814 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5a2e9-70f8-4600-8c1d-9897cee205b2 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:31.105268 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1218/2441] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:31 2022] PUT /identity/v3/projects/9051609981d94788a617da9f85f4ca52/users/19f81913658a4cc99499ececc0d418e3/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:31.109231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e0682-e8df-4c4c-8ddf-7e8a61357e47 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:31.119298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e0682-e8df-4c4c-8ddf-7e8a61357e47 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:31.175790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3ed7e-4e22-44b3-9e63-6ffce7904091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:31.176389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3ed7e-4e22-44b3-9e63-6ffce7904091 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:31.176673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3ed7e-4e22-44b3-9e63-6ffce7904091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:31.176974 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3ed7e-4e22-44b3-9e63-6ffce7904091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:31.177698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3ed7e-4e22-44b3-9e63-6ffce7904091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:31.179393 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3ed7e-4e22-44b3-9e63-6ffce7904091 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:31.189547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1224/2442] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:31.193762 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5a2e9-70f8-4600-8c1d-9897cee205b2 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:31.204370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5a2e9-70f8-4600-8c1d-9897cee205b2 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:31.209673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d43d8b-b0dc-4db6-900d-08da6c93e0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:31.210583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43d8b-b0dc-4db6-900d-08da6c93e0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:31.210858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43d8b-b0dc-4db6-900d-08da6c93e0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:31.211160 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43d8b-b0dc-4db6-900d-08da6c93e0f8 admin admin] PATH_INFO: `/v3/projects/9051609981d94788a617da9f85f4ca52/users/19f81913658a4cc99499ececc0d418e3/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:31.213656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d43d8b-b0dc-4db6-900d-08da6c93e0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9051609981d94788a617da9f85f4ca52, user_id=19f81913658a4cc99499ececc0d418e3, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:31.216327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d43d8b-b0dc-4db6-900d-08da6c93e0f8 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:31.227128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1219/2443] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:31 2022] PUT /identity/v3/projects/9051609981d94788a617da9f85f4ca52/users/19f81913658a4cc99499ececc0d418e3/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:31.237371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb873a-14d2-466d-8a2b-683be5e9138d None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:31.237690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb873a-14d2-466d-8a2b-683be5e9138d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:31.237985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb873a-14d2-466d-8a2b-683be5e9138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:31.265578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-d3bb873a-14d2-466d-8a2b-683be5e9138d None None] MFA Rules not processed for user `19f81913658a4cc99499ececc0d418e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:31.266792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d3bb873a-14d2-466d-8a2b-683be5e9138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:31.337877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1225/2444] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:31.349666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d43d8b-b0dc-4db6-900d-08da6c93e0f8 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:31.351783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-92d43d8b-b0dc-4db6-900d-08da6c93e0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:31.409960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d43d8b-b0dc-4db6-900d-08da6c93e0f8 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:31.414209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600b1b6-be1b-492c-8063-b7e63914fe8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:31.415004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b1b6-be1b-492c-8063-b7e63914fe8f service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:31.415293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b1b6-be1b-492c-8063-b7e63914fe8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:31.415573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b1b6-be1b-492c-8063-b7e63914fe8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:31.451578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:31.480478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600b1b6-be1b-492c-8063-b7e63914fe8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:31.481947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600b1b6-be1b-492c-8063-b7e63914fe8f service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:31.491630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1220/2445] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:32.855090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb873a-14d2-466d-8a2b-683be5e9138d None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:32.856500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-d3bb873a-14d2-466d-8a2b-683be5e9138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:32.869012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb873a-14d2-466d-8a2b-683be5e9138d None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:32.872855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933e0d4-0823-4786-aa1d-3ee75215bc5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:32.873523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933e0d4-0823-4786-aa1d-3ee75215bc5d service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:32.873780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933e0d4-0823-4786-aa1d-3ee75215bc5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:32.874060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933e0d4-0823-4786-aa1d-3ee75215bc5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:32.883724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933e0d4-0823-4786-aa1d-3ee75215bc5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:32.885227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933e0d4-0823-4786-aa1d-3ee75215bc5d service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:32.894886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1226/2446] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:36.692141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600b1b6-be1b-492c-8063-b7e63914fe8f service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:36.765502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600b1b6-be1b-492c-8063-b7e63914fe8f service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:36.770573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:36.771473 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:36.771752 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:36.772029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] PATH_INFO: `/v3/users/c52acbcf9fda401f9f74e03746fd2242` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:36.773199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52acbcf9fda401f9f74e03746fd2242)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:36.775145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:36.821971 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52acbcf9fda401f9f74e03746fd2242'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:36.834628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52acbcf9fda401f9f74e03746fd2242'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:36.835352 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52acbcf9fda401f9f74e03746fd2242'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:36.842398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52acbcf9fda401f9f74e03746fd2242'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:36.843061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52acbcf9fda401f9f74e03746fd2242'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:36.858766 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1221/2447] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:36 2022] DELETE /identity/v3/users/c52acbcf9fda401f9f74e03746fd2242 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:36.863659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5180e-5ae0-4aea-b54e-53b2d95e1240 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:36.864187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5180e-5ae0-4aea-b54e-53b2d95e1240 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:36.864292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5180e-5ae0-4aea-b54e-53b2d95e1240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:36.881840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:36.888544 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-cae5180e-5ae0-4aea-b54e-53b2d95e1240 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:36.890402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-cae5180e-5ae0-4aea-b54e-53b2d95e1240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:36.950221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1227/2448] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:11:36.960172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:36.961765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:37.016287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:37.020324 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f6dc-7e5a-40ca-bfcf-6444420ec482 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:37.025428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098e39c-08e6-40dc-bef9-88a97ad9c06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:37.026136 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e39c-08e6-40dc-bef9-88a97ad9c06c service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:37.026453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e39c-08e6-40dc-bef9-88a97ad9c06c service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:37.026733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e39c-08e6-40dc-bef9-88a97ad9c06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:37.042024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098e39c-08e6-40dc-bef9-88a97ad9c06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:37.044362 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098e39c-08e6-40dc-bef9-88a97ad9c06c service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:37.058395 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1222/2449] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:37.340045 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5180e-5ae0-4aea-b54e-53b2d95e1240 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:37.342354 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-cae5180e-5ae0-4aea-b54e-53b2d95e1240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:37.362214 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5180e-5ae0-4aea-b54e-53b2d95e1240 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:37.368357 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:37.369308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:37.369617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:37.369951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] PATH_INFO: `/v3/projects/7d40f667748a43e1af46e0eabe869df6` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:37.371119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d40f667748a43e1af46e0eabe869df6)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:37.373052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:37.426773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d40f667748a43e1af46e0eabe869df6', 'request_id': 'req-103ed574-3ab6-404c-ba78-42db11ab47ad'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:37.432984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d40f667748a43e1af46e0eabe869df6', 'request_id': 'req-103ed574-3ab6-404c-ba78-42db11ab47ad'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:37.442385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d40f667748a43e1af46e0eabe869df6', 'request_id': 'req-103ed574-3ab6-404c-ba78-42db11ab47ad'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:37.453645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] The token cache is being invalidate because project 7d40f667748a43e1af46e0eabe869df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:37.453941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:37.454613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:37.456519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1228/2450] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:37 2022] DELETE /identity/v3/projects/7d40f667748a43e1af46e0eabe869df6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:37.460376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098e39c-08e6-40dc-bef9-88a97ad9c06c service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:37.470220 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098e39c-08e6-40dc-bef9-88a97ad9c06c service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:37.534475 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934d6ef-f3de-497f-9b0e-ff2a42252fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:37.535534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934d6ef-f3de-497f-9b0e-ff2a42252fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:37.535756 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934d6ef-f3de-497f-9b0e-ff2a42252fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:37.536034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934d6ef-f3de-497f-9b0e-ff2a42252fd8 admin admin] PATH_INFO: `/v3/users/19f81913658a4cc99499ececc0d418e3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:37.537275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934d6ef-f3de-497f-9b0e-ff2a42252fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f81913658a4cc99499ececc0d418e3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:37.539257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934d6ef-f3de-497f-9b0e-ff2a42252fd8 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:37.588420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7934d6ef-f3de-497f-9b0e-ff2a42252fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f81913658a4cc99499ececc0d418e3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:37.601019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7934d6ef-f3de-497f-9b0e-ff2a42252fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f81913658a4cc99499ececc0d418e3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:37.601710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7934d6ef-f3de-497f-9b0e-ff2a42252fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f81913658a4cc99499ececc0d418e3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:37.609019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7934d6ef-f3de-497f-9b0e-ff2a42252fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f81913658a4cc99499ececc0d418e3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:37.609666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7934d6ef-f3de-497f-9b0e-ff2a42252fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f81913658a4cc99499ececc0d418e3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:37.623617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1223/2451] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:37 2022] DELETE /identity/v3/users/19f81913658a4cc99499ececc0d418e3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:37.909077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:37.911257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:37.926231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ed574-3ab6-404c-ba78-42db11ab47ad admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:37.991115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:37.992015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:37.992302 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:37.992567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] PATH_INFO: `/v3/projects/9051609981d94788a617da9f85f4ca52` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:37.993802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9051609981d94788a617da9f85f4ca52)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:37.995835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:38.032248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:38.051575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9051609981d94788a617da9f85f4ca52', 'request_id': 'req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:38.060386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9051609981d94788a617da9f85f4ca52', 'request_id': 'req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:38.070582 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9051609981d94788a617da9f85f4ca52', 'request_id': 'req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:38.082954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] The token cache is being invalidate because project 9051609981d94788a617da9f85f4ca52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:38.083275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:38.083922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-cbbcc1f2-866d-4414-a467-fa9b7fb6fac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:38.085654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1229/2452] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:37 2022] DELETE /identity/v3/projects/9051609981d94788a617da9f85f4ca52 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:38.090445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c6d6e-2422-4773-9c3e-ea1b9b5c21d2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.090978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c6d6e-2422-4773-9c3e-ea1b9b5c21d2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.090978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c6d6e-2422-4773-9c3e-ea1b9b5c21d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.109006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-036c6d6e-2422-4773-9c3e-ea1b9b5c21d2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:38.110236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-036c6d6e-2422-4773-9c3e-ea1b9b5c21d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:38.178774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1224/2453] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:38.186850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e6ea-f02c-4fe7-8a75-9e65b1001ff9 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.187160 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e6ea-f02c-4fe7-8a75-9e65b1001ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.187437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e6ea-f02c-4fe7-8a75-9e65b1001ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.207275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-b642e6ea-f02c-4fe7-8a75-9e65b1001ff9 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:38.208604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b642e6ea-f02c-4fe7-8a75-9e65b1001ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:38.217543 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1230/2454] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:38.221915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c6d6e-2422-4773-9c3e-ea1b9b5c21d2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:38.232005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c6d6e-2422-4773-9c3e-ea1b9b5c21d2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:38.236934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b917b2d-00b0-4976-ae12-99005dc54e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:38.237635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917b2d-00b0-4976-ae12-99005dc54e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.238010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917b2d-00b0-4976-ae12-99005dc54e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.238349 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b917b2d-00b0-4976-ae12-99005dc54e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.239103 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b917b2d-00b0-4976-ae12-99005dc54e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:11:38.239438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b917b2d-00b0-4976-ae12-99005dc54e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:38.241048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b917b2d-00b0-4976-ae12-99005dc54e07 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:38.247992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:38.253311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1225/2455] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:11:38.257949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642e6ea-f02c-4fe7-8a75-9e65b1001ff9 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:38.267374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642e6ea-f02c-4fe7-8a75-9e65b1001ff9 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:38.272226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97f1c3-2c48-4842-81b1-3aff0d6295b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:38.272913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97f1c3-2c48-4842-81b1-3aff0d6295b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.273189 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97f1c3-2c48-4842-81b1-3aff0d6295b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.273461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97f1c3-2c48-4842-81b1-3aff0d6295b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.274173 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97f1c3-2c48-4842-81b1-3aff0d6295b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:38.276165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97f1c3-2c48-4842-81b1-3aff0d6295b1 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:38.307602 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1231/2456] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:38 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:38.308716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b917b2d-00b0-4976-ae12-99005dc54e07 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:38.320618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b917b2d-00b0-4976-ae12-99005dc54e07 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:38.380894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79662-9338-4cf9-b278-1506083d93bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:38.381578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79662-9338-4cf9-b278-1506083d93bd admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.381859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79662-9338-4cf9-b278-1506083d93bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.382152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79662-9338-4cf9-b278-1506083d93bd admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.382834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c79662-9338-4cf9-b278-1506083d93bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:38.388988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c79662-9338-4cf9-b278-1506083d93bd admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:38.412983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1226/2457] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:38 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:38.417189 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97f1c3-2c48-4842-81b1-3aff0d6295b1 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:38.427626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97f1c3-2c48-4842-81b1-3aff0d6295b1 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:38.432423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b0297-f8ad-4820-b844-9c3947df470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:38.433107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0297-f8ad-4820-b844-9c3947df470c admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.433386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0297-f8ad-4820-b844-9c3947df470c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.433656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0297-f8ad-4820-b844-9c3947df470c admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.434411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b0297-f8ad-4820-b844-9c3947df470c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:38.436056 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b0297-f8ad-4820-b844-9c3947df470c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:38.448157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1232/2458] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:38.452155 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79662-9338-4cf9-b278-1506083d93bd admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:38.462727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79662-9338-4cf9-b278-1506083d93bd admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:38.468459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068057ee-4a90-4f86-842a-5a9f453b59b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:38.469247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068057ee-4a90-4f86-842a-5a9f453b59b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.469575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068057ee-4a90-4f86-842a-5a9f453b59b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.469832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068057ee-4a90-4f86-842a-5a9f453b59b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.470554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068057ee-4a90-4f86-842a-5a9f453b59b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:38.472201 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068057ee-4a90-4f86-842a-5a9f453b59b7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:38.483549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1227/2459] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:11:38.487904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b0297-f8ad-4820-b844-9c3947df470c admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:38.499594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b0297-f8ad-4820-b844-9c3947df470c admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:38.505046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507747a-95d1-4a88-a5b2-078767e4d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:38.505959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507747a-95d1-4a88-a5b2-078767e4d8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.506247 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507747a-95d1-4a88-a5b2-078767e4d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.506522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507747a-95d1-4a88-a5b2-078767e4d8fa admin admin] PATH_INFO: `/v3/projects/68fe9f7b5c8b450e9756a59c13a17e9d/users/8881bb546ddc4daa938ae71973a3045f/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.526462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507747a-95d1-4a88-a5b2-078767e4d8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fe9f7b5c8b450e9756a59c13a17e9d, user_id=8881bb546ddc4daa938ae71973a3045f, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:38.528236 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507747a-95d1-4a88-a5b2-078767e4d8fa admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:38.546921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1233/2460] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:38 2022] PUT /identity/v3/projects/68fe9f7b5c8b450e9756a59c13a17e9d/users/8881bb546ddc4daa938ae71973a3045f/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:38.557911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed1837-27ba-4cbb-b371-54822e15a331 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.558211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed1837-27ba-4cbb-b371-54822e15a331 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.558555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed1837-27ba-4cbb-b371-54822e15a331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.589137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-4aed1837-27ba-4cbb-b371-54822e15a331 None None] MFA Rules not processed for user `8881bb546ddc4daa938ae71973a3045f`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:38.590375 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4aed1837-27ba-4cbb-b371-54822e15a331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:38.660539 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1228/2461] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:38.664828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507747a-95d1-4a88-a5b2-078767e4d8fa admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:38.734133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507747a-95d1-4a88-a5b2-078767e4d8fa admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:38.739343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8ab5e-52f0-4d34-b11e-96fbf606dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:38.740281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8ab5e-52f0-4d34-b11e-96fbf606dbea admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.740909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8ab5e-52f0-4d34-b11e-96fbf606dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.741420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8ab5e-52f0-4d34-b11e-96fbf606dbea admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.742828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8ab5e-52f0-4d34-b11e-96fbf606dbea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:38.744915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8ab5e-52f0-4d34-b11e-96fbf606dbea admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:38.775770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1234/2462] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:38 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:38.780393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed1837-27ba-4cbb-b371-54822e15a331 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:38.793241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed1837-27ba-4cbb-b371-54822e15a331 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:38.855280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc7ae7-8f3b-4e1a-8740-3e24e26a87b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:38.855962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7ae7-8f3b-4e1a-8740-3e24e26a87b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.856251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7ae7-8f3b-4e1a-8740-3e24e26a87b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.856529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7ae7-8f3b-4e1a-8740-3e24e26a87b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.857354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc7ae7-8f3b-4e1a-8740-3e24e26a87b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:38.859334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc7ae7-8f3b-4e1a-8740-3e24e26a87b9 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:38.869713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:38.883085 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1229/2463] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:38 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:38.887381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8ab5e-52f0-4d34-b11e-96fbf606dbea admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:38.898028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8ab5e-52f0-4d34-b11e-96fbf606dbea admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:38.902805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843df56-5521-4e7e-94b1-3d3c5959a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:38.903588 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843df56-5521-4e7e-94b1-3d3c5959a0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.904297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843df56-5521-4e7e-94b1-3d3c5959a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.904648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843df56-5521-4e7e-94b1-3d3c5959a0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.905449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843df56-5521-4e7e-94b1-3d3c5959a0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:38.907091 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843df56-5521-4e7e-94b1-3d3c5959a0b9 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:38.923126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1235/2464] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:11:38.925142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc7ae7-8f3b-4e1a-8740-3e24e26a87b9 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:38.936030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc7ae7-8f3b-4e1a-8740-3e24e26a87b9 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:38.942723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380352c3-189e-4fe5-83f8-73239eefd30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:38.943677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380352c3-189e-4fe5-83f8-73239eefd30a admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:38.943962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380352c3-189e-4fe5-83f8-73239eefd30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:38.944242 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380352c3-189e-4fe5-83f8-73239eefd30a admin admin] PATH_INFO: `/v3/projects/f2f6a6380d214a9ebe81cd1222989748/users/f7ca493b78a24c01bd6da458a2b25c4a/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:38.963048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380352c3-189e-4fe5-83f8-73239eefd30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f6a6380d214a9ebe81cd1222989748, user_id=f7ca493b78a24c01bd6da458a2b25c4a, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:38.965785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380352c3-189e-4fe5-83f8-73239eefd30a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:38.982746 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1230/2465] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:38 2022] PUT /identity/v3/projects/f2f6a6380d214a9ebe81cd1222989748/users/f7ca493b78a24c01bd6da458a2b25c4a/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:11:38.986670 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843df56-5521-4e7e-94b1-3d3c5959a0b9 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:38.997228 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843df56-5521-4e7e-94b1-3d3c5959a0b9 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:39.029782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:39.065084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823c398-79a5-4b89-8466-2b7d7e64a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:39.065688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823c398-79a5-4b89-8466-2b7d7e64a1de admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:39.065968 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823c398-79a5-4b89-8466-2b7d7e64a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:39.066295 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823c398-79a5-4b89-8466-2b7d7e64a1de admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:39.067331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823c398-79a5-4b89-8466-2b7d7e64a1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:39.069188 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823c398-79a5-4b89-8466-2b7d7e64a1de admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:39.084669 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1236/2466] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:39.087248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380352c3-189e-4fe5-83f8-73239eefd30a admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:39.099086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380352c3-189e-4fe5-83f8-73239eefd30a admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:39.105456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2dbab-dd0e-4aef-a0b5-62f3e0979124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:39.105649 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2dbab-dd0e-4aef-a0b5-62f3e0979124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:39.105862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2dbab-dd0e-4aef-a0b5-62f3e0979124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:39.106146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2dbab-dd0e-4aef-a0b5-62f3e0979124 admin admin] PATH_INFO: `/v3/projects/f2f6a6380d214a9ebe81cd1222989748/users/f7ca493b78a24c01bd6da458a2b25c4a/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:39.108195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2dbab-dd0e-4aef-a0b5-62f3e0979124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f6a6380d214a9ebe81cd1222989748, user_id=f7ca493b78a24c01bd6da458a2b25c4a, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:39.110862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2dbab-dd0e-4aef-a0b5-62f3e0979124 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:39.123290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1231/2467] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:39 2022] PUT /identity/v3/projects/f2f6a6380d214a9ebe81cd1222989748/users/f7ca493b78a24c01bd6da458a2b25c4a/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:39.134293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd126b-d410-4f0a-a9a6-979c5ee19db8 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:39.134585 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd126b-d410-4f0a-a9a6-979c5ee19db8 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:39.134949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd126b-d410-4f0a-a9a6-979c5ee19db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:39.166201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-a6bd126b-d410-4f0a-a9a6-979c5ee19db8 None None] MFA Rules not processed for user `f7ca493b78a24c01bd6da458a2b25c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:39.167554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a6bd126b-d410-4f0a-a9a6-979c5ee19db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:39.262592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1237/2468] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:39.274035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2dbab-dd0e-4aef-a0b5-62f3e0979124 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:39.276237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c8f2dbab-dd0e-4aef-a0b5-62f3e0979124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:39.340460 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2dbab-dd0e-4aef-a0b5-62f3e0979124 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:39.344308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbe5e0-6287-48a8-894c-dfa38767efe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:39.344991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbe5e0-6287-48a8-894c-dfa38767efe3 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:39.345244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbe5e0-6287-48a8-894c-dfa38767efe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:39.345551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbe5e0-6287-48a8-894c-dfa38767efe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:39.355107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbe5e0-6287-48a8-894c-dfa38767efe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:39.356567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbe5e0-6287-48a8-894c-dfa38767efe3 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:39.366113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1232/2469] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:39.432636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd126b-d410-4f0a-a9a6-979c5ee19db8 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:39.499988 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd126b-d410-4f0a-a9a6-979c5ee19db8 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:39.504719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:39.505615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:39.505897 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:39.506179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] PATH_INFO: `/v3/users/8881bb546ddc4daa938ae71973a3045f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:39.507421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8881bb546ddc4daa938ae71973a3045f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:39.509488 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:39.560824 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8881bb546ddc4daa938ae71973a3045f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:39.566705 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:39.575626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8881bb546ddc4daa938ae71973a3045f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:39.583666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8881bb546ddc4daa938ae71973a3045f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:39.591702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8881bb546ddc4daa938ae71973a3045f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:39.592913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8881bb546ddc4daa938ae71973a3045f'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:39.598584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1238/2470] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:39 2022] DELETE /identity/v3/users/8881bb546ddc4daa938ae71973a3045f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:39.603455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e89276-f4f6-4104-99c1-c0694ff071b8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:39.603770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e89276-f4f6-4104-99c1-c0694ff071b8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:39.604037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e89276-f4f6-4104-99c1-c0694ff071b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:39.624350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e8e89276-f4f6-4104-99c1-c0694ff071b8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:39.625610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e8e89276-f4f6-4104-99c1-c0694ff071b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:39.684784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1233/2471] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:39.694891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:39.697558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:39.755951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0cc7-706d-4c77-83cd-a2cdf8a84e9b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:39.760078 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c01da7-44fb-469d-8766-1d18a338d844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:39.760725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c01da7-44fb-469d-8766-1d18a338d844 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:39.761017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c01da7-44fb-469d-8766-1d18a338d844 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:39.761296 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c01da7-44fb-469d-8766-1d18a338d844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:39.770977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c01da7-44fb-469d-8766-1d18a338d844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:39.772480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c01da7-44fb-469d-8766-1d18a338d844 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:39.782574 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1239/2472] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:40.066182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e89276-f4f6-4104-99c1-c0694ff071b8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:40.067728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e8e89276-f4f6-4104-99c1-c0694ff071b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:40.080197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e89276-f4f6-4104-99c1-c0694ff071b8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:40.085589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:40.086756 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:40.087073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:40.087379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] PATH_INFO: `/v3/projects/68fe9f7b5c8b450e9756a59c13a17e9d` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:40.088754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fe9f7b5c8b450e9756a59c13a17e9d)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:40.090725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:40.140918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fe9f7b5c8b450e9756a59c13a17e9d', 'request_id': 'req-3163ff3c-be2a-49b6-8666-dcaec9efc955'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.147719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fe9f7b5c8b450e9756a59c13a17e9d', 'request_id': 'req-3163ff3c-be2a-49b6-8666-dcaec9efc955'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.150411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:40.156911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fe9f7b5c8b450e9756a59c13a17e9d', 'request_id': 'req-3163ff3c-be2a-49b6-8666-dcaec9efc955'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.170070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] The token cache is being invalidate because project 68fe9f7b5c8b450e9756a59c13a17e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:40.170360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.171024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.172623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1234/2473] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:40 2022] DELETE /identity/v3/projects/68fe9f7b5c8b450e9756a59c13a17e9d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:40.176719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c01da7-44fb-469d-8766-1d18a338d844 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:40.187073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c01da7-44fb-469d-8766-1d18a338d844 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:40.252083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44c196-1656-4245-8542-f9c1b105f2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:40.252984 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c196-1656-4245-8542-f9c1b105f2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:40.253259 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c196-1656-4245-8542-f9c1b105f2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:40.253513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c196-1656-4245-8542-f9c1b105f2f8 admin admin] PATH_INFO: `/v3/users/f7ca493b78a24c01bd6da458a2b25c4a` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:40.255312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44c196-1656-4245-8542-f9c1b105f2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ca493b78a24c01bd6da458a2b25c4a)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:40.258557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44c196-1656-4245-8542-f9c1b105f2f8 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:40.309697 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4c44c196-1656-4245-8542-f9c1b105f2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ca493b78a24c01bd6da458a2b25c4a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.322586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4c44c196-1656-4245-8542-f9c1b105f2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ca493b78a24c01bd6da458a2b25c4a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.333615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4c44c196-1656-4245-8542-f9c1b105f2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ca493b78a24c01bd6da458a2b25c4a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.338488 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:40.341496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4c44c196-1656-4245-8542-f9c1b105f2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ca493b78a24c01bd6da458a2b25c4a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.342712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4c44c196-1656-4245-8542-f9c1b105f2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ca493b78a24c01bd6da458a2b25c4a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.351461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1240/2474] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:40 2022] DELETE /identity/v3/users/f7ca493b78a24c01bd6da458a2b25c4a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:40.632225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:40.634241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:40.650586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163ff3c-be2a-49b6-8666-dcaec9efc955 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:40.710296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:40.711137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:40.711415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:40.711696 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] PATH_INFO: `/v3/projects/f2f6a6380d214a9ebe81cd1222989748` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:40.712894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f6a6380d214a9ebe81cd1222989748)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:40.714895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:40.765029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f6a6380d214a9ebe81cd1222989748', 'request_id': 'req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.771102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f6a6380d214a9ebe81cd1222989748', 'request_id': 'req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.780094 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f6a6380d214a9ebe81cd1222989748', 'request_id': 'req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.791298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] The token cache is being invalidate because project f2f6a6380d214a9ebe81cd1222989748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:40.791583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.792267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-724c37ce-38a8-4ac6-a166-6a7614a2fd8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:40.793891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1235/2475] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:40 2022] DELETE /identity/v3/projects/f2f6a6380d214a9ebe81cd1222989748 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:40.798877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63064c-bf0a-47c5-9917-51f59b6f8e3a None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:40.799264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63064c-bf0a-47c5-9917-51f59b6f8e3a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:40.799542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63064c-bf0a-47c5-9917-51f59b6f8e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:40.824497 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8c63064c-bf0a-47c5-9917-51f59b6f8e3a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:40.825963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8c63064c-bf0a-47c5-9917-51f59b6f8e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:40.889349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1241/2476] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:40.897489 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932c992-7947-4d91-bcf1-e3a18167a442 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:40.897780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932c992-7947-4d91-bcf1-e3a18167a442 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:40.898056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932c992-7947-4d91-bcf1-e3a18167a442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:40.919177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7932c992-7947-4d91-bcf1-e3a18167a442 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:40.920392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7932c992-7947-4d91-bcf1-e3a18167a442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:40.930319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1236/2477] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:40.935322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63064c-bf0a-47c5-9917-51f59b6f8e3a None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:40.949498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63064c-bf0a-47c5-9917-51f59b6f8e3a None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:40.957849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e877f-14b1-474c-98fe-62f6178284f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:40.958731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e877f-14b1-474c-98fe-62f6178284f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:40.959026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e877f-14b1-474c-98fe-62f6178284f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:40.959305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e877f-14b1-474c-98fe-62f6178284f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:40.960375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e877f-14b1-474c-98fe-62f6178284f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:11:40.960620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e877f-14b1-474c-98fe-62f6178284f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:40.963052 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e877f-14b1-474c-98fe-62f6178284f2 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:40.975750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1242/2478] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:11:40.980528 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932c992-7947-4d91-bcf1-e3a18167a442 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:40.994850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932c992-7947-4d91-bcf1-e3a18167a442 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:41.001298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3fc68-c393-4bbc-a4a2-e22c219dca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:41.001970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3fc68-c393-4bbc-a4a2-e22c219dca76 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.002250 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3fc68-c393-4bbc-a4a2-e22c219dca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.002525 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3fc68-c393-4bbc-a4a2-e22c219dca76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.003524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3fc68-c393-4bbc-a4a2-e22c219dca76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:41.005453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3fc68-c393-4bbc-a4a2-e22c219dca76 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:41.036086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1237/2479] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:40 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:41.040397 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e877f-14b1-474c-98fe-62f6178284f2 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:41.051235 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e877f-14b1-474c-98fe-62f6178284f2 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:41.117805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af5f6-abb6-4a45-aa84-0593af135dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:41.118474 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af5f6-abb6-4a45-aa84-0593af135dee admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.118753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af5f6-abb6-4a45-aa84-0593af135dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.119061 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af5f6-abb6-4a45-aa84-0593af135dee admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.119742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af5f6-abb6-4a45-aa84-0593af135dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:41.121714 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af5f6-abb6-4a45-aa84-0593af135dee admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:41.143554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1243/2480] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:41 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:41.147822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3fc68-c393-4bbc-a4a2-e22c219dca76 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:41.158596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3fc68-c393-4bbc-a4a2-e22c219dca76 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:41.163397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4971-f6e0-4217-9593-0e602b1efae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:41.164054 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4971-f6e0-4217-9593-0e602b1efae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.164334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4971-f6e0-4217-9593-0e602b1efae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.164603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4971-f6e0-4217-9593-0e602b1efae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.165327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4971-f6e0-4217-9593-0e602b1efae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:41.166916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4971-f6e0-4217-9593-0e602b1efae3 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:41.177532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1238/2481] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:41.181477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af5f6-abb6-4a45-aa84-0593af135dee admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:41.191793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af5f6-abb6-4a45-aa84-0593af135dee admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:41.196650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa1922-50ed-4c53-8db9-24e950976a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:41.197298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa1922-50ed-4c53-8db9-24e950976a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.197575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa1922-50ed-4c53-8db9-24e950976a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.197855 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa1922-50ed-4c53-8db9-24e950976a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.198565 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa1922-50ed-4c53-8db9-24e950976a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:41.200288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa1922-50ed-4c53-8db9-24e950976a2a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:41.210109 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1244/2482] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:41.214112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4971-f6e0-4217-9593-0e602b1efae3 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:41.224139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4971-f6e0-4217-9593-0e602b1efae3 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:41.229182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495428ed-2629-4224-ac67-633195286721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:41.230132 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495428ed-2629-4224-ac67-633195286721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.230392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495428ed-2629-4224-ac67-633195286721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.230676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495428ed-2629-4224-ac67-633195286721 admin admin] PATH_INFO: `/v3/projects/67bee3263fae482bbf3f2582919af376/users/a2695384222f48a99c309838bda51692/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.247021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495428ed-2629-4224-ac67-633195286721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67bee3263fae482bbf3f2582919af376, user_id=a2695384222f48a99c309838bda51692, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:41.249692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495428ed-2629-4224-ac67-633195286721 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:41.265192 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1239/2483] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:41 2022] PUT /identity/v3/projects/67bee3263fae482bbf3f2582919af376/users/a2695384222f48a99c309838bda51692/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:41.276361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d03b-7c0d-4c20-80b8-8dd71612789b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.276648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d03b-7c0d-4c20-80b8-8dd71612789b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.276958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d03b-7c0d-4c20-80b8-8dd71612789b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.311384 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-07a5d03b-7c0d-4c20-80b8-8dd71612789b None None] MFA Rules not processed for user `a2695384222f48a99c309838bda51692`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:41.312607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-07a5d03b-7c0d-4c20-80b8-8dd71612789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:41.362896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:41.387930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1245/2484] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:41.392575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495428ed-2629-4224-ac67-633195286721 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:41.405570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:41.454810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495428ed-2629-4224-ac67-633195286721 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:41.460099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f29ce-43b3-4796-a13c-f6a64c3f1751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:41.460747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f29ce-43b3-4796-a13c-f6a64c3f1751 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.461023 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f29ce-43b3-4796-a13c-f6a64c3f1751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.461298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f29ce-43b3-4796-a13c-f6a64c3f1751 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.461981 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f29ce-43b3-4796-a13c-f6a64c3f1751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:41.463934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f29ce-43b3-4796-a13c-f6a64c3f1751 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:41.491037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1240/2485] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:41 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:41.496621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5d03b-7c0d-4c20-80b8-8dd71612789b None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:41.511180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5d03b-7c0d-4c20-80b8-8dd71612789b None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:41.569171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec660c-b4e2-4eb7-9a6d-10e2b75fa334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:41.569994 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec660c-b4e2-4eb7-9a6d-10e2b75fa334 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.570299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec660c-b4e2-4eb7-9a6d-10e2b75fa334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.570574 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec660c-b4e2-4eb7-9a6d-10e2b75fa334 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.571288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec660c-b4e2-4eb7-9a6d-10e2b75fa334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:41.573259 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec660c-b4e2-4eb7-9a6d-10e2b75fa334 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:41.596852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1246/2486] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:41 2022] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:41.600875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f29ce-43b3-4796-a13c-f6a64c3f1751 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:41.611308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f29ce-43b3-4796-a13c-f6a64c3f1751 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:41.616745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75481ca4-e229-4299-81a6-d0f79520d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:41.617431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75481ca4-e229-4299-81a6-d0f79520d74e admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.617723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75481ca4-e229-4299-81a6-d0f79520d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.618001 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75481ca4-e229-4299-81a6-d0f79520d74e admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.618719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75481ca4-e229-4299-81a6-d0f79520d74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:41.620504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75481ca4-e229-4299-81a6-d0f79520d74e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:41.631740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1241/2487] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:41.636223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec660c-b4e2-4eb7-9a6d-10e2b75fa334 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:41.646364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec660c-b4e2-4eb7-9a6d-10e2b75fa334 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:41.651383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2e96f-b494-4c83-9532-81b44504a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:41.652325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e96f-b494-4c83-9532-81b44504a850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.652606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e96f-b494-4c83-9532-81b44504a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.652900 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e96f-b494-4c83-9532-81b44504a850 admin admin] PATH_INFO: `/v3/projects/206309c0269a442eaa324cd0875cdad1/users/23c5ddc58866491f8b4ed6221d686c21/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.668325 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2e96f-b494-4c83-9532-81b44504a850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=206309c0269a442eaa324cd0875cdad1, user_id=23c5ddc58866491f8b4ed6221d686c21, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:41.671039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2e96f-b494-4c83-9532-81b44504a850 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:41.686065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1247/2488] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:41 2022] PUT /identity/v3/projects/206309c0269a442eaa324cd0875cdad1/users/23c5ddc58866491f8b4ed6221d686c21/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:41.690092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75481ca4-e229-4299-81a6-d0f79520d74e admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:41.700330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75481ca4-e229-4299-81a6-d0f79520d74e admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:41.760070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cd7b4-d04e-4b88-97c4-2a6cb62044f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:41.760646 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cd7b4-d04e-4b88-97c4-2a6cb62044f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.760952 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cd7b4-d04e-4b88-97c4-2a6cb62044f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.761264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cd7b4-d04e-4b88-97c4-2a6cb62044f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.761993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cd7b4-d04e-4b88-97c4-2a6cb62044f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:41.763661 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cd7b4-d04e-4b88-97c4-2a6cb62044f0 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:41.773459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1242/2489] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:11:41.777920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2e96f-b494-4c83-9532-81b44504a850 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:41.789020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2e96f-b494-4c83-9532-81b44504a850 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:41.794609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b2bbc-de9e-43e8-ad74-a3e59d4fb1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:41.795542 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b2bbc-de9e-43e8-ad74-a3e59d4fb1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.795823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b2bbc-de9e-43e8-ad74-a3e59d4fb1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.796097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b2bbc-de9e-43e8-ad74-a3e59d4fb1d7 admin admin] PATH_INFO: `/v3/projects/206309c0269a442eaa324cd0875cdad1/users/23c5ddc58866491f8b4ed6221d686c21/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.798328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b2bbc-de9e-43e8-ad74-a3e59d4fb1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=206309c0269a442eaa324cd0875cdad1, user_id=23c5ddc58866491f8b4ed6221d686c21, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:41.801009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b2bbc-de9e-43e8-ad74-a3e59d4fb1d7 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:41.812046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1248/2490] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:41 2022] PUT /identity/v3/projects/206309c0269a442eaa324cd0875cdad1/users/23c5ddc58866491f8b4ed6221d686c21/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:41.822337 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a16b4-fff5-4368-8554-03189e950eaf None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:41.822744 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a16b4-fff5-4368-8554-03189e950eaf None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:41.823074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a16b4-fff5-4368-8554-03189e950eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:41.849653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-aa5a16b4-fff5-4368-8554-03189e950eaf None None] MFA Rules not processed for user `23c5ddc58866491f8b4ed6221d686c21`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:41.850846 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-aa5a16b4-fff5-4368-8554-03189e950eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:41.920478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1243/2491] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:11:41.931841 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b2bbc-de9e-43e8-ad74-a3e59d4fb1d7 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:41.933959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6c0b2bbc-de9e-43e8-ad74-a3e59d4fb1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:42.008873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b2bbc-de9e-43e8-ad74-a3e59d4fb1d7 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:42.013294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdd822-9990-41ff-b2e6-916ffe92a02a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:42.013870 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdd822-9990-41ff-b2e6-916ffe92a02a service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:42.014148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdd822-9990-41ff-b2e6-916ffe92a02a service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:42.014420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdd822-9990-41ff-b2e6-916ffe92a02a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:42.023947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdd822-9990-41ff-b2e6-916ffe92a02a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:42.025391 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdd822-9990-41ff-b2e6-916ffe92a02a service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:42.035374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1249/2492] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:42.170394 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a16b4-fff5-4368-8554-03189e950eaf None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:42.182109 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:42.237430 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a16b4-fff5-4368-8554-03189e950eaf None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:42.242932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:42.243836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:42.244117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:42.244394 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] PATH_INFO: `/v3/users/a2695384222f48a99c309838bda51692` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:42.245720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2695384222f48a99c309838bda51692)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:42.247699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:42.297351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2695384222f48a99c309838bda51692'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:42.309168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2695384222f48a99c309838bda51692'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:42.309863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2695384222f48a99c309838bda51692'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:42.316675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2695384222f48a99c309838bda51692'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:42.317313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2695384222f48a99c309838bda51692'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:42.332078 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1244/2493] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:42 2022] DELETE /identity/v3/users/a2695384222f48a99c309838bda51692 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:42.336924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f198ce-6901-4b13-9e9c-6537675b50d8 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:42.337406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f198ce-6901-4b13-9e9c-6537675b50d8 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:42.337599 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f198ce-6901-4b13-9e9c-6537675b50d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:42.355245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-58f198ce-6901-4b13-9e9c-6537675b50d8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:42.356493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-58f198ce-6901-4b13-9e9c-6537675b50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:42.396463 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:42.417959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1250/2494] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:42.427974 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:42.429467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:42.491236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329651d3-40cc-426f-97e9-ccf123fadf62 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:42.495992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4c924-c484-4c7d-bea9-8b1770b9de83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:42.496655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c924-c484-4c7d-bea9-8b1770b9de83 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:42.496935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c924-c484-4c7d-bea9-8b1770b9de83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:42.497215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c924-c484-4c7d-bea9-8b1770b9de83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:42.507124 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4c924-c484-4c7d-bea9-8b1770b9de83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:42.508584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4c924-c484-4c7d-bea9-8b1770b9de83 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:42.518519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1245/2495] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:42.798156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f198ce-6901-4b13-9e9c-6537675b50d8 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:42.799719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-58f198ce-6901-4b13-9e9c-6537675b50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:42.812051 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f198ce-6901-4b13-9e9c-6537675b50d8 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:42.816915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:42.817728 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:42.818004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:42.818385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] PATH_INFO: `/v3/projects/67bee3263fae482bbf3f2582919af376` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:42.819623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67bee3263fae482bbf3f2582919af376)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:42.821558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:42.868645 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67bee3263fae482bbf3f2582919af376', 'request_id': 'req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:42.874563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67bee3263fae482bbf3f2582919af376', 'request_id': 'req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:42.882415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67bee3263fae482bbf3f2582919af376', 'request_id': 'req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:42.892431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] The token cache is being invalidate because project 67bee3263fae482bbf3f2582919af376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:42.892711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:42.893356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:42.894925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1251/2496] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:42 2022] DELETE /identity/v3/projects/67bee3263fae482bbf3f2582919af376 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:42.899125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4c924-c484-4c7d-bea9-8b1770b9de83 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:42.909567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4c924-c484-4c7d-bea9-8b1770b9de83 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:42.937194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:42.971341 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68a788-3107-4f6b-b37c-535113590185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:42.972225 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68a788-3107-4f6b-b37c-535113590185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:42.972509 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68a788-3107-4f6b-b37c-535113590185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:42.972786 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68a788-3107-4f6b-b37c-535113590185 admin admin] PATH_INFO: `/v3/users/23c5ddc58866491f8b4ed6221d686c21` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:42.974010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68a788-3107-4f6b-b37c-535113590185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c5ddc58866491f8b4ed6221d686c21)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:42.976011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68a788-3107-4f6b-b37c-535113590185 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:43.031570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7e68a788-3107-4f6b-b37c-535113590185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c5ddc58866491f8b4ed6221d686c21'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:43.044003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7e68a788-3107-4f6b-b37c-535113590185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c5ddc58866491f8b4ed6221d686c21'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:43.044751 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7e68a788-3107-4f6b-b37c-535113590185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c5ddc58866491f8b4ed6221d686c21'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:43.052345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7e68a788-3107-4f6b-b37c-535113590185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c5ddc58866491f8b4ed6221d686c21'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:43.053014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-7e68a788-3107-4f6b-b37c-535113590185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c5ddc58866491f8b4ed6221d686c21'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:43.066728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1246/2497] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:42 2022] DELETE /identity/v3/users/23c5ddc58866491f8b4ed6221d686c21 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:43.348766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:43.350373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:43.367090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86005a86-5cb5-481b-ab8a-bfe1fa4039b5 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:43.424752 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:43.425608 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:43.425890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:43.426159 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] PATH_INFO: `/v3/projects/206309c0269a442eaa324cd0875cdad1` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:43.427393 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=206309c0269a442eaa324cd0875cdad1)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:43.429317 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:43.477372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '206309c0269a442eaa324cd0875cdad1', 'request_id': 'req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:43.483528 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '206309c0269a442eaa324cd0875cdad1', 'request_id': 'req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:43.492044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '206309c0269a442eaa324cd0875cdad1', 'request_id': 'req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:43.498311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:43.503745 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] The token cache is being invalidate because project 206309c0269a442eaa324cd0875cdad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:43.504039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:43.505268 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f7eb1474-ac6f-4f71-b7d5-5bbfb1f140c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:43.506879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1252/2498] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:43 2022] DELETE /identity/v3/projects/206309c0269a442eaa324cd0875cdad1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:43.512182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454e03-f5e9-401f-89f6-2d5f2b39d074 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:43.512659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454e03-f5e9-401f-89f6-2d5f2b39d074 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:43.512774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23454e03-f5e9-401f-89f6-2d5f2b39d074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:43.531554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-23454e03-f5e9-401f-89f6-2d5f2b39d074 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:43.532838 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-23454e03-f5e9-401f-89f6-2d5f2b39d074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:43.597298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1247/2499] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:43.606435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753900c-55c8-4a8d-bcf5-86326c0b7047 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:43.606726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753900c-55c8-4a8d-bcf5-86326c0b7047 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:43.607041 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753900c-55c8-4a8d-bcf5-86326c0b7047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:43.625689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-3753900c-55c8-4a8d-bcf5-86326c0b7047 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:43.626884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3753900c-55c8-4a8d-bcf5-86326c0b7047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:43.635442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1253/2500] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:43.640008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23454e03-f5e9-401f-89f6-2d5f2b39d074 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:43.650376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23454e03-f5e9-401f-89f6-2d5f2b39d074 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:43.656792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaa7d0-5baf-4987-a03b-9755609a9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:43.657462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaa7d0-5baf-4987-a03b-9755609a9708 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:43.657748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaa7d0-5baf-4987-a03b-9755609a9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:43.658026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaa7d0-5baf-4987-a03b-9755609a9708 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:43.658803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eaa7d0-5baf-4987-a03b-9755609a9708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:11:43.659148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eaa7d0-5baf-4987-a03b-9755609a9708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:43.660777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eaa7d0-5baf-4987-a03b-9755609a9708 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:43.673153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1248/2501] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:11:43.677547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753900c-55c8-4a8d-bcf5-86326c0b7047 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:43.687025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753900c-55c8-4a8d-bcf5-86326c0b7047 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:43.692691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3ff71-6df5-4757-a630-39804da5f682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:43.693345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ff71-6df5-4757-a630-39804da5f682 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:43.693625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ff71-6df5-4757-a630-39804da5f682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:43.693872 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ff71-6df5-4757-a630-39804da5f682 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:43.694590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3ff71-6df5-4757-a630-39804da5f682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:43.696562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3ff71-6df5-4757-a630-39804da5f682 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:43.727457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1254/2502] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:43 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:43.732693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaa7d0-5baf-4987-a03b-9755609a9708 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:43.743546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaa7d0-5baf-4987-a03b-9755609a9708 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:43.778723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:43.805714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4108dfa-57de-4948-9b7e-f8c679be53c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:43.806420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108dfa-57de-4948-9b7e-f8c679be53c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:43.806706 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108dfa-57de-4948-9b7e-f8c679be53c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:43.807006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4108dfa-57de-4948-9b7e-f8c679be53c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:43.807722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4108dfa-57de-4948-9b7e-f8c679be53c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:43.809764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4108dfa-57de-4948-9b7e-f8c679be53c0 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:43.831245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1249/2503] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:43 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:43.835444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3ff71-6df5-4757-a630-39804da5f682 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:43.846932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3ff71-6df5-4757-a630-39804da5f682 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:43.851908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaacc41-92a5-48e8-9263-1ead3df4afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:43.852598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaacc41-92a5-48e8-9263-1ead3df4afb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:43.852859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaacc41-92a5-48e8-9263-1ead3df4afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:43.853134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaacc41-92a5-48e8-9263-1ead3df4afb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:43.853852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaacc41-92a5-48e8-9263-1ead3df4afb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:43.855599 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaacc41-92a5-48e8-9263-1ead3df4afb1 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:43.866744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1255/2504] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:43.870967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4108dfa-57de-4948-9b7e-f8c679be53c0 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:43.881489 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4108dfa-57de-4948-9b7e-f8c679be53c0 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:43.887260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453c1f0-224d-4e4e-8670-69c14704a873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:43.887958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c1f0-224d-4e4e-8670-69c14704a873 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:43.888246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c1f0-224d-4e4e-8670-69c14704a873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:43.888523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453c1f0-224d-4e4e-8670-69c14704a873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:43.889230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453c1f0-224d-4e4e-8670-69c14704a873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:43.890859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453c1f0-224d-4e4e-8670-69c14704a873 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:43.901633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1250/2505] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:43.906194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaacc41-92a5-48e8-9263-1ead3df4afb1 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:43.916755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaacc41-92a5-48e8-9263-1ead3df4afb1 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:43.922067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb10f9-f622-49aa-a164-fe02d0777f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:43.922965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb10f9-f622-49aa-a164-fe02d0777f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:43.923271 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb10f9-f622-49aa-a164-fe02d0777f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:43.923552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb10f9-f622-49aa-a164-fe02d0777f76 admin admin] PATH_INFO: `/v3/projects/cc651ae9a16941caa56d0282a4ad6e7a/users/66ba7f6679d74546995b9b07e29dd43f/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:43.938931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb10f9-f622-49aa-a164-fe02d0777f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc651ae9a16941caa56d0282a4ad6e7a, user_id=66ba7f6679d74546995b9b07e29dd43f, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:43.941660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb10f9-f622-49aa-a164-fe02d0777f76 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:43.957191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1256/2506] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:43 2022] PUT /identity/v3/projects/cc651ae9a16941caa56d0282a4ad6e7a/users/66ba7f6679d74546995b9b07e29dd43f/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:43.967980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaeecc-e06e-4522-b17f-99c688108445 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:43.968268 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaeecc-e06e-4522-b17f-99c688108445 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:43.968545 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaeecc-e06e-4522-b17f-99c688108445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.002467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e2aaeecc-e06e-4522-b17f-99c688108445 None None] MFA Rules not processed for user `66ba7f6679d74546995b9b07e29dd43f`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:44.003724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e2aaeecc-e06e-4522-b17f-99c688108445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:44.070009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1251/2507] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:44.074381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb10f9-f622-49aa-a164-fe02d0777f76 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:44.138664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb10f9-f622-49aa-a164-fe02d0777f76 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:44.143857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0676c70-6145-4c09-ba9e-f1e752dad595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:44.144518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0676c70-6145-4c09-ba9e-f1e752dad595 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.144802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0676c70-6145-4c09-ba9e-f1e752dad595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.145077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0676c70-6145-4c09-ba9e-f1e752dad595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.145763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0676c70-6145-4c09-ba9e-f1e752dad595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:44.147744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0676c70-6145-4c09-ba9e-f1e752dad595 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:44.174773 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1257/2508] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:44 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:44.179007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaeecc-e06e-4522-b17f-99c688108445 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:44.190256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaeecc-e06e-4522-b17f-99c688108445 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:44.252986 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8bea6-1fe4-4522-be37-8b9ab9a66114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:44.253654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8bea6-1fe4-4522-be37-8b9ab9a66114 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.253938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8bea6-1fe4-4522-be37-8b9ab9a66114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.254226 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8bea6-1fe4-4522-be37-8b9ab9a66114 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.254906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8bea6-1fe4-4522-be37-8b9ab9a66114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:44.256881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8bea6-1fe4-4522-be37-8b9ab9a66114 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:44.277035 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1252/2509] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:44 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:44.281648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0676c70-6145-4c09-ba9e-f1e752dad595 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:44.292652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0676c70-6145-4c09-ba9e-f1e752dad595 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:44.298457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7e9f8-db5d-416b-b8ec-9ec4fffdee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:44.299188 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7e9f8-db5d-416b-b8ec-9ec4fffdee90 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.299468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7e9f8-db5d-416b-b8ec-9ec4fffdee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.299743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7e9f8-db5d-416b-b8ec-9ec4fffdee90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.300476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7e9f8-db5d-416b-b8ec-9ec4fffdee90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:44.302111 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7e9f8-db5d-416b-b8ec-9ec4fffdee90 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:44.312944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1258/2510] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:44.317194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8bea6-1fe4-4522-be37-8b9ab9a66114 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:44.328109 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8bea6-1fe4-4522-be37-8b9ab9a66114 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:44.334050 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f3b48-f43e-4da4-8853-496acd78b460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:44.334736 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f3b48-f43e-4da4-8853-496acd78b460 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.335024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f3b48-f43e-4da4-8853-496acd78b460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.335319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f3b48-f43e-4da4-8853-496acd78b460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.336074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f3b48-f43e-4da4-8853-496acd78b460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:44.337688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f3b48-f43e-4da4-8853-496acd78b460 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:44.348142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1253/2511] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:44.352514 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7e9f8-db5d-416b-b8ec-9ec4fffdee90 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:44.363575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7e9f8-db5d-416b-b8ec-9ec4fffdee90 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:44.369707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdbfd8-45ea-4432-961c-79dc128844f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:44.370594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdbfd8-45ea-4432-961c-79dc128844f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.370898 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdbfd8-45ea-4432-961c-79dc128844f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.371207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdbfd8-45ea-4432-961c-79dc128844f3 admin admin] PATH_INFO: `/v3/projects/5f099b3c1f6148ed8810f3865839557e/users/81d7a4e5aa2b4e97a4428779f47a5abb/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.386263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdbfd8-45ea-4432-961c-79dc128844f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f099b3c1f6148ed8810f3865839557e, user_id=81d7a4e5aa2b4e97a4428779f47a5abb, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:44.389040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdbfd8-45ea-4432-961c-79dc128844f3 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:44.404483 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1259/2512] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:44 2022] PUT /identity/v3/projects/5f099b3c1f6148ed8810f3865839557e/users/81d7a4e5aa2b4e97a4428779f47a5abb/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:44.415083 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687935f1-aaca-4b5d-880f-cc9cfe5ccb78 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.415376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687935f1-aaca-4b5d-880f-cc9cfe5ccb78 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.415625 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687935f1-aaca-4b5d-880f-cc9cfe5ccb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.442824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-687935f1-aaca-4b5d-880f-cc9cfe5ccb78 None None] MFA Rules not processed for user `81d7a4e5aa2b4e97a4428779f47a5abb`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:44.444086 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-687935f1-aaca-4b5d-880f-cc9cfe5ccb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:44.454147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:44.511594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1254/2513] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:44.516256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdbfd8-45ea-4432-961c-79dc128844f3 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:44.564856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:44.586404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdbfd8-45ea-4432-961c-79dc128844f3 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:44.592686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758a0e9-40c4-47ac-b336-2dcedf95772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:44.593356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758a0e9-40c4-47ac-b336-2dcedf95772a admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.593643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758a0e9-40c4-47ac-b336-2dcedf95772a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.593924 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758a0e9-40c4-47ac-b336-2dcedf95772a admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.594619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758a0e9-40c4-47ac-b336-2dcedf95772a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:44.596614 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758a0e9-40c4-47ac-b336-2dcedf95772a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:44.623623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1260/2514] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:44 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:44.627910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687935f1-aaca-4b5d-880f-cc9cfe5ccb78 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:44.640325 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687935f1-aaca-4b5d-880f-cc9cfe5ccb78 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:44.704030 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a95eb-36f3-435e-963a-f6d2386842cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:44.704705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a95eb-36f3-435e-963a-f6d2386842cd admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.704991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a95eb-36f3-435e-963a-f6d2386842cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.705267 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a95eb-36f3-435e-963a-f6d2386842cd admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.705956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a95eb-36f3-435e-963a-f6d2386842cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:44.707953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a95eb-36f3-435e-963a-f6d2386842cd admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:44.729562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1255/2515] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:44 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:44.733719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758a0e9-40c4-47ac-b336-2dcedf95772a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:44.744472 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758a0e9-40c4-47ac-b336-2dcedf95772a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:44.749925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79467659-624d-4930-9241-4960580bfe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:44.750590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79467659-624d-4930-9241-4960580bfe27 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.750875 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79467659-624d-4930-9241-4960580bfe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.751233 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79467659-624d-4930-9241-4960580bfe27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.751959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79467659-624d-4930-9241-4960580bfe27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:44.753625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79467659-624d-4930-9241-4960580bfe27 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:44.765387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1261/2516] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:44.769535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a95eb-36f3-435e-963a-f6d2386842cd admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:44.780372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a95eb-36f3-435e-963a-f6d2386842cd admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:44.785704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51994bb-23d6-48d6-8a83-64f1c1661e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:44.786610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51994bb-23d6-48d6-8a83-64f1c1661e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.786891 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51994bb-23d6-48d6-8a83-64f1c1661e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.787199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51994bb-23d6-48d6-8a83-64f1c1661e8c admin admin] PATH_INFO: `/v3/projects/5d058ac091ce44d3b5a93fb5497ff3fe/users/06fe90875f46430da87660316258e7c6/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.802975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51994bb-23d6-48d6-8a83-64f1c1661e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d058ac091ce44d3b5a93fb5497ff3fe, user_id=06fe90875f46430da87660316258e7c6, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:44.805743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51994bb-23d6-48d6-8a83-64f1c1661e8c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:44.820825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1256/2517] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:44 2022] PUT /identity/v3/projects/5d058ac091ce44d3b5a93fb5497ff3fe/users/06fe90875f46430da87660316258e7c6/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:44.824904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79467659-624d-4930-9241-4960580bfe27 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:44.835135 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79467659-624d-4930-9241-4960580bfe27 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:44.891621 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c2076-235d-4bde-a036-2926daa346d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:44.892204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c2076-235d-4bde-a036-2926daa346d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.892485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c2076-235d-4bde-a036-2926daa346d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.892759 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c2076-235d-4bde-a036-2926daa346d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.893498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c2076-235d-4bde-a036-2926daa346d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:44.895100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c2076-235d-4bde-a036-2926daa346d8 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:44.905210 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1262/2518] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:44.909549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51994bb-23d6-48d6-8a83-64f1c1661e8c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:44.920192 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51994bb-23d6-48d6-8a83-64f1c1661e8c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:44.925726 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ba6eb-3f5c-4027-b23a-748adc736040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:44.926618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ba6eb-3f5c-4027-b23a-748adc736040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.926896 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ba6eb-3f5c-4027-b23a-748adc736040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.927228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ba6eb-3f5c-4027-b23a-748adc736040 admin admin] PATH_INFO: `/v3/projects/5d058ac091ce44d3b5a93fb5497ff3fe/users/06fe90875f46430da87660316258e7c6/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.929311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ba6eb-3f5c-4027-b23a-748adc736040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d058ac091ce44d3b5a93fb5497ff3fe, user_id=06fe90875f46430da87660316258e7c6, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:44.932017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ba6eb-3f5c-4027-b23a-748adc736040 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:44.943102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1257/2519] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:44 2022] PUT /identity/v3/projects/5d058ac091ce44d3b5a93fb5497ff3fe/users/06fe90875f46430da87660316258e7c6/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:44.954023 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127c5b2-0c4b-4a15-b846-65caaba06a33 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:44.954345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127c5b2-0c4b-4a15-b846-65caaba06a33 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:44.954626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127c5b2-0c4b-4a15-b846-65caaba06a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:44.984190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-9127c5b2-0c4b-4a15-b846-65caaba06a33 None None] MFA Rules not processed for user `06fe90875f46430da87660316258e7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:44.985411 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9127c5b2-0c4b-4a15-b846-65caaba06a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:45.058316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1263/2520] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:45.070097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ba6eb-3f5c-4027-b23a-748adc736040 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:45.072181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-021ba6eb-3f5c-4027-b23a-748adc736040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:45.131970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ba6eb-3f5c-4027-b23a-748adc736040 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:45.136233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1c3ab-3153-46b7-800f-189f8494b455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:45.136909 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1c3ab-3153-46b7-800f-189f8494b455 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:45.137173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1c3ab-3153-46b7-800f-189f8494b455 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:45.137452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1c3ab-3153-46b7-800f-189f8494b455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:45.147760 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1c3ab-3153-46b7-800f-189f8494b455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:45.149217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1c3ab-3153-46b7-800f-189f8494b455 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:45.159825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1258/2521] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:45.201465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127c5b2-0c4b-4a15-b846-65caaba06a33 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:45.202966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9127c5b2-0c4b-4a15-b846-65caaba06a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:45.215666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127c5b2-0c4b-4a15-b846-65caaba06a33 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:45.220168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ec5cd-1d6b-4c0f-96ec-e200e05e7c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:45.220818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ec5cd-1d6b-4c0f-96ec-e200e05e7c37 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:45.221121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ec5cd-1d6b-4c0f-96ec-e200e05e7c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:45.221381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ec5cd-1d6b-4c0f-96ec-e200e05e7c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:45.261536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:45.283322 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ec5cd-1d6b-4c0f-96ec-e200e05e7c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:45.284819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ec5cd-1d6b-4c0f-96ec-e200e05e7c37 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:45.294126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1264/2522] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:48.190546 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1c3ab-3153-46b7-800f-189f8494b455 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:48.199595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:48.256993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1c3ab-3153-46b7-800f-189f8494b455 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:48.262449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:48.263408 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:48.263723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:48.264292 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] PATH_INFO: `/v3/users/66ba7f6679d74546995b9b07e29dd43f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:48.265731 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ba7f6679d74546995b9b07e29dd43f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:48.267695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:48.316858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ba7f6679d74546995b9b07e29dd43f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:48.328322 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ba7f6679d74546995b9b07e29dd43f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:48.329019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ba7f6679d74546995b9b07e29dd43f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:48.336849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ba7f6679d74546995b9b07e29dd43f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:48.337692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ba7f6679d74546995b9b07e29dd43f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:48.351045 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1259/2523] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:48 2022] DELETE /identity/v3/users/66ba7f6679d74546995b9b07e29dd43f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:48.355352 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19417db3-1260-4896-bd67-5d41e8d79b28 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:48.355818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19417db3-1260-4896-bd67-5d41e8d79b28 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:48.355911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19417db3-1260-4896-bd67-5d41e8d79b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:48.372980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-19417db3-1260-4896-bd67-5d41e8d79b28 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:48.374269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-19417db3-1260-4896-bd67-5d41e8d79b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:48.434307 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1265/2524] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:48.444620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:48.446203 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:48.505069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f32df6-65a3-44b9-a13c-de975ed6ad07 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:48.509841 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9daf1c-d108-494f-ba5d-ce1810e8eb7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:48.510499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9daf1c-d108-494f-ba5d-ce1810e8eb7f service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:48.510780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9daf1c-d108-494f-ba5d-ce1810e8eb7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:48.511088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9daf1c-d108-494f-ba5d-ce1810e8eb7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:48.521250 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9daf1c-d108-494f-ba5d-ce1810e8eb7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:48.522730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9daf1c-d108-494f-ba5d-ce1810e8eb7f service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:48.533173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1260/2525] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:48.821165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19417db3-1260-4896-bd67-5d41e8d79b28 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:48.822685 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-19417db3-1260-4896-bd67-5d41e8d79b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:48.840569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19417db3-1260-4896-bd67-5d41e8d79b28 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:48.846206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:48.847166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:48.847441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:48.847693 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] PATH_INFO: `/v3/projects/cc651ae9a16941caa56d0282a4ad6e7a` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:48.849589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc651ae9a16941caa56d0282a4ad6e7a)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:48.851786 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:48.899081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc651ae9a16941caa56d0282a4ad6e7a', 'request_id': 'req-f64bf058-3d15-47b3-abcc-ee137242e544'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:48.905996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc651ae9a16941caa56d0282a4ad6e7a', 'request_id': 'req-f64bf058-3d15-47b3-abcc-ee137242e544'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:48.916589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc651ae9a16941caa56d0282a4ad6e7a', 'request_id': 'req-f64bf058-3d15-47b3-abcc-ee137242e544'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:48.927945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] The token cache is being invalidate because project cc651ae9a16941caa56d0282a4ad6e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:48.928370 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:48.928990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:48.930568 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1266/2526] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:48 2022] DELETE /identity/v3/projects/cc651ae9a16941caa56d0282a4ad6e7a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:48.934721 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9daf1c-d108-494f-ba5d-ce1810e8eb7f service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:48.945468 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9daf1c-d108-494f-ba5d-ce1810e8eb7f service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:48.980436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:49.014237 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:49.015161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:49.015443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:49.015722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] PATH_INFO: `/v3/users/81d7a4e5aa2b4e97a4428779f47a5abb` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:49.016910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d7a4e5aa2b4e97a4428779f47a5abb)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:49.018858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:49.069897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d7a4e5aa2b4e97a4428779f47a5abb'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.083849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d7a4e5aa2b4e97a4428779f47a5abb'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.084604 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d7a4e5aa2b4e97a4428779f47a5abb'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.091499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d7a4e5aa2b4e97a4428779f47a5abb'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.092228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d7a4e5aa2b4e97a4428779f47a5abb'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.106040 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1261/2527] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:48 2022] DELETE /identity/v3/users/81d7a4e5aa2b4e97a4428779f47a5abb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:49.390820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:49.392419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:49.409217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf058-3d15-47b3-abcc-ee137242e544 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:49.465133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:49.465952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:49.466232 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:49.466509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] PATH_INFO: `/v3/projects/5f099b3c1f6148ed8810f3865839557e` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:49.467732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f099b3c1f6148ed8810f3865839557e)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:49.469646 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:49.471996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:49.526571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f099b3c1f6148ed8810f3865839557e', 'request_id': 'req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.533202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f099b3c1f6148ed8810f3865839557e', 'request_id': 'req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.541529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f099b3c1f6148ed8810f3865839557e', 'request_id': 'req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.551921 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] The token cache is being invalidate because project 5f099b3c1f6148ed8810f3865839557e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:49.552238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.553144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.554769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1267/2528] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:49 2022] DELETE /identity/v3/projects/5f099b3c1f6148ed8810f3865839557e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:49.558821 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:49.560541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:49.573813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a893215-0275-4ef8-90c4-7073903f223a admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:49.632056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4f1a0-ee94-41cd-8693-d832de24c176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:49.632942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f1a0-ee94-41cd-8693-d832de24c176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:49.633222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f1a0-ee94-41cd-8693-d832de24c176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:49.633502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4f1a0-ee94-41cd-8693-d832de24c176 admin admin] PATH_INFO: `/v3/users/06fe90875f46430da87660316258e7c6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:49.634719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4f1a0-ee94-41cd-8693-d832de24c176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fe90875f46430da87660316258e7c6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:49.636689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4f1a0-ee94-41cd-8693-d832de24c176 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:49.686901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-bff4f1a0-ee94-41cd-8693-d832de24c176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fe90875f46430da87660316258e7c6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.688888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:49.700866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-bff4f1a0-ee94-41cd-8693-d832de24c176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fe90875f46430da87660316258e7c6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.701553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-bff4f1a0-ee94-41cd-8693-d832de24c176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fe90875f46430da87660316258e7c6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.708515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-bff4f1a0-ee94-41cd-8693-d832de24c176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fe90875f46430da87660316258e7c6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.709169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-bff4f1a0-ee94-41cd-8693-d832de24c176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fe90875f46430da87660316258e7c6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:49.722438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1262/2529] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:49 2022] DELETE /identity/v3/users/06fe90875f46430da87660316258e7c6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:50.018026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:50.019633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:50.033671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dbfc8-d13e-4f10-94dd-63ff6e44ec1d admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:50.091309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:50.092193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.092478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.092756 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] PATH_INFO: `/v3/projects/5d058ac091ce44d3b5a93fb5497ff3fe` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.093943 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d058ac091ce44d3b5a93fb5497ff3fe)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:50.095925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:50.145491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d058ac091ce44d3b5a93fb5497ff3fe', 'request_id': 'req-d7f83746-d0cc-49a5-899f-a99faaed29e1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:50.152212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d058ac091ce44d3b5a93fb5497ff3fe', 'request_id': 'req-d7f83746-d0cc-49a5-899f-a99faaed29e1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:50.160546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d058ac091ce44d3b5a93fb5497ff3fe', 'request_id': 'req-d7f83746-d0cc-49a5-899f-a99faaed29e1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:50.171352 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] The token cache is being invalidate because project 5d058ac091ce44d3b5a93fb5497ff3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:50.171638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:50.172262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-d7f83746-d0cc-49a5-899f-a99faaed29e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:50.173805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1268/2530] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:50 2022] DELETE /identity/v3/projects/5d058ac091ce44d3b5a93fb5497ff3fe => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:50.179915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252e2a-2fd7-4d6a-8bd5-ce84d9a8a221 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.180205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252e2a-2fd7-4d6a-8bd5-ce84d9a8a221 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.180511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5252e2a-2fd7-4d6a-8bd5-ce84d9a8a221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.198523 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c5252e2a-2fd7-4d6a-8bd5-ce84d9a8a221 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:50.199914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c5252e2a-2fd7-4d6a-8bd5-ce84d9a8a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:50.262257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1263/2531] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:50.270972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc722b-d4dd-4994-8bd9-1e4143e4ef0d None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.271279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc722b-d4dd-4994-8bd9-1e4143e4ef0d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.271554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc722b-d4dd-4994-8bd9-1e4143e4ef0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.292108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-66dc722b-d4dd-4994-8bd9-1e4143e4ef0d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:50.293329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-66dc722b-d4dd-4994-8bd9-1e4143e4ef0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:50.302744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1269/2532] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:50.307161 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5252e2a-2fd7-4d6a-8bd5-ce84d9a8a221 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:50.316861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5252e2a-2fd7-4d6a-8bd5-ce84d9a8a221 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:50.321843 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa086d-e181-4795-8524-1e452c058be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:50.322488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa086d-e181-4795-8524-1e452c058be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.322771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa086d-e181-4795-8524-1e452c058be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.323069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa086d-e181-4795-8524-1e452c058be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.323788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa086d-e181-4795-8524-1e452c058be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:11:50.324092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa086d-e181-4795-8524-1e452c058be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:50.325704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa086d-e181-4795-8524-1e452c058be1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:50.336996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1264/2533] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 03:11:50.341533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc722b-d4dd-4994-8bd9-1e4143e4ef0d None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:50.350817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc722b-d4dd-4994-8bd9-1e4143e4ef0d None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:50.355688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959a28c-b94e-4178-b9d6-f2f71c1ec04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:50.356329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959a28c-b94e-4178-b9d6-f2f71c1ec04f admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.356598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959a28c-b94e-4178-b9d6-f2f71c1ec04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.356893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959a28c-b94e-4178-b9d6-f2f71c1ec04f admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.357581 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959a28c-b94e-4178-b9d6-f2f71c1ec04f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:50.359648 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959a28c-b94e-4178-b9d6-f2f71c1ec04f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:50.374298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:50.391148 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1270/2534] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:50 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:50.392321 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa086d-e181-4795-8524-1e452c058be1 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:50.402533 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa086d-e181-4795-8524-1e452c058be1 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:50.460043 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcf1f7-d9f3-40d6-84c4-6ab7739d7290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:50.460720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcf1f7-d9f3-40d6-84c4-6ab7739d7290 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.461005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcf1f7-d9f3-40d6-84c4-6ab7739d7290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.461285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcf1f7-d9f3-40d6-84c4-6ab7739d7290 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.461985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcf1f7-d9f3-40d6-84c4-6ab7739d7290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:50.463957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcf1f7-d9f3-40d6-84c4-6ab7739d7290 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:50.482948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1265/2535] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:50 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:11:50.487177 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959a28c-b94e-4178-b9d6-f2f71c1ec04f admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:50.497870 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959a28c-b94e-4178-b9d6-f2f71c1ec04f admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:50.503249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f9652-3706-48cc-b2cc-ff90375601c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:50.503955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f9652-3706-48cc-b2cc-ff90375601c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.504239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f9652-3706-48cc-b2cc-ff90375601c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.504519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f9652-3706-48cc-b2cc-ff90375601c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.505252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f9652-3706-48cc-b2cc-ff90375601c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:50.506900 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f9652-3706-48cc-b2cc-ff90375601c7 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:50.519316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1271/2536] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:50.523616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcf1f7-d9f3-40d6-84c4-6ab7739d7290 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:50.534707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcf1f7-d9f3-40d6-84c4-6ab7739d7290 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:50.541003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaf7db-31a4-4b1d-9b29-56b5c5c76c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:50.541670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaf7db-31a4-4b1d-9b29-56b5c5c76c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.541928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaf7db-31a4-4b1d-9b29-56b5c5c76c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.542229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaf7db-31a4-4b1d-9b29-56b5c5c76c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.542953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaf7db-31a4-4b1d-9b29-56b5c5c76c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:50.544595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaf7db-31a4-4b1d-9b29-56b5c5c76c8b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:50.556428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1266/2537] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:11:50.560859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f9652-3706-48cc-b2cc-ff90375601c7 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:50.571584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f9652-3706-48cc-b2cc-ff90375601c7 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:50.576771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf0ff0-23a3-451e-86f8-52e1ae16d9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:50.577652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf0ff0-23a3-451e-86f8-52e1ae16d9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.577933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf0ff0-23a3-451e-86f8-52e1ae16d9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.578202 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf0ff0-23a3-451e-86f8-52e1ae16d9ef admin admin] PATH_INFO: `/v3/projects/6a2fd63d6dcf4cbf9fe83e313d93ef22/users/8413fdc052da4f29a63d292a60cb6be6/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.593843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf0ff0-23a3-451e-86f8-52e1ae16d9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2fd63d6dcf4cbf9fe83e313d93ef22, user_id=8413fdc052da4f29a63d292a60cb6be6, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:50.596530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf0ff0-23a3-451e-86f8-52e1ae16d9ef admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:50.611547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1272/2538] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:50 2022] PUT /identity/v3/projects/6a2fd63d6dcf4cbf9fe83e313d93ef22/users/8413fdc052da4f29a63d292a60cb6be6/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:50.625933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c33f7b-8a54-43f7-9115-c817d3a58dd3 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.626457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c33f7b-8a54-43f7-9115-c817d3a58dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.626457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c33f7b-8a54-43f7-9115-c817d3a58dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.653949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f2c33f7b-8a54-43f7-9115-c817d3a58dd3 None None] MFA Rules not processed for user `8413fdc052da4f29a63d292a60cb6be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:50.655346 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f2c33f7b-8a54-43f7-9115-c817d3a58dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:50.679077 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:50.728340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1267/2539] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:50.740818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf0ff0-23a3-451e-86f8-52e1ae16d9ef admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:50.743917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-28cf0ff0-23a3-451e-86f8-52e1ae16d9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:50.812082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf0ff0-23a3-451e-86f8-52e1ae16d9ef admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:50.816167 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a77f82-6f49-47dc-9352-f791e68ac19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:50.816799 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77f82-6f49-47dc-9352-f791e68ac19c service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.817089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77f82-6f49-47dc-9352-f791e68ac19c service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.817364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77f82-6f49-47dc-9352-f791e68ac19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.826846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a77f82-6f49-47dc-9352-f791e68ac19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:50.830681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a77f82-6f49-47dc-9352-f791e68ac19c service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:50.839981 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1273/2540] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:50.862652 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c33f7b-8a54-43f7-9115-c817d3a58dd3 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:50.930698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c33f7b-8a54-43f7-9115-c817d3a58dd3 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:50.935298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:50.936170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:50.936513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:50.936792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] PATH_INFO: `/v3/users/8413fdc052da4f29a63d292a60cb6be6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:50.938029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8413fdc052da4f29a63d292a60cb6be6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:50.939992 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:50.990394 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8413fdc052da4f29a63d292a60cb6be6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:51.002064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8413fdc052da4f29a63d292a60cb6be6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:51.002702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8413fdc052da4f29a63d292a60cb6be6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:51.009450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8413fdc052da4f29a63d292a60cb6be6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:51.010059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8413fdc052da4f29a63d292a60cb6be6'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:51.023189 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1268/2541] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:50 2022] DELETE /identity/v3/users/8413fdc052da4f29a63d292a60cb6be6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:51.027894 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5be6f-fa19-4a4c-9079-512d4f2983e6 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:51.028207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5be6f-fa19-4a4c-9079-512d4f2983e6 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:51.028831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5be6f-fa19-4a4c-9079-512d4f2983e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:51.045893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5ca5be6f-fa19-4a4c-9079-512d4f2983e6 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:51.047102 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5ca5be6f-fa19-4a4c-9079-512d4f2983e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:51.109831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1274/2542] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:51.122169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:51.123703 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:51.172181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:51.185609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbde72e-72bc-4c41-a239-316b2efdb18e admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:51.189305 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e32d5-3926-47c7-834e-9cf177f69cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:51.189948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e32d5-3926-47c7-834e-9cf177f69cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:51.190230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e32d5-3926-47c7-834e-9cf177f69cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:51.190504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e32d5-3926-47c7-834e-9cf177f69cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:51.200263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e32d5-3926-47c7-834e-9cf177f69cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:51.201714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e32d5-3926-47c7-834e-9cf177f69cb9 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:51.211585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1269/2543] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:51.493827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5be6f-fa19-4a4c-9079-512d4f2983e6 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:51.495445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5ca5be6f-fa19-4a4c-9079-512d4f2983e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:51.509163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5be6f-fa19-4a4c-9079-512d4f2983e6 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:51.514509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:51.515550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:51.515838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:51.516115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] PATH_INFO: `/v3/projects/6a2fd63d6dcf4cbf9fe83e313d93ef22` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:51.517327 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2fd63d6dcf4cbf9fe83e313d93ef22)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:51.519340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:51.569410 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2fd63d6dcf4cbf9fe83e313d93ef22', 'request_id': 'req-72c3290d-397a-4d8b-90a5-6c651e2d8f60'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:51.576105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2fd63d6dcf4cbf9fe83e313d93ef22', 'request_id': 'req-72c3290d-397a-4d8b-90a5-6c651e2d8f60'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:51.578959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:51.585379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2fd63d6dcf4cbf9fe83e313d93ef22', 'request_id': 'req-72c3290d-397a-4d8b-90a5-6c651e2d8f60'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:51.596955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] The token cache is being invalidate because project 6a2fd63d6dcf4cbf9fe83e313d93ef22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:51.597239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:51.597864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-72c3290d-397a-4d8b-90a5-6c651e2d8f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:51.599465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1275/2544] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:51 2022] DELETE /identity/v3/projects/6a2fd63d6dcf4cbf9fe83e313d93ef22 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:51.605949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aa3f1-af40-4ce6-ad3e-2c2b3a106b2d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:51.606122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aa3f1-af40-4ce6-ad3e-2c2b3a106b2d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:51.606432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aa3f1-af40-4ce6-ad3e-2c2b3a106b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:51.625639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-512aa3f1-af40-4ce6-ad3e-2c2b3a106b2d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:51.626868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-512aa3f1-af40-4ce6-ad3e-2c2b3a106b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:51.697056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1270/2545] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:51.759249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6efb44-88ab-46c8-9129-d851fc6d9dbe None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:51.759534 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6efb44-88ab-46c8-9129-d851fc6d9dbe None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:51.759810 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6efb44-88ab-46c8-9129-d851fc6d9dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:51.783346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-9c6efb44-88ab-46c8-9129-d851fc6d9dbe None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:51.785001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9c6efb44-88ab-46c8-9129-d851fc6d9dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:51.797850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1276/2546] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:51.802296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512aa3f1-af40-4ce6-ad3e-2c2b3a106b2d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:51.812492 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512aa3f1-af40-4ce6-ad3e-2c2b3a106b2d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:51.817995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc1d22-0ee1-4385-8297-29fc1d77e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:51.818653 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc1d22-0ee1-4385-8297-29fc1d77e02e admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:51.818937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc1d22-0ee1-4385-8297-29fc1d77e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:51.819248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc1d22-0ee1-4385-8297-29fc1d77e02e admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:51.819974 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc1d22-0ee1-4385-8297-29fc1d77e02e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:11:51.820278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc1d22-0ee1-4385-8297-29fc1d77e02e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:51.821885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc1d22-0ee1-4385-8297-29fc1d77e02e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:51.833630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1271/2547] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:11:51.837865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6efb44-88ab-46c8-9129-d851fc6d9dbe None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:51.847573 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6efb44-88ab-46c8-9129-d851fc6d9dbe None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:51.853248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfad94-ecaf-4501-bcda-5f4b89723f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:51.853900 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfad94-ecaf-4501-bcda-5f4b89723f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:51.854177 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfad94-ecaf-4501-bcda-5f4b89723f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:51.854447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfad94-ecaf-4501-bcda-5f4b89723f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:51.855159 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfad94-ecaf-4501-bcda-5f4b89723f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:51.857206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfad94-ecaf-4501-bcda-5f4b89723f5a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:51.892529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1277/2548] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:51 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:51.898792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc1d22-0ee1-4385-8297-29fc1d77e02e admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:51.912230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc1d22-0ee1-4385-8297-29fc1d77e02e admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:51.978094 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e0de-11bf-4eb4-871c-012653df67c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:51.978783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e0de-11bf-4eb4-871c-012653df67c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:51.979098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e0de-11bf-4eb4-871c-012653df67c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:51.979361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e0de-11bf-4eb4-871c-012653df67c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:51.980058 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0e0de-11bf-4eb4-871c-012653df67c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:51.981994 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0e0de-11bf-4eb4-871c-012653df67c7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:52.004166 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1272/2549] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:51 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:52.008215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfad94-ecaf-4501-bcda-5f4b89723f5a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:52.021652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfad94-ecaf-4501-bcda-5f4b89723f5a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:52.030183 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4aa00-98f0-4f5b-be18-a6e48b0b40e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:52.030847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4aa00-98f0-4f5b-be18-a6e48b0b40e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.031149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4aa00-98f0-4f5b-be18-a6e48b0b40e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.031446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4aa00-98f0-4f5b-be18-a6e48b0b40e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.032186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4aa00-98f0-4f5b-be18-a6e48b0b40e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:52.033801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4aa00-98f0-4f5b-be18-a6e48b0b40e5 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:52.045092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1278/2550] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:52.049361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e0de-11bf-4eb4-871c-012653df67c7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:52.060514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e0de-11bf-4eb4-871c-012653df67c7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:52.065636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1b08a-1e84-40fc-b941-7b93efbf2f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:52.066296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1b08a-1e84-40fc-b941-7b93efbf2f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.066575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1b08a-1e84-40fc-b941-7b93efbf2f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.066849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1b08a-1e84-40fc-b941-7b93efbf2f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.067593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1b08a-1e84-40fc-b941-7b93efbf2f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:52.069217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1b08a-1e84-40fc-b941-7b93efbf2f30 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:52.079579 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1273/2551] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:52.083854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4aa00-98f0-4f5b-be18-a6e48b0b40e5 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:52.094514 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4aa00-98f0-4f5b-be18-a6e48b0b40e5 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:52.099538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631e3c8-4d31-47aa-b2dc-07440569085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:52.100419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631e3c8-4d31-47aa-b2dc-07440569085b admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.100701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631e3c8-4d31-47aa-b2dc-07440569085b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.100977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631e3c8-4d31-47aa-b2dc-07440569085b admin admin] PATH_INFO: `/v3/projects/8a4ae6276f654e6f93db1d295534e026/users/e46e653512d24b148d02bdf6f06376dd/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.116113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631e3c8-4d31-47aa-b2dc-07440569085b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4ae6276f654e6f93db1d295534e026, user_id=e46e653512d24b148d02bdf6f06376dd, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:52.118727 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631e3c8-4d31-47aa-b2dc-07440569085b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:52.133580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1279/2552] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:52 2022] PUT /identity/v3/projects/8a4ae6276f654e6f93db1d295534e026/users/e46e653512d24b148d02bdf6f06376dd/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:52.143698 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00c62-a95c-4107-adc6-e92d4ea1c172 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.143987 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00c62-a95c-4107-adc6-e92d4ea1c172 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.144260 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00c62-a95c-4107-adc6-e92d4ea1c172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.172256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-96a00c62-a95c-4107-adc6-e92d4ea1c172 None None] MFA Rules not processed for user `e46e653512d24b148d02bdf6f06376dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:52.173485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-96a00c62-a95c-4107-adc6-e92d4ea1c172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:52.212762 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:52.242406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1274/2553] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:11:52.247613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631e3c8-4d31-47aa-b2dc-07440569085b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:52.323666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631e3c8-4d31-47aa-b2dc-07440569085b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:52.328763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58c327-0f5f-46fc-8307-c68782b27d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:52.329412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58c327-0f5f-46fc-8307-c68782b27d90 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.329690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58c327-0f5f-46fc-8307-c68782b27d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.329962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58c327-0f5f-46fc-8307-c68782b27d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.330687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58c327-0f5f-46fc-8307-c68782b27d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:52.332633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58c327-0f5f-46fc-8307-c68782b27d90 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:52.360982 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1280/2554] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:11:52 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:11:52.365319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00c62-a95c-4107-adc6-e92d4ea1c172 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:52.377152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00c62-a95c-4107-adc6-e92d4ea1c172 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:52.435529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33104d3e-8e4f-4ebc-bd2d-a984ffac1ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:52.436197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33104d3e-8e4f-4ebc-bd2d-a984ffac1ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.436498 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33104d3e-8e4f-4ebc-bd2d-a984ffac1ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.436778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33104d3e-8e4f-4ebc-bd2d-a984ffac1ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.437473 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33104d3e-8e4f-4ebc-bd2d-a984ffac1ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:52.439433 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33104d3e-8e4f-4ebc-bd2d-a984ffac1ff7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:52.462307 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1275/2555] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:11:52 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:11:52.466473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58c327-0f5f-46fc-8307-c68782b27d90 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:52.477188 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58c327-0f5f-46fc-8307-c68782b27d90 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:52.482811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebba47-ccc1-4a8a-8d8a-b0cd6d1ec251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:52.483584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebba47-ccc1-4a8a-8d8a-b0cd6d1ec251 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.483859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebba47-ccc1-4a8a-8d8a-b0cd6d1ec251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.484130 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebba47-ccc1-4a8a-8d8a-b0cd6d1ec251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.484857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebba47-ccc1-4a8a-8d8a-b0cd6d1ec251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:52.486473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebba47-ccc1-4a8a-8d8a-b0cd6d1ec251 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:52.497858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1281/2556] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:52.502220 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33104d3e-8e4f-4ebc-bd2d-a984ffac1ff7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:52.512638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33104d3e-8e4f-4ebc-bd2d-a984ffac1ff7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:52.517878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02351f23-e5d2-454c-9aaf-745f47906b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:52.518780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351f23-e5d2-454c-9aaf-745f47906b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.519090 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351f23-e5d2-454c-9aaf-745f47906b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.519329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351f23-e5d2-454c-9aaf-745f47906b0f admin admin] PATH_INFO: `/v3/projects/9d6e87fa6a224ad9967d4c225dea6c39/users/5e58320e6e284869a7edd332ca0b547c/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.534834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02351f23-e5d2-454c-9aaf-745f47906b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6e87fa6a224ad9967d4c225dea6c39, user_id=5e58320e6e284869a7edd332ca0b547c, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:52.537528 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02351f23-e5d2-454c-9aaf-745f47906b0f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:52.552857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1276/2557] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:52 2022] PUT /identity/v3/projects/9d6e87fa6a224ad9967d4c225dea6c39/users/5e58320e6e284869a7edd332ca0b547c/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:11:52.557092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebba47-ccc1-4a8a-8d8a-b0cd6d1ec251 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:52.567270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebba47-ccc1-4a8a-8d8a-b0cd6d1ec251 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:52.617781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:52.625917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67550f2c-ae3b-4ba8-9733-c96e37ced09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:52.626593 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67550f2c-ae3b-4ba8-9733-c96e37ced09f admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.626881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67550f2c-ae3b-4ba8-9733-c96e37ced09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.627244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67550f2c-ae3b-4ba8-9733-c96e37ced09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.627954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67550f2c-ae3b-4ba8-9733-c96e37ced09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:52.629918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67550f2c-ae3b-4ba8-9733-c96e37ced09f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:52.641096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1282/2558] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:11:52.645534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02351f23-e5d2-454c-9aaf-745f47906b0f admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:52.658878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02351f23-e5d2-454c-9aaf-745f47906b0f admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:52.665308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d1a56-1bd8-422f-b67b-e99816e845e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:52.666263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d1a56-1bd8-422f-b67b-e99816e845e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.666548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d1a56-1bd8-422f-b67b-e99816e845e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.666858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d1a56-1bd8-422f-b67b-e99816e845e0 admin admin] PATH_INFO: `/v3/projects/9d6e87fa6a224ad9967d4c225dea6c39/users/5e58320e6e284869a7edd332ca0b547c/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.669486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d1a56-1bd8-422f-b67b-e99816e845e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6e87fa6a224ad9967d4c225dea6c39, user_id=5e58320e6e284869a7edd332ca0b547c, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:52.672194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d1a56-1bd8-422f-b67b-e99816e845e0 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:52.685060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1277/2559] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:11:52 2022] PUT /identity/v3/projects/9d6e87fa6a224ad9967d4c225dea6c39/users/5e58320e6e284869a7edd332ca0b547c/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:11:52.697270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e2adb-8516-4062-94f2-63de2a2dbd4b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.697551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e2adb-8516-4062-94f2-63de2a2dbd4b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.697802 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e2adb-8516-4062-94f2-63de2a2dbd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.727680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-f11e2adb-8516-4062-94f2-63de2a2dbd4b None None] MFA Rules not processed for user `5e58320e6e284869a7edd332ca0b547c`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:52.729501 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f11e2adb-8516-4062-94f2-63de2a2dbd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:52.806095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1283/2560] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:52.817238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d1a56-1bd8-422f-b67b-e99816e845e0 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:52.819213 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-108d1a56-1bd8-422f-b67b-e99816e845e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:52.877780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d1a56-1bd8-422f-b67b-e99816e845e0 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:52.881833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36b586-358f-4d42-b6bb-d8d9d93ac6ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:52.882471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36b586-358f-4d42-b6bb-d8d9d93ac6ae service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:52.882758 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36b586-358f-4d42-b6bb-d8d9d93ac6ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:52.883039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36b586-358f-4d42-b6bb-d8d9d93ac6ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:52.929092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:52.943003 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36b586-358f-4d42-b6bb-d8d9d93ac6ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:52.944510 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36b586-358f-4d42-b6bb-d8d9d93ac6ae service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:52.953537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1278/2561] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:55.505144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e2adb-8516-4062-94f2-63de2a2dbd4b None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:55.569803 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e2adb-8516-4062-94f2-63de2a2dbd4b None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:55.575893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:55.576791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:55.577083 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:55.577348 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] PATH_INFO: `/v3/users/e46e653512d24b148d02bdf6f06376dd` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:55.578673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46e653512d24b148d02bdf6f06376dd)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:55.580694 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:55.630568 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46e653512d24b148d02bdf6f06376dd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:55.641743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46e653512d24b148d02bdf6f06376dd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:55.649996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46e653512d24b148d02bdf6f06376dd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:55.655731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:55.658108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46e653512d24b148d02bdf6f06376dd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:55.659062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46e653512d24b148d02bdf6f06376dd'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:55.666329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1284/2562] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:55 2022] DELETE /identity/v3/users/e46e653512d24b148d02bdf6f06376dd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:55.671061 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527850df-62aa-44a1-b600-1ec923e6b27f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:55.671555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527850df-62aa-44a1-b600-1ec923e6b27f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:55.671664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527850df-62aa-44a1-b600-1ec923e6b27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:55.688415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-527850df-62aa-44a1-b600-1ec923e6b27f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:11:55.689712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-527850df-62aa-44a1-b600-1ec923e6b27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:55.748487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1279/2563] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:11:55.758502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:55.760163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:55.819157 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5b347-1634-42cd-93bc-6448a8c12272 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:55.825845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cddc8-0c44-48d7-afd1-8077db3f7fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:55.826833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cddc8-0c44-48d7-afd1-8077db3f7fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:55.827352 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cddc8-0c44-48d7-afd1-8077db3f7fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:55.827746 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cddc8-0c44-48d7-afd1-8077db3f7fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:55.844770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cddc8-0c44-48d7-afd1-8077db3f7fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:55.846441 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cddc8-0c44-48d7-afd1-8077db3f7fe3 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:55.856519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1285/2564] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:11:56.143354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527850df-62aa-44a1-b600-1ec923e6b27f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:56.144901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-527850df-62aa-44a1-b600-1ec923e6b27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:56.162017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527850df-62aa-44a1-b600-1ec923e6b27f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:56.168561 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:56.169443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:56.169710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:56.170044 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] PATH_INFO: `/v3/projects/8a4ae6276f654e6f93db1d295534e026` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:56.171355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4ae6276f654e6f93db1d295534e026)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:56.173424 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:56.222047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4ae6276f654e6f93db1d295534e026', 'request_id': 'req-293c2915-e00c-49a3-871e-26ae9a1670bb'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.228512 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4ae6276f654e6f93db1d295534e026', 'request_id': 'req-293c2915-e00c-49a3-871e-26ae9a1670bb'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.237107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4ae6276f654e6f93db1d295534e026', 'request_id': 'req-293c2915-e00c-49a3-871e-26ae9a1670bb'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.248484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] The token cache is being invalidate because project 8a4ae6276f654e6f93db1d295534e026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:56.248777 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.249438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.251092 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1280/2565] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:56 2022] DELETE /identity/v3/projects/8a4ae6276f654e6f93db1d295534e026 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:56.255404 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cddc8-0c44-48d7-afd1-8077db3f7fe3 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:56.265043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cddc8-0c44-48d7-afd1-8077db3f7fe3 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:56.326908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfadb9c-7800-4b59-894b-036fd5867307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:56.327823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfadb9c-7800-4b59-894b-036fd5867307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:56.328094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfadb9c-7800-4b59-894b-036fd5867307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:56.328366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfadb9c-7800-4b59-894b-036fd5867307 admin admin] PATH_INFO: `/v3/users/5e58320e6e284869a7edd332ca0b547c` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:56.329743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfadb9c-7800-4b59-894b-036fd5867307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e58320e6e284869a7edd332ca0b547c)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:56.331748 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfadb9c-7800-4b59-894b-036fd5867307 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:56.382866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9bfadb9c-7800-4b59-894b-036fd5867307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e58320e6e284869a7edd332ca0b547c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.394688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9bfadb9c-7800-4b59-894b-036fd5867307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e58320e6e284869a7edd332ca0b547c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.404254 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9bfadb9c-7800-4b59-894b-036fd5867307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e58320e6e284869a7edd332ca0b547c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.412011 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9bfadb9c-7800-4b59-894b-036fd5867307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e58320e6e284869a7edd332ca0b547c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.412639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9bfadb9c-7800-4b59-894b-036fd5867307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e58320e6e284869a7edd332ca0b547c'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.418487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1286/2566] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:11:56 2022] DELETE /identity/v3/users/5e58320e6e284869a7edd332ca0b547c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:11:56.696279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:11:56.697808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:11:56.711951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c2915-e00c-49a3-871e-26ae9a1670bb admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:11:56.769107 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:11:56.769915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:11:56.770198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:11:56.770459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] PATH_INFO: `/v3/projects/9d6e87fa6a224ad9967d4c225dea6c39` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:11:56.771721 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6e87fa6a224ad9967d4c225dea6c39)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:11:56.773637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:11:56.785521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:11:56.822383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6e87fa6a224ad9967d4c225dea6c39', 'request_id': 'req-a324c554-d02b-40ed-b4dc-a53e9eb548cb'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.828272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6e87fa6a224ad9967d4c225dea6c39', 'request_id': 'req-a324c554-d02b-40ed-b4dc-a53e9eb548cb'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.837059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6e87fa6a224ad9967d4c225dea6c39', 'request_id': 'req-a324c554-d02b-40ed-b4dc-a53e9eb548cb'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.847150 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] The token cache is being invalidate because project 9d6e87fa6a224ad9967d4c225dea6c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:11:56.847433 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.848084 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:11:56.849660 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1281/2567] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:11:56 2022] DELETE /identity/v3/projects/9d6e87fa6a224ad9967d4c225dea6c39 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:12:06.415013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=81,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:12:06.844589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:12:56.801421 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62392d-8937-48fd-b297-a28be91d7210 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:12:56.801960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62392d-8937-48fd-b297-a28be91d7210 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:12:56.801960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62392d-8937-48fd-b297-a28be91d7210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:12:56.820267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5c62392d-8937-48fd-b297-a28be91d7210 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:12:56.821480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5c62392d-8937-48fd-b297-a28be91d7210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:12:56.878267 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1287/2568] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:12:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:12:56.921406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:12:56.922911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:12:56.993908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324c554-d02b-40ed-b4dc-a53e9eb548cb admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:12:57.000804 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a568253-e624-47c8-ad9f-6b9803183485 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:12:57.001462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568253-e624-47c8-ad9f-6b9803183485 service swift] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:12:57.001742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568253-e624-47c8-ad9f-6b9803183485 service swift] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:12:57.002015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568253-e624-47c8-ad9f-6b9803183485 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:12:57.010852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a568253-e624-47c8-ad9f-6b9803183485 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:12:57.012476 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a568253-e624-47c8-ad9f-6b9803183485 service swift] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:12:57.020619 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1282/2569] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:12:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:13:05.180640 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62392d-8937-48fd-b297-a28be91d7210 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:05.182182 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5c62392d-8937-48fd-b297-a28be91d7210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:05.288042 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62392d-8937-48fd-b297-a28be91d7210 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:05.294074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950452-fa3c-48b5-a558-be3a6494772c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:05.295146 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950452-fa3c-48b5-a558-be3a6494772c service placement] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:05.295610 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950452-fa3c-48b5-a558-be3a6494772c service placement] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:05.296200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950452-fa3c-48b5-a558-be3a6494772c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:05.298203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-56950452-fa3c-48b5-a558-be3a6494772c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:05.312447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56950452-fa3c-48b5-a558-be3a6494772c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:05.314200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56950452-fa3c-48b5-a558-be3a6494772c service placement] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:05.335062 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1288/2570] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:13:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:13:07.017672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=32 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:07.085635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9201e-3f31-4d8d-9de3-4c271d543b21 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:07.085922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9201e-3f31-4d8d-9de3-4c271d543b21 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:07.086451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9201e-3f31-4d8d-9de3-4c271d543b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:07.109053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7ed9201e-3f31-4d8d-9de3-4c271d543b21 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:13:07.109937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7ed9201e-3f31-4d8d-9de3-4c271d543b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:07.120806 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1283/2571] 10.222.0.36 () {58 vars in 967 bytes} [Sun Jun 26 03:13:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:13:07.135461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950452-fa3c-48b5-a558-be3a6494772c service placement] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:07.147674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950452-fa3c-48b5-a558-be3a6494772c service placement] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:07.153123 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d299cd6-b4ad-46e3-af08-7c0aa708e444 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:07.153853 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d299cd6-b4ad-46e3-af08-7c0aa708e444 service swift] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:07.154209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d299cd6-b4ad-46e3-af08-7c0aa708e444 service swift] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:07.154557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d299cd6-b4ad-46e3-af08-7c0aa708e444 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:07.164549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d299cd6-b4ad-46e3-af08-7c0aa708e444 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:07.168795 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d299cd6-b4ad-46e3-af08-7c0aa708e444 service swift] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:07.178497 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1289/2572] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:13:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:13:13.701893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd445a04-a782-4afd-ad8c-8538dae70f04 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:13.702534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd445a04-a782-4afd-ad8c-8538dae70f04 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:13.702534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd445a04-a782-4afd-ad8c-8538dae70f04 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:13.703897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1284/2573] 10.222.0.36 () {54 vars in 921 bytes} [Sun Jun 26 03:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 26 03:13:13.733144 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe5625-b239-41a1-afc7-61226ad5093b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:13.733675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe5625-b239-41a1-afc7-61226ad5093b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:13.733788 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe5625-b239-41a1-afc7-61226ad5093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:13.752959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-59fe5625-b239-41a1-afc7-61226ad5093b None None] MFA Rules not processed for user `24319e5e83ed4caf9dd3ae4b3937b3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:13:13.754458 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-59fe5625-b239-41a1-afc7-61226ad5093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:13.900533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1290/2574] 10.222.0.36 () {58 vars in 1018 bytes} [Sun Jun 26 03:13:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:13:13.922701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd445a04-a782-4afd-ad8c-8538dae70f04 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:13.922701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-dd445a04-a782-4afd-ad8c-8538dae70f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:14.004931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd445a04-a782-4afd-ad8c-8538dae70f04 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:14.010798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b37275-e0ec-4f90-94bb-63727842cfe6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '250c47daff26400c96a6b467d7cf5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:14.011745 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b37275-e0ec-4f90-94bb-63727842cfe6 service glance] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:14.012482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b37275-e0ec-4f90-94bb-63727842cfe6 service glance] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:14.012767 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b37275-e0ec-4f90-94bb-63727842cfe6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:14.025972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b37275-e0ec-4f90-94bb-63727842cfe6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:14.027514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b37275-e0ec-4f90-94bb-63727842cfe6 service glance] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:14.039725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1285/2575] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:13:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:13:14.657071 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe5625-b239-41a1-afc7-61226ad5093b None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:14.659563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-59fe5625-b239-41a1-afc7-61226ad5093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:14.679948 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:14.730449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe5625-b239-41a1-afc7-61226ad5093b None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:14.735149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:14.736015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:14.736291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:14.736562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] PATH_INFO: `/v3/users/b8a91f886b7b43a38ac6d91dc7f301c1` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:14.737789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a91f886b7b43a38ac6d91dc7f301c1)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:14.739971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:14.791681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a91f886b7b43a38ac6d91dc7f301c1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:14.804402 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a91f886b7b43a38ac6d91dc7f301c1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:14.813081 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a91f886b7b43a38ac6d91dc7f301c1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:14.820639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a91f886b7b43a38ac6d91dc7f301c1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:14.821340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a91f886b7b43a38ac6d91dc7f301c1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:14.827493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1291/2576] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:13:14 2022] DELETE /identity/v3/users/b8a91f886b7b43a38ac6d91dc7f301c1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:13:15.102206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b37275-e0ec-4f90-94bb-63727842cfe6 service glance] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:15.113367 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b37275-e0ec-4f90-94bb-63727842cfe6 service glance] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:15.207842 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:15.209299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:15.209580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:15.209855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] PATH_INFO: `/v3/projects/c14a6c56310d41daae3669f22c130375` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:15.211148 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14a6c56310d41daae3669f22c130375)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:15.213048 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:15.259569 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14a6c56310d41daae3669f22c130375', 'request_id': 'req-c048e509-568c-4867-a40f-a340fa3d851c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.265759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14a6c56310d41daae3669f22c130375', 'request_id': 'req-c048e509-568c-4867-a40f-a340fa3d851c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.273566 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14a6c56310d41daae3669f22c130375', 'request_id': 'req-c048e509-568c-4867-a40f-a340fa3d851c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.285045 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] The token cache is being invalidate because project c14a6c56310d41daae3669f22c130375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:13:15.285335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.285970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.287592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1286/2577] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:13:15 2022] DELETE /identity/v3/projects/c14a6c56310d41daae3669f22c130375 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:13:15.291793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:15.293736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:15.308174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5099c8-f310-4eb3-920d-8b3160b8e350 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:15.364744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:15.365592 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:15.365874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:15.366151 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] PATH_INFO: `/v3/users/4d79624e84794b4c89423e2a02519494` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:15.367545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d79624e84794b4c89423e2a02519494)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:15.369500 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:15.409900 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:15.421204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d79624e84794b4c89423e2a02519494'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.433901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d79624e84794b4c89423e2a02519494'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.443846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d79624e84794b4c89423e2a02519494'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.450655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d79624e84794b4c89423e2a02519494'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.451292 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d79624e84794b4c89423e2a02519494'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.457262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1292/2578] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:13:15 2022] DELETE /identity/v3/users/4d79624e84794b4c89423e2a02519494 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:13:15.543550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:15.547245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:15.586605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:15.625686 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048e509-568c-4867-a40f-a340fa3d851c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:15.659566 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:15.661521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:15.686818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537155aa-c336-4606-9cff-38d978807765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:15.687514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537155aa-c336-4606-9cff-38d978807765 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:15.687794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537155aa-c336-4606-9cff-38d978807765 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:15.688070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537155aa-c336-4606-9cff-38d978807765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:15.689892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-537155aa-c336-4606-9cff-38d978807765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:15.751680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537155aa-c336-4606-9cff-38d978807765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:15.753142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537155aa-c336-4606-9cff-38d978807765 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:15.757252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4f8b7-ef0a-40bf-b0b0-b69614a3f30e admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:15.762912 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:15.763520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1287/2579] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:13:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:13:15.764009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:15.764431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:15.764740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] PATH_INFO: `/v3/projects/19412ee60feb4875acb4cc54ee631ecf` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:15.766006 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19412ee60feb4875acb4cc54ee631ecf)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:15.767971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:15.823119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19412ee60feb4875acb4cc54ee631ecf', 'request_id': 'req-eebe352b-d457-49eb-97c0-b7be3db90098'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.830320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19412ee60feb4875acb4cc54ee631ecf', 'request_id': 'req-eebe352b-d457-49eb-97c0-b7be3db90098'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.839118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19412ee60feb4875acb4cc54ee631ecf', 'request_id': 'req-eebe352b-d457-49eb-97c0-b7be3db90098'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.850550 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] The token cache is being invalidate because project 19412ee60feb4875acb4cc54ee631ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:13:15.850863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.851577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:15.863025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1293/2580] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:13:15 2022] DELETE /identity/v3/projects/19412ee60feb4875acb4cc54ee631ecf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:13:16.339557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d4044-efc5-4260-a83b-32f7d8afa69f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:16.340384 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d4044-efc5-4260-a83b-32f7d8afa69f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:16.340853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d4044-efc5-4260-a83b-32f7d8afa69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:16.364429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5e4d4044-efc5-4260-a83b-32f7d8afa69f None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:13:16.366548 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5e4d4044-efc5-4260-a83b-32f7d8afa69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:16.437859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1288/2581] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:13:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:13:16.457513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:16.459260 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:16.530196 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:16.557569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe352b-d457-49eb-97c0-b7be3db90098 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:16.562955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fb8e2-c8a8-45a9-ab3c-bc22c4daa173 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:16.563630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fb8e2-c8a8-45a9-ab3c-bc22c4daa173 service swift] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:16.563915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fb8e2-c8a8-45a9-ab3c-bc22c4daa173 service swift] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:16.564197 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fb8e2-c8a8-45a9-ab3c-bc22c4daa173 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:16.572632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fb8e2-c8a8-45a9-ab3c-bc22c4daa173 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:16.574253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fb8e2-c8a8-45a9-ab3c-bc22c4daa173 service swift] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:16.582560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1294/2582] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:13:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:13:26.428461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=81 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:26.580146 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=13 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:35.939834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d4044-efc5-4260-a83b-32f7d8afa69f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:35.941313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5e4d4044-efc5-4260-a83b-32f7d8afa69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:35.996968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d4044-efc5-4260-a83b-32f7d8afa69f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:36.000907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a415520-cb3f-42f4-874c-2c041f3054c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:36.001707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a415520-cb3f-42f4-874c-2c041f3054c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:36.002206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a415520-cb3f-42f4-874c-2c041f3054c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:36.002493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a415520-cb3f-42f4-874c-2c041f3054c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:36.004550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5a415520-cb3f-42f4-874c-2c041f3054c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:36.076817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a415520-cb3f-42f4-874c-2c041f3054c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:36.078840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a415520-cb3f-42f4-874c-2c041f3054c5 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:36.090198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1289/2583] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:13:36.779230 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af32e1-2ce4-42d6-ba3f-7d0b00681a76 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:36.780116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af32e1-2ce4-42d6-ba3f-7d0b00681a76 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:36.780554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af32e1-2ce4-42d6-ba3f-7d0b00681a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:36.801460 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-90af32e1-2ce4-42d6-ba3f-7d0b00681a76 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:13:36.803048 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-90af32e1-2ce4-42d6-ba3f-7d0b00681a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:36.825158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a415520-cb3f-42f4-874c-2c041f3054c5 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:36.836559 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1295/2584] 10.222.0.36 () {58 vars in 967 bytes} [Sun Jun 26 03:13:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:13:36.837668 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a415520-cb3f-42f4-874c-2c041f3054c5 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:36.842897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acde78e-549d-4001-92e4-366aff64f06c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:36.843601 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde78e-549d-4001-92e4-366aff64f06c service swift] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:36.843934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde78e-549d-4001-92e4-366aff64f06c service swift] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:36.844211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde78e-549d-4001-92e4-366aff64f06c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:36.853547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acde78e-549d-4001-92e4-366aff64f06c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:36.855264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acde78e-549d-4001-92e4-366aff64f06c service swift] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:36.864695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1290/2585] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:13:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 26 03:13:42.003043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af32e1-2ce4-42d6-ba3f-7d0b00681a76 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:42.004527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-90af32e1-2ce4-42d6-ba3f-7d0b00681a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:42.016761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af32e1-2ce4-42d6-ba3f-7d0b00681a76 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:42.020335 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e5c50-0b2a-4312-aa54-dfbe7cc24d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:42.020979 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e5c50-0b2a-4312-aa54-dfbe7cc24d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:42.021255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e5c50-0b2a-4312-aa54-dfbe7cc24d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:42.021531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e5c50-0b2a-4312-aa54-dfbe7cc24d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:42.023290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-641e5c50-0b2a-4312-aa54-dfbe7cc24d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:42.035369 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e5c50-0b2a-4312-aa54-dfbe7cc24d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:42.037115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e5c50-0b2a-4312-aa54-dfbe7cc24d23 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:42.046998 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1296/2586] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:13:42.933173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acde78e-549d-4001-92e4-366aff64f06c service swift] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:42.935406 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5acde78e-549d-4001-92e4-366aff64f06c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:42.970193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acde78e-549d-4001-92e4-366aff64f06c service swift] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:42.975189 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:42.976114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:42.976399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:42.976741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] PATH_INFO: `/v3/users/a3276a47e989448f85cd720d1450baf5` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:42.978057 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3276a47e989448f85cd720d1450baf5)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:42.980076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:43.055928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3276a47e989448f85cd720d1450baf5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.070179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3276a47e989448f85cd720d1450baf5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.073125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3276a47e989448f85cd720d1450baf5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.083527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3276a47e989448f85cd720d1450baf5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.084361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3276a47e989448f85cd720d1450baf5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.102765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1291/2587] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:13:42 2022] DELETE /identity/v3/users/a3276a47e989448f85cd720d1450baf5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:13:43.301150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e5c50-0b2a-4312-aa54-dfbe7cc24d23 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:43.314412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e5c50-0b2a-4312-aa54-dfbe7cc24d23 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:43.373385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:43.374387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:43.374740 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:43.375131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] PATH_INFO: `/v3/projects/389b33e30a0244d880981ad07e6aa089` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:43.376471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] RBAC: Authorizing `identity:delete_project(project_id=389b33e30a0244d880981ad07e6aa089)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:43.378445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:43.436312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389b33e30a0244d880981ad07e6aa089', 'request_id': 'req-09e8d069-2261-4dcd-a57b-dd72375b315a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.444818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389b33e30a0244d880981ad07e6aa089', 'request_id': 'req-09e8d069-2261-4dcd-a57b-dd72375b315a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.454547 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389b33e30a0244d880981ad07e6aa089', 'request_id': 'req-09e8d069-2261-4dcd-a57b-dd72375b315a'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.466825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] The token cache is being invalidate because project 389b33e30a0244d880981ad07e6aa089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:13:43.467140 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.467781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.469366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1297/2588] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:13:43 2022] DELETE /identity/v3/projects/389b33e30a0244d880981ad07e6aa089 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:13:43.474799 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:43.475932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:43.510162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56622c-5c53-481e-b540-a6b8d95a4c9b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:43.516978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:43.581863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:43.582976 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:43.583371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:43.583716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] PATH_INFO: `/v3/users/9508c6c0bb6d461b91bb74036b81f600` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:43.585093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9508c6c0bb6d461b91bb74036b81f600)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:43.587811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:43.645065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9508c6c0bb6d461b91bb74036b81f600'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.658958 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9508c6c0bb6d461b91bb74036b81f600'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.659829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9508c6c0bb6d461b91bb74036b81f600'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.669534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9508c6c0bb6d461b91bb74036b81f600'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.670414 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9508c6c0bb6d461b91bb74036b81f600'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:43.686898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1292/2589] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:13:43 2022] DELETE /identity/v3/users/9508c6c0bb6d461b91bb74036b81f600 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:13:43.873400 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:43.874865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:43.894629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8d069-2261-4dcd-a57b-dd72375b315a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:43.970318 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:43.971330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:43.971745 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:43.972116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] PATH_INFO: `/v3/projects/ca57fa350a464214982cfef398605083` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:43.973663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca57fa350a464214982cfef398605083)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:43.976033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:43.989700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:44.039141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca57fa350a464214982cfef398605083', 'request_id': 'req-fbd25080-6bf0-4297-bb4d-f7b0362db764'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:44.045371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca57fa350a464214982cfef398605083', 'request_id': 'req-fbd25080-6bf0-4297-bb4d-f7b0362db764'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:44.054116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca57fa350a464214982cfef398605083', 'request_id': 'req-fbd25080-6bf0-4297-bb4d-f7b0362db764'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:44.065291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] The token cache is being invalidate because project ca57fa350a464214982cfef398605083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:13:44.065582 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:44.066222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:44.067839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1298/2590] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:13:43 2022] DELETE /identity/v3/projects/ca57fa350a464214982cfef398605083 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:13:45.288126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:45.289708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:45.357440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:45.358923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:45.376692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4962946-54d5-42c3-8251-6cf8a13db6f7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:45.420932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:45.434833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd25080-6bf0-4297-bb4d-f7b0362db764 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:45.440021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5971984-6464-481d-b54a-9a99dfe6491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:45.440849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5971984-6464-481d-b54a-9a99dfe6491d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:45.441131 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5971984-6464-481d-b54a-9a99dfe6491d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:45.441489 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5971984-6464-481d-b54a-9a99dfe6491d admin admin] PATH_INFO: `/v3/users/62f614b02ced4c4fae0fc0853ed66431` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:45.442713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5971984-6464-481d-b54a-9a99dfe6491d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f614b02ced4c4fae0fc0853ed66431)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:45.444713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5971984-6464-481d-b54a-9a99dfe6491d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:45.460347 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188166cb-92f8-491d-ac20-bd198cdf234b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:45.461021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188166cb-92f8-491d-ac20-bd198cdf234b service placement] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:45.461308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188166cb-92f8-491d-ac20-bd198cdf234b service placement] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:45.461592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188166cb-92f8-491d-ac20-bd198cdf234b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:45.463656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-188166cb-92f8-491d-ac20-bd198cdf234b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:45.476274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188166cb-92f8-491d-ac20-bd198cdf234b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:45.481559 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188166cb-92f8-491d-ac20-bd198cdf234b service placement] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:45.492502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1293/2591] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:13:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:13:45.514775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f5971984-6464-481d-b54a-9a99dfe6491d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f614b02ced4c4fae0fc0853ed66431'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:45.528484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f5971984-6464-481d-b54a-9a99dfe6491d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f614b02ced4c4fae0fc0853ed66431'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:45.539205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f5971984-6464-481d-b54a-9a99dfe6491d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f614b02ced4c4fae0fc0853ed66431'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:45.546532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f5971984-6464-481d-b54a-9a99dfe6491d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f614b02ced4c4fae0fc0853ed66431'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:45.547375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f5971984-6464-481d-b54a-9a99dfe6491d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f614b02ced4c4fae0fc0853ed66431'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:45.553467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1299/2592] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:13:45 2022] DELETE /identity/v3/users/62f614b02ced4c4fae0fc0853ed66431 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:13:45.735085 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188166cb-92f8-491d-ac20-bd198cdf234b service placement] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:45.746429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188166cb-92f8-491d-ac20-bd198cdf234b service placement] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:45.805733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:45.806603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:45.806999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:45.807296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] PATH_INFO: `/v3/projects/b83cf0bff2f74b9ca8596218774e323c` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:45.808560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b83cf0bff2f74b9ca8596218774e323c)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:45.810477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:45.858220 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b83cf0bff2f74b9ca8596218774e323c', 'request_id': 'req-044ef22d-e9f6-4628-9e32-d94bf51c9921'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:45.864570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b83cf0bff2f74b9ca8596218774e323c', 'request_id': 'req-044ef22d-e9f6-4628-9e32-d94bf51c9921'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:45.873436 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b83cf0bff2f74b9ca8596218774e323c', 'request_id': 'req-044ef22d-e9f6-4628-9e32-d94bf51c9921'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:45.884510 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] The token cache is being invalidate because project b83cf0bff2f74b9ca8596218774e323c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:13:45.884798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:45.885497 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-044ef22d-e9f6-4628-9e32-d94bf51c9921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:13:45.887118 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1294/2593] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:13:45 2022] DELETE /identity/v3/projects/b83cf0bff2f74b9ca8596218774e323c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:13:45.892346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd1b2-31e4-4d15-95f5-6c037caf032e None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:45.892623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd1b2-31e4-4d15-95f5-6c037caf032e None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:45.892902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd1b2-31e4-4d15-95f5-6c037caf032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:45.911409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-2e2fd1b2-31e4-4d15-95f5-6c037caf032e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:13:45.912623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2e2fd1b2-31e4-4d15-95f5-6c037caf032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:45.932805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:45.983142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1300/2594] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:13:45.991684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759688b-1bdc-4e3c-8cd4-dc1558eb28e6 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:45.992055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759688b-1bdc-4e3c-8cd4-dc1558eb28e6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:45.992431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759688b-1bdc-4e3c-8cd4-dc1558eb28e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:46.017466 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b759688b-1bdc-4e3c-8cd4-dc1558eb28e6 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:13:46.018678 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b759688b-1bdc-4e3c-8cd4-dc1558eb28e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:46.028605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1295/2595] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:13:46.032971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fd1b2-31e4-4d15-95f5-6c037caf032e None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:46.043388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fd1b2-31e4-4d15-95f5-6c037caf032e None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:46.049288 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dac97-3cf0-4207-8d35-010db37f279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:46.049953 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dac97-3cf0-4207-8d35-010db37f279b admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:46.050247 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dac97-3cf0-4207-8d35-010db37f279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:46.050516 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dac97-3cf0-4207-8d35-010db37f279b admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:46.051293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dac97-3cf0-4207-8d35-010db37f279b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:13:46.051598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dac97-3cf0-4207-8d35-010db37f279b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:46.053252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dac97-3cf0-4207-8d35-010db37f279b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:46.065988 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1301/2596] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:13:46.070562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759688b-1bdc-4e3c-8cd4-dc1558eb28e6 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:46.080543 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759688b-1bdc-4e3c-8cd4-dc1558eb28e6 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:46.086243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b255839-bb6c-408a-a0de-7487d87cf2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:46.087018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b255839-bb6c-408a-a0de-7487d87cf2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:46.087310 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b255839-bb6c-408a-a0de-7487d87cf2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:46.087598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b255839-bb6c-408a-a0de-7487d87cf2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:46.088317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b255839-bb6c-408a-a0de-7487d87cf2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:46.090222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b255839-bb6c-408a-a0de-7487d87cf2a9 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:46.115622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1296/2597] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:13:46 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:13:46.119891 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dac97-3cf0-4207-8d35-010db37f279b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:46.130149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dac97-3cf0-4207-8d35-010db37f279b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:46.187951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e47033-d702-479b-aa68-5f7dc6d224cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:46.188613 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e47033-d702-479b-aa68-5f7dc6d224cc admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:46.188887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e47033-d702-479b-aa68-5f7dc6d224cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:46.189163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e47033-d702-479b-aa68-5f7dc6d224cc admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:46.189848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e47033-d702-479b-aa68-5f7dc6d224cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:46.191818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e47033-d702-479b-aa68-5f7dc6d224cc admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:46.213852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1302/2598] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:13:46 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:13:46.218081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b255839-bb6c-408a-a0de-7487d87cf2a9 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:46.228681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b255839-bb6c-408a-a0de-7487d87cf2a9 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:46.233942 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4ce75-450c-40da-b5e7-47aeb9b1fbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:46.234550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4ce75-450c-40da-b5e7-47aeb9b1fbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:46.234832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4ce75-450c-40da-b5e7-47aeb9b1fbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:46.235149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4ce75-450c-40da-b5e7-47aeb9b1fbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:46.235914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4ce75-450c-40da-b5e7-47aeb9b1fbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:46.237534 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4ce75-450c-40da-b5e7-47aeb9b1fbf1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:46.248474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1297/2599] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:13:46.252366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e47033-d702-479b-aa68-5f7dc6d224cc admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:46.263015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e47033-d702-479b-aa68-5f7dc6d224cc admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:46.268115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae39d1a-270f-47d6-917c-e26cd6a145f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:46.268797 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39d1a-270f-47d6-917c-e26cd6a145f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:46.269055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39d1a-270f-47d6-917c-e26cd6a145f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:46.269331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39d1a-270f-47d6-917c-e26cd6a145f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:46.270064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae39d1a-270f-47d6-917c-e26cd6a145f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:46.271717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae39d1a-270f-47d6-917c-e26cd6a145f5 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:46.282328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1303/2600] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:13:46.286445 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4ce75-450c-40da-b5e7-47aeb9b1fbf1 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:46.296955 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4ce75-450c-40da-b5e7-47aeb9b1fbf1 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:46.302741 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4c2dd-ca08-488a-b44e-58381e6123be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:46.303693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4c2dd-ca08-488a-b44e-58381e6123be admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:46.303956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4c2dd-ca08-488a-b44e-58381e6123be admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:46.304264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4c2dd-ca08-488a-b44e-58381e6123be admin admin] PATH_INFO: `/v3/projects/a343b1fea3834e5f86b9109cac7768c2/users/b745bccb3ce24ca9bb32b6648a5e17c7/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:46.312699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:46.320610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4c2dd-ca08-488a-b44e-58381e6123be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a343b1fea3834e5f86b9109cac7768c2, user_id=b745bccb3ce24ca9bb32b6648a5e17c7, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:46.323689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4c2dd-ca08-488a-b44e-58381e6123be admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:46.337460 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1298/2601] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:13:46 2022] PUT /identity/v3/projects/a343b1fea3834e5f86b9109cac7768c2/users/b745bccb3ce24ca9bb32b6648a5e17c7/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:13:46.342600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172b71-777b-472d-9a5c-ef3ac25283a0 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:46.343134 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172b71-777b-472d-9a5c-ef3ac25283a0 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:46.343417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172b71-777b-472d-9a5c-ef3ac25283a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:46.361128 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-16172b71-777b-472d-9a5c-ef3ac25283a0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:13:46.362305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-16172b71-777b-472d-9a5c-ef3ac25283a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:46.423226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1304/2602] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:13:46.433918 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4c2dd-ca08-488a-b44e-58381e6123be admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:46.436503 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-29e4c2dd-ca08-488a-b44e-58381e6123be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:46.502126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4c2dd-ca08-488a-b44e-58381e6123be admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:46.506922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc5d28-02d1-4b3a-9b92-9ffa3d0e0bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:46.507617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc5d28-02d1-4b3a-9b92-9ffa3d0e0bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:46.507897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc5d28-02d1-4b3a-9b92-9ffa3d0e0bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:46.508172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc5d28-02d1-4b3a-9b92-9ffa3d0e0bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:46.518784 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc5d28-02d1-4b3a-9b92-9ffa3d0e0bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:46.520265 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc5d28-02d1-4b3a-9b92-9ffa3d0e0bbf service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:46.530783 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1299/2603] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:13:50.939238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0bf9-6acf-4367-b298-d7678355c15b None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:50.939784 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0bf9-6acf-4367-b298-d7678355c15b None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:50.940035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0bf9-6acf-4367-b298-d7678355c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:50.967919 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-321b0bf9-6acf-4367-b298-d7678355c15b None None] MFA Rules not processed for user `b745bccb3ce24ca9bb32b6648a5e17c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:13:50.969893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-321b0bf9-6acf-4367-b298-d7678355c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:50.984809 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:13:51.038696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1305/2604] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:13:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:13:51.052720 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc5d28-02d1-4b3a-9b92-9ffa3d0e0bbf service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:13:51.054369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5abc5d28-02d1-4b3a-9b92-9ffa3d0e0bbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:51.131269 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc5d28-02d1-4b3a-9b92-9ffa3d0e0bbf service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:13:51.137850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b0ba-8553-41e9-8f8e-fc96dab6306a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:13:51.138428 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b0ba-8553-41e9-8f8e-fc96dab6306a service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:51.138710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b0ba-8553-41e9-8f8e-fc96dab6306a service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:51.139015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b0ba-8553-41e9-8f8e-fc96dab6306a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:51.147385 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704b0ba-8553-41e9-8f8e-fc96dab6306a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:13:51.149157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704b0ba-8553-41e9-8f8e-fc96dab6306a service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:13:51.158908 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1300/2605] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:13:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:13:52.499718 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a967d-d531-4b7b-a7f7-1cea7fae78bb None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:13:52.500248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a967d-d531-4b7b-a7f7-1cea7fae78bb None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:13:52.500248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a967d-d531-4b7b-a7f7-1cea7fae78bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:13:52.519694 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-bd7a967d-d531-4b7b-a7f7-1cea7fae78bb None None] MFA Rules not processed for user `b745bccb3ce24ca9bb32b6648a5e17c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:13:52.521279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-bd7a967d-d531-4b7b-a7f7-1cea7fae78bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:13:52.529129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1306/2606] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:13:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:01.155115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:02.514517 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=23 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:40.547463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b0ba-8553-41e9-8f8e-fc96dab6306a service nova] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:40.548980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8704b0ba-8553-41e9-8f8e-fc96dab6306a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:40.561526 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b0ba-8553-41e9-8f8e-fc96dab6306a service nova] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:40.566162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d248b-3139-48ed-86ca-5dbf2c7d1877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:40.566889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d248b-3139-48ed-86ca-5dbf2c7d1877 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:40.567401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d248b-3139-48ed-86ca-5dbf2c7d1877 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:40.567674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d248b-3139-48ed-86ca-5dbf2c7d1877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:40.569637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-717d248b-3139-48ed-86ca-5dbf2c7d1877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:40.582483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d248b-3139-48ed-86ca-5dbf2c7d1877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:40.584012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d248b-3139-48ed-86ca-5dbf2c7d1877 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:40.593930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1301/2607] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:14:43.703513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a967d-d531-4b7b-a7f7-1cea7fae78bb None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:43.705589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-bd7a967d-d531-4b7b-a7f7-1cea7fae78bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:43.721119 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a967d-d531-4b7b-a7f7-1cea7fae78bb None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:43.725699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076c069-1b38-4322-a22e-319b97991c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:43.726584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076c069-1b38-4322-a22e-319b97991c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:43.726860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076c069-1b38-4322-a22e-319b97991c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:43.727309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076c069-1b38-4322-a22e-319b97991c89 admin admin] PATH_INFO: `/v3/users/9fd251e1a49a4a5e817eec4df8794656` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:43.728506 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076c069-1b38-4322-a22e-319b97991c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd251e1a49a4a5e817eec4df8794656)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:43.730484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076c069-1b38-4322-a22e-319b97991c89 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:43.781865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7076c069-1b38-4322-a22e-319b97991c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd251e1a49a4a5e817eec4df8794656'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:43.797064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7076c069-1b38-4322-a22e-319b97991c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd251e1a49a4a5e817eec4df8794656'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:43.805340 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7076c069-1b38-4322-a22e-319b97991c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd251e1a49a4a5e817eec4df8794656'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:43.812231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7076c069-1b38-4322-a22e-319b97991c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd251e1a49a4a5e817eec4df8794656'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:43.812918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7076c069-1b38-4322-a22e-319b97991c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd251e1a49a4a5e817eec4df8794656'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:43.819250 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1307/2608] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:14:43 2022] DELETE /identity/v3/users/9fd251e1a49a4a5e817eec4df8794656 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:43.998802 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d248b-3139-48ed-86ca-5dbf2c7d1877 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:44.010146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d248b-3139-48ed-86ca-5dbf2c7d1877 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:44.068024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:44.068880 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:44.069173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:44.069451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] PATH_INFO: `/v3/projects/da0f89811c5a4ec3a7701ad0bf1de7c1` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:44.070616 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0f89811c5a4ec3a7701ad0bf1de7c1)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:44.072598 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:44.129599 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0f89811c5a4ec3a7701ad0bf1de7c1', 'request_id': 'req-185241e9-5851-4eec-89e6-f89663a2647a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:44.135976 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0f89811c5a4ec3a7701ad0bf1de7c1', 'request_id': 'req-185241e9-5851-4eec-89e6-f89663a2647a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:44.144251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0f89811c5a4ec3a7701ad0bf1de7c1', 'request_id': 'req-185241e9-5851-4eec-89e6-f89663a2647a'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:44.155647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] The token cache is being invalidate because project da0f89811c5a4ec3a7701ad0bf1de7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:14:44.155930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:44.156565 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-185241e9-5851-4eec-89e6-f89663a2647a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:44.158180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1302/2609] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:14:43 2022] DELETE /identity/v3/projects/da0f89811c5a4ec3a7701ad0bf1de7c1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:44.164171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0c4d2-52c4-4373-aea6-deb5b0b24055 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:44.164673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0c4d2-52c4-4373-aea6-deb5b0b24055 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:44.165127 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0c4d2-52c4-4373-aea6-deb5b0b24055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:44.192100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-77b0c4d2-52c4-4373-aea6-deb5b0b24055 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:44.193336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-77b0c4d2-52c4-4373-aea6-deb5b0b24055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:44.255196 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1308/2610] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:44.263254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5de71-a784-4660-aa67-2cb34fac7cd7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:44.263549 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5de71-a784-4660-aa67-2cb34fac7cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:44.263828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5de71-a784-4660-aa67-2cb34fac7cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:44.284624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-72b5de71-a784-4660-aa67-2cb34fac7cd7 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:44.287994 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-72b5de71-a784-4660-aa67-2cb34fac7cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:44.297372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1303/2611] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:44.301814 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0c4d2-52c4-4373-aea6-deb5b0b24055 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:44.312310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0c4d2-52c4-4373-aea6-deb5b0b24055 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:44.317943 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144a1d6-a259-4133-9b55-5f2bc0b481f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:44.318605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a1d6-a259-4133-9b55-5f2bc0b481f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:44.318892 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a1d6-a259-4133-9b55-5f2bc0b481f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:44.319205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a1d6-a259-4133-9b55-5f2bc0b481f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:44.319937 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144a1d6-a259-4133-9b55-5f2bc0b481f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:14:44.320245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144a1d6-a259-4133-9b55-5f2bc0b481f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:44.321906 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144a1d6-a259-4133-9b55-5f2bc0b481f6 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:44.334161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1309/2612] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:14:44.338420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5de71-a784-4660-aa67-2cb34fac7cd7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:44.348156 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5de71-a784-4660-aa67-2cb34fac7cd7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:44.353967 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a4e6f-a16f-4f5c-99aa-f4c51b59f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:44.354638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a4e6f-a16f-4f5c-99aa-f4c51b59f334 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:44.354919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a4e6f-a16f-4f5c-99aa-f4c51b59f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:44.355222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a4e6f-a16f-4f5c-99aa-f4c51b59f334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:44.355906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a4e6f-a16f-4f5c-99aa-f4c51b59f334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:44.357813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a4e6f-a16f-4f5c-99aa-f4c51b59f334 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:44.386822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1304/2613] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:14:44 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:14:44.392250 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144a1d6-a259-4133-9b55-5f2bc0b481f6 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:44.403060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144a1d6-a259-4133-9b55-5f2bc0b481f6 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:44.462531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a888f74-b8ca-44dd-ab29-32509f9bd4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:44.463140 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a888f74-b8ca-44dd-ab29-32509f9bd4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:44.463425 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a888f74-b8ca-44dd-ab29-32509f9bd4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:44.463700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a888f74-b8ca-44dd-ab29-32509f9bd4f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:44.464376 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a888f74-b8ca-44dd-ab29-32509f9bd4f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:44.466303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a888f74-b8ca-44dd-ab29-32509f9bd4f0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:44.472825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:44.491654 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1310/2614] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:14:44 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:14:44.496097 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a4e6f-a16f-4f5c-99aa-f4c51b59f334 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:44.506672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a4e6f-a16f-4f5c-99aa-f4c51b59f334 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:44.511680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee0579-de92-45ac-93ba-22fc56ed44c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:44.512346 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee0579-de92-45ac-93ba-22fc56ed44c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:44.512627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee0579-de92-45ac-93ba-22fc56ed44c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:44.512901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee0579-de92-45ac-93ba-22fc56ed44c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:44.513692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee0579-de92-45ac-93ba-22fc56ed44c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:44.515347 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee0579-de92-45ac-93ba-22fc56ed44c3 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:44.527132 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1305/2615] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:14:44.531143 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a888f74-b8ca-44dd-ab29-32509f9bd4f0 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:44.541561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a888f74-b8ca-44dd-ab29-32509f9bd4f0 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:44.547375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2d18b-a025-45f4-9cc4-089ea1acfc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:44.548047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d18b-a025-45f4-9cc4-089ea1acfc97 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:44.548318 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d18b-a025-45f4-9cc4-089ea1acfc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:44.548588 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d18b-a025-45f4-9cc4-089ea1acfc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:44.549314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2d18b-a025-45f4-9cc4-089ea1acfc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:44.550935 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2d18b-a025-45f4-9cc4-089ea1acfc97 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:44.563270 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1311/2616] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:14:44.567345 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee0579-de92-45ac-93ba-22fc56ed44c3 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:44.577673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee0579-de92-45ac-93ba-22fc56ed44c3 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:44.582822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d8aa-e240-4187-b442-8faec89bd99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:44.583738 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d8aa-e240-4187-b442-8faec89bd99a admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:44.584016 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d8aa-e240-4187-b442-8faec89bd99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:44.584293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d8aa-e240-4187-b442-8faec89bd99a admin admin] PATH_INFO: `/v3/projects/96925fdbdd324391a3ee4f67661b4395/users/2ccb97963a80470ca0adf5dca98a3228/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:44.599288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8d8aa-e240-4187-b442-8faec89bd99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=96925fdbdd324391a3ee4f67661b4395, user_id=2ccb97963a80470ca0adf5dca98a3228, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:44.601941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8d8aa-e240-4187-b442-8faec89bd99a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:44.616694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1306/2617] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:14:44 2022] PUT /identity/v3/projects/96925fdbdd324391a3ee4f67661b4395/users/2ccb97963a80470ca0adf5dca98a3228/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:44.621671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ccba8-bed0-4d2a-960e-c3534681bdaf None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:44.621960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ccba8-bed0-4d2a-960e-c3534681bdaf None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:44.622239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ccba8-bed0-4d2a-960e-c3534681bdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:44.639089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-934ccba8-bed0-4d2a-960e-c3534681bdaf None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:44.640253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-934ccba8-bed0-4d2a-960e-c3534681bdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:44.698616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1312/2618] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:44.710177 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d8aa-e240-4187-b442-8faec89bd99a admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:44.712033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5ac8d8aa-e240-4187-b442-8faec89bd99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:44.726556 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:44.771999 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d8aa-e240-4187-b442-8faec89bd99a admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:44.776522 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a2631-2e43-4b4d-83fa-961f9a7695bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:44.777170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a2631-2e43-4b4d-83fa-961f9a7695bb service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:44.777453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a2631-2e43-4b4d-83fa-961f9a7695bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:44.777730 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a2631-2e43-4b4d-83fa-961f9a7695bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:44.787764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a2631-2e43-4b4d-83fa-961f9a7695bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:44.789205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a2631-2e43-4b4d-83fa-961f9a7695bb service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:44.798439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1307/2619] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:14:45.384665 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4661fb-d50b-42cb-bb90-f0dfbdf517d1 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:45.385253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4661fb-d50b-42cb-bb90-f0dfbdf517d1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:45.385253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4661fb-d50b-42cb-bb90-f0dfbdf517d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:45.414226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ca4661fb-d50b-42cb-bb90-f0dfbdf517d1 None None] MFA Rules not processed for user `2ccb97963a80470ca0adf5dca98a3228`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:45.415555 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ca4661fb-d50b-42cb-bb90-f0dfbdf517d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:45.484754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1313/2620] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:45.489447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a2631-2e43-4b4d-83fa-961f9a7695bb service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:45.499827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a2631-2e43-4b4d-83fa-961f9a7695bb service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:45.504937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373c7c9-2825-4f88-8dc3-f4b14447e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:45.505613 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373c7c9-2825-4f88-8dc3-f4b14447e7bc admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:45.505890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373c7c9-2825-4f88-8dc3-f4b14447e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:45.506171 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373c7c9-2825-4f88-8dc3-f4b14447e7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:45.506866 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373c7c9-2825-4f88-8dc3-f4b14447e7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:45.508897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373c7c9-2825-4f88-8dc3-f4b14447e7bc admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:45.538153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1308/2621] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:14:45 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:14:45.539374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4661fb-d50b-42cb-bb90-f0dfbdf517d1 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:45.550960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4661fb-d50b-42cb-bb90-f0dfbdf517d1 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:45.607770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354b122-1fd3-4ab8-b995-3b804955c965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:45.608445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354b122-1fd3-4ab8-b995-3b804955c965 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:45.608743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354b122-1fd3-4ab8-b995-3b804955c965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:45.609029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354b122-1fd3-4ab8-b995-3b804955c965 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:45.609707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354b122-1fd3-4ab8-b995-3b804955c965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:45.611688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354b122-1fd3-4ab8-b995-3b804955c965 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:45.625710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:45.632353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1314/2622] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:14:45 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:14:45.639047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373c7c9-2825-4f88-8dc3-f4b14447e7bc admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:45.650009 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373c7c9-2825-4f88-8dc3-f4b14447e7bc admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:45.655102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810cfec-8628-44f2-8072-7a0bff6628b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:45.655763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810cfec-8628-44f2-8072-7a0bff6628b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:45.656042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810cfec-8628-44f2-8072-7a0bff6628b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:45.656319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810cfec-8628-44f2-8072-7a0bff6628b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:45.657041 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810cfec-8628-44f2-8072-7a0bff6628b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:45.658707 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810cfec-8628-44f2-8072-7a0bff6628b9 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:45.669214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1309/2623] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:14:45.673258 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354b122-1fd3-4ab8-b995-3b804955c965 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:45.683596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354b122-1fd3-4ab8-b995-3b804955c965 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:45.689376 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cb061-45f5-48b4-b8d4-9dbfa3278ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:45.690274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cb061-45f5-48b4-b8d4-9dbfa3278ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:45.690557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cb061-45f5-48b4-b8d4-9dbfa3278ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:45.690807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cb061-45f5-48b4-b8d4-9dbfa3278ad2 admin admin] PATH_INFO: `/v3/projects/05131fd2d0204c5b8172d2e44994b42b/users/1a1ce65fa045438587e094af7234ccc0/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:45.706453 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cb061-45f5-48b4-b8d4-9dbfa3278ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05131fd2d0204c5b8172d2e44994b42b, user_id=1a1ce65fa045438587e094af7234ccc0, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:45.709192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cb061-45f5-48b4-b8d4-9dbfa3278ad2 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:45.722530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1315/2624] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:14:45 2022] PUT /identity/v3/projects/05131fd2d0204c5b8172d2e44994b42b/users/1a1ce65fa045438587e094af7234ccc0/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:45.726712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810cfec-8628-44f2-8072-7a0bff6628b9 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:45.736859 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810cfec-8628-44f2-8072-7a0bff6628b9 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:45.802695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f1635-c905-44f9-b6a4-769ff9d36fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:45.803397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1635-c905-44f9-b6a4-769ff9d36fab admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:45.803674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1635-c905-44f9-b6a4-769ff9d36fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:45.803953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1635-c905-44f9-b6a4-769ff9d36fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:45.804677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f1635-c905-44f9-b6a4-769ff9d36fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:45.806285 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f1635-c905-44f9-b6a4-769ff9d36fab admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:45.816386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1310/2625] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:14:45.821139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cb061-45f5-48b4-b8d4-9dbfa3278ad2 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:45.832578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cb061-45f5-48b4-b8d4-9dbfa3278ad2 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:45.838458 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dceef-20d3-4d9c-91d1-5f02d3030a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:45.839351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dceef-20d3-4d9c-91d1-5f02d3030a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:45.839641 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dceef-20d3-4d9c-91d1-5f02d3030a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:45.839937 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dceef-20d3-4d9c-91d1-5f02d3030a45 admin admin] PATH_INFO: `/v3/projects/05131fd2d0204c5b8172d2e44994b42b/users/1a1ce65fa045438587e094af7234ccc0/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:45.842164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406dceef-20d3-4d9c-91d1-5f02d3030a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05131fd2d0204c5b8172d2e44994b42b, user_id=1a1ce65fa045438587e094af7234ccc0, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:45.844869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406dceef-20d3-4d9c-91d1-5f02d3030a45 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:45.855947 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1316/2626] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:14:45 2022] PUT /identity/v3/projects/05131fd2d0204c5b8172d2e44994b42b/users/1a1ce65fa045438587e094af7234ccc0/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:46.517015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e2088-161e-4155-83b2-1fa6edfe3bbb None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:46.517544 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e2088-161e-4155-83b2-1fa6edfe3bbb None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:46.517669 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e2088-161e-4155-83b2-1fa6edfe3bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:46.545911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ab5e2088-161e-4155-83b2-1fa6edfe3bbb None None] MFA Rules not processed for user `1a1ce65fa045438587e094af7234ccc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:46.547245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ab5e2088-161e-4155-83b2-1fa6edfe3bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:46.619182 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1311/2627] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:47.660511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dceef-20d3-4d9c-91d1-5f02d3030a45 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:47.726904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dceef-20d3-4d9c-91d1-5f02d3030a45 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:47.732470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:47.733355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:47.733634 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:47.733910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] PATH_INFO: `/v3/users/2ccb97963a80470ca0adf5dca98a3228` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:47.735240 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ccb97963a80470ca0adf5dca98a3228)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:47.737189 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:47.789209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ccb97963a80470ca0adf5dca98a3228'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:47.801896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ccb97963a80470ca0adf5dca98a3228'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:47.810204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ccb97963a80470ca0adf5dca98a3228'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:47.818941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ccb97963a80470ca0adf5dca98a3228'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:47.819628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ccb97963a80470ca0adf5dca98a3228'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:47.825503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1317/2628] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:14:47 2022] DELETE /identity/v3/users/2ccb97963a80470ca0adf5dca98a3228 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:47.997039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e2088-161e-4155-83b2-1fa6edfe3bbb None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:48.004418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:48.009359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e2088-161e-4155-83b2-1fa6edfe3bbb None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:48.069238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:48.070117 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:48.070405 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:48.070683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] PATH_INFO: `/v3/projects/96925fdbdd324391a3ee4f67661b4395` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:48.071906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96925fdbdd324391a3ee4f67661b4395)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:48.073818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:48.121637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96925fdbdd324391a3ee4f67661b4395', 'request_id': 'req-b49a7548-d339-4ee8-bac0-b33f4716c757'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.127749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96925fdbdd324391a3ee4f67661b4395', 'request_id': 'req-b49a7548-d339-4ee8-bac0-b33f4716c757'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.135825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96925fdbdd324391a3ee4f67661b4395', 'request_id': 'req-b49a7548-d339-4ee8-bac0-b33f4716c757'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.146154 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] The token cache is being invalidate because project 96925fdbdd324391a3ee4f67661b4395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:14:48.146502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.147680 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.149371 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1312/2629] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:14:47 2022] DELETE /identity/v3/projects/96925fdbdd324391a3ee4f67661b4395 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:48.153496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:48.155079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:48.168960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77a929-fd4c-4d2c-9055-9e8eb97a155a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:48.207521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:48.229181 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce24056-6529-4e04-b8d8-e34bc2189d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:48.230069 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce24056-6529-4e04-b8d8-e34bc2189d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:48.230352 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce24056-6529-4e04-b8d8-e34bc2189d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:48.230627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce24056-6529-4e04-b8d8-e34bc2189d16 admin admin] PATH_INFO: `/v3/users/1a1ce65fa045438587e094af7234ccc0` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:48.231874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce24056-6529-4e04-b8d8-e34bc2189d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a1ce65fa045438587e094af7234ccc0)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:48.233812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce24056-6529-4e04-b8d8-e34bc2189d16 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:48.280193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-3ce24056-6529-4e04-b8d8-e34bc2189d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1ce65fa045438587e094af7234ccc0'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.291739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-3ce24056-6529-4e04-b8d8-e34bc2189d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1ce65fa045438587e094af7234ccc0'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.299913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-3ce24056-6529-4e04-b8d8-e34bc2189d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1ce65fa045438587e094af7234ccc0'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.307419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-3ce24056-6529-4e04-b8d8-e34bc2189d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1ce65fa045438587e094af7234ccc0'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.308149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-3ce24056-6529-4e04-b8d8-e34bc2189d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1ce65fa045438587e094af7234ccc0'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.314446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1318/2630] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:14:48 2022] DELETE /identity/v3/users/1a1ce65fa045438587e094af7234ccc0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:48.506303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:48.507855 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:48.525350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7548-d339-4ee8-bac0-b33f4716c757 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:48.582964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:48.583869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:48.584150 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:48.584429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] PATH_INFO: `/v3/projects/05131fd2d0204c5b8172d2e44994b42b` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:48.585665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05131fd2d0204c5b8172d2e44994b42b)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:48.587671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:48.636710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:48.646311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05131fd2d0204c5b8172d2e44994b42b', 'request_id': 'req-821f0df7-1a8b-4070-a10e-a5c8ee205416'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.653198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05131fd2d0204c5b8172d2e44994b42b', 'request_id': 'req-821f0df7-1a8b-4070-a10e-a5c8ee205416'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.662065 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05131fd2d0204c5b8172d2e44994b42b', 'request_id': 'req-821f0df7-1a8b-4070-a10e-a5c8ee205416'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.678911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] The token cache is being invalidate because project 05131fd2d0204c5b8172d2e44994b42b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:14:48.679215 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.680244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-821f0df7-1a8b-4070-a10e-a5c8ee205416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:48.682553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1313/2631] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:14:48 2022] DELETE /identity/v3/projects/05131fd2d0204c5b8172d2e44994b42b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:14:48.689261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9e9b0-bd07-4135-9dc3-0c920ed0c6cc None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:48.689738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9e9b0-bd07-4135-9dc3-0c920ed0c6cc None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:48.689845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9e9b0-bd07-4135-9dc3-0c920ed0c6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:48.709552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4dd9e9b0-bd07-4135-9dc3-0c920ed0c6cc None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:48.710757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4dd9e9b0-bd07-4135-9dc3-0c920ed0c6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:48.770588 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1319/2632] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:48.778683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc50ec-674b-478b-8655-9165d1130aa1 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:48.778970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc50ec-674b-478b-8655-9165d1130aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:48.779279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc50ec-674b-478b-8655-9165d1130aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:48.798822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7adc50ec-674b-478b-8655-9165d1130aa1 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:48.799980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7adc50ec-674b-478b-8655-9165d1130aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:48.809735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1314/2633] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:48.814095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9e9b0-bd07-4135-9dc3-0c920ed0c6cc None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:48.824576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9e9b0-bd07-4135-9dc3-0c920ed0c6cc None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:48.830291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807e516-a8bc-48cc-a4af-14d4b7507d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:48.831009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e516-a8bc-48cc-a4af-14d4b7507d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:48.831291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e516-a8bc-48cc-a4af-14d4b7507d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:48.831562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807e516-a8bc-48cc-a4af-14d4b7507d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:48.832369 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807e516-a8bc-48cc-a4af-14d4b7507d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:14:48.832675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807e516-a8bc-48cc-a4af-14d4b7507d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:48.834298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807e516-a8bc-48cc-a4af-14d4b7507d85 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:48.846632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1320/2634] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:14:48.854838 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc50ec-674b-478b-8655-9165d1130aa1 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:48.861351 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc50ec-674b-478b-8655-9165d1130aa1 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:48.867801 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32bd15-c886-4b6f-a5dc-9490631fab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:48.868498 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32bd15-c886-4b6f-a5dc-9490631fab22 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:48.868778 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32bd15-c886-4b6f-a5dc-9490631fab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:48.869047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32bd15-c886-4b6f-a5dc-9490631fab22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:48.869740 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32bd15-c886-4b6f-a5dc-9490631fab22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:48.872447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32bd15-c886-4b6f-a5dc-9490631fab22 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:48.906858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1315/2635] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:14:48 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:14:48.911215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807e516-a8bc-48cc-a4af-14d4b7507d85 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:48.921298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807e516-a8bc-48cc-a4af-14d4b7507d85 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:48.967525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:48.985865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbe067-8f5b-4f09-956d-52fa9fcdeeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:48.986840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe067-8f5b-4f09-956d-52fa9fcdeeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:48.987355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe067-8f5b-4f09-956d-52fa9fcdeeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:48.987745 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe067-8f5b-4f09-956d-52fa9fcdeeb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:48.988880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbe067-8f5b-4f09-956d-52fa9fcdeeb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:48.990823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbe067-8f5b-4f09-956d-52fa9fcdeeb0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:49.014951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1321/2636] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:14:48 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:14:49.019255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32bd15-c886-4b6f-a5dc-9490631fab22 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:49.030311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32bd15-c886-4b6f-a5dc-9490631fab22 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:49.036241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1e0de-bf5a-4260-8db2-7a919d98800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:49.036931 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1e0de-bf5a-4260-8db2-7a919d98800d admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.037211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1e0de-bf5a-4260-8db2-7a919d98800d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.037481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1e0de-bf5a-4260-8db2-7a919d98800d admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.038244 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1e0de-bf5a-4260-8db2-7a919d98800d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:49.039907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1e0de-bf5a-4260-8db2-7a919d98800d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:49.050850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1316/2637] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:14:49.055057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbe067-8f5b-4f09-956d-52fa9fcdeeb0 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:49.065858 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbe067-8f5b-4f09-956d-52fa9fcdeeb0 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:49.071726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed6a91-ec96-455d-850d-eb51bff2baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:49.072382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed6a91-ec96-455d-850d-eb51bff2baed admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.072663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed6a91-ec96-455d-850d-eb51bff2baed admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.072936 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed6a91-ec96-455d-850d-eb51bff2baed admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.073666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed6a91-ec96-455d-850d-eb51bff2baed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:49.075355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed6a91-ec96-455d-850d-eb51bff2baed admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:49.085844 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1322/2638] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:14:49.092248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1e0de-bf5a-4260-8db2-7a919d98800d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:49.105503 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1e0de-bf5a-4260-8db2-7a919d98800d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:49.112658 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6146d5-9b79-435f-adbf-74f9fe980528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:49.114018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6146d5-9b79-435f-adbf-74f9fe980528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.114306 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6146d5-9b79-435f-adbf-74f9fe980528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.114583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6146d5-9b79-435f-adbf-74f9fe980528 admin admin] PATH_INFO: `/v3/projects/b51f8b956c2740a8acbd19df4e1867a6/users/9306a1444ade4a72b07906bfc813999e/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.130719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6146d5-9b79-435f-adbf-74f9fe980528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51f8b956c2740a8acbd19df4e1867a6, user_id=9306a1444ade4a72b07906bfc813999e, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:49.133422 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6146d5-9b79-435f-adbf-74f9fe980528 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:49.148856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1317/2639] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:14:49 2022] PUT /identity/v3/projects/b51f8b956c2740a8acbd19df4e1867a6/users/9306a1444ade4a72b07906bfc813999e/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:49.159457 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c5131-d8a9-444a-b12f-a8076d7bb306 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.159732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c5131-d8a9-444a-b12f-a8076d7bb306 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.160005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c5131-d8a9-444a-b12f-a8076d7bb306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.186255 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-070c5131-d8a9-444a-b12f-a8076d7bb306 None None] MFA Rules not processed for user `9306a1444ade4a72b07906bfc813999e`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:49.187476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-070c5131-d8a9-444a-b12f-a8076d7bb306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:49.252846 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1323/2640] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:49.257590 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6146d5-9b79-435f-adbf-74f9fe980528 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:49.325056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6146d5-9b79-435f-adbf-74f9fe980528 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:49.330708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59081d8d-ce9b-4ed9-83cb-c13cc9786dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:49.331398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59081d8d-ce9b-4ed9-83cb-c13cc9786dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.331684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59081d8d-ce9b-4ed9-83cb-c13cc9786dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.331965 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59081d8d-ce9b-4ed9-83cb-c13cc9786dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.332673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59081d8d-ce9b-4ed9-83cb-c13cc9786dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:49.334617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59081d8d-ce9b-4ed9-83cb-c13cc9786dd5 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:49.370153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1318/2641] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:14:49 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:14:49.375126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c5131-d8a9-444a-b12f-a8076d7bb306 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:49.388549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c5131-d8a9-444a-b12f-a8076d7bb306 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:49.448689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd2f67-22c1-4651-9fde-69368dc84c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:49.449376 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd2f67-22c1-4651-9fde-69368dc84c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.449660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd2f67-22c1-4651-9fde-69368dc84c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.449945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd2f67-22c1-4651-9fde-69368dc84c15 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.450631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd2f67-22c1-4651-9fde-69368dc84c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:49.452620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd2f67-22c1-4651-9fde-69368dc84c15 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:49.474569 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1324/2642] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:14:49 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:14:49.478691 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59081d8d-ce9b-4ed9-83cb-c13cc9786dd5 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:49.489551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59081d8d-ce9b-4ed9-83cb-c13cc9786dd5 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:49.494434 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d30f2-88d8-462e-b480-b6bc9e64a402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:49.495124 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d30f2-88d8-462e-b480-b6bc9e64a402 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.495409 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d30f2-88d8-462e-b480-b6bc9e64a402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.495684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d30f2-88d8-462e-b480-b6bc9e64a402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.496416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d30f2-88d8-462e-b480-b6bc9e64a402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:49.498046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d30f2-88d8-462e-b480-b6bc9e64a402 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:49.508945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1319/2643] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:14:49.513226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd2f67-22c1-4651-9fde-69368dc84c15 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:49.523734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd2f67-22c1-4651-9fde-69368dc84c15 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:49.528639 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5bf52-e302-4bce-b72e-d298e098ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:49.529529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5bf52-e302-4bce-b72e-d298e098ef6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.529807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5bf52-e302-4bce-b72e-d298e098ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.530082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5bf52-e302-4bce-b72e-d298e098ef6b admin admin] PATH_INFO: `/v3/projects/8fdcde8676e248b7b9d52e9dcc2578b0/users/fb6eae3b185f4cb083b7c18f32085091/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.545203 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5bf52-e302-4bce-b72e-d298e098ef6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdcde8676e248b7b9d52e9dcc2578b0, user_id=fb6eae3b185f4cb083b7c18f32085091, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:49.547926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5bf52-e302-4bce-b72e-d298e098ef6b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:49.562753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1325/2644] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:14:49 2022] PUT /identity/v3/projects/8fdcde8676e248b7b9d52e9dcc2578b0/users/fb6eae3b185f4cb083b7c18f32085091/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:49.567240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d30f2-88d8-462e-b480-b6bc9e64a402 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:49.577991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d30f2-88d8-462e-b480-b6bc9e64a402 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:49.612368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:49.645694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fad9b-a375-435a-99b4-5405edb80ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:49.646344 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fad9b-a375-435a-99b4-5405edb80ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.646623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fad9b-a375-435a-99b4-5405edb80ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.646899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fad9b-a375-435a-99b4-5405edb80ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.648004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fad9b-a375-435a-99b4-5405edb80ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:49.649600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fad9b-a375-435a-99b4-5405edb80ca1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:49.660663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1320/2645] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:14:49.666533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5bf52-e302-4bce-b72e-d298e098ef6b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:49.680481 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5bf52-e302-4bce-b72e-d298e098ef6b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:49.686141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2e5cb-409a-4e90-819e-1a1564030015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:49.687073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2e5cb-409a-4e90-819e-1a1564030015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.687359 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2e5cb-409a-4e90-819e-1a1564030015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.687632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2e5cb-409a-4e90-819e-1a1564030015 admin admin] PATH_INFO: `/v3/projects/8fdcde8676e248b7b9d52e9dcc2578b0/users/fb6eae3b185f4cb083b7c18f32085091/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.689849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2e5cb-409a-4e90-819e-1a1564030015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdcde8676e248b7b9d52e9dcc2578b0, user_id=fb6eae3b185f4cb083b7c18f32085091, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:49.692576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2e5cb-409a-4e90-819e-1a1564030015 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:49.703601 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1326/2646] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:14:49 2022] PUT /identity/v3/projects/8fdcde8676e248b7b9d52e9dcc2578b0/users/fb6eae3b185f4cb083b7c18f32085091/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:49.715112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca200c-11d0-4846-a3d7-840ee10aabe7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.715433 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca200c-11d0-4846-a3d7-840ee10aabe7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.715717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca200c-11d0-4846-a3d7-840ee10aabe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.741519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-bbca200c-11d0-4846-a3d7-840ee10aabe7 None None] MFA Rules not processed for user `fb6eae3b185f4cb083b7c18f32085091`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:49.742714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-bbca200c-11d0-4846-a3d7-840ee10aabe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:49.810356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1321/2647] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:49 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:14:49.827314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2e5cb-409a-4e90-819e-1a1564030015 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:49.831254 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-daf2e5cb-409a-4e90-819e-1a1564030015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:49.842252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:49.895396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2e5cb-409a-4e90-819e-1a1564030015 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:49.902369 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6ed4-8f8f-40dd-a3f0-f6fa7d29459b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:49.903396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6ed4-8f8f-40dd-a3f0-f6fa7d29459b service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:49.903701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6ed4-8f8f-40dd-a3f0-f6fa7d29459b service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:49.904063 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6ed4-8f8f-40dd-a3f0-f6fa7d29459b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:49.918955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e6ed4-8f8f-40dd-a3f0-f6fa7d29459b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:49.920536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e6ed4-8f8f-40dd-a3f0-f6fa7d29459b service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:49.931959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1327/2648] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:14:49 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:14:50.018356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca200c-11d0-4846-a3d7-840ee10aabe7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:50.029274 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca200c-11d0-4846-a3d7-840ee10aabe7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:50.033782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be0a1c-8e70-47df-b5cc-b6d60a6cc681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:50.034421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0a1c-8e70-47df-b5cc-b6d60a6cc681 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:50.034701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0a1c-8e70-47df-b5cc-b6d60a6cc681 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:50.034968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0a1c-8e70-47df-b5cc-b6d60a6cc681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:50.096271 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be0a1c-8e70-47df-b5cc-b6d60a6cc681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:50.097645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be0a1c-8e70-47df-b5cc-b6d60a6cc681 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:50.106890 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1322/2649] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:14:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:14:57.179867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6ed4-8f8f-40dd-a3f0-f6fa7d29459b service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:57.244012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6ed4-8f8f-40dd-a3f0-f6fa7d29459b service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:57.249277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:57.250210 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:57.250509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:57.250805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] PATH_INFO: `/v3/users/9306a1444ade4a72b07906bfc813999e` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:57.252029 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9306a1444ade4a72b07906bfc813999e)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:57.253956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:57.308886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9306a1444ade4a72b07906bfc813999e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:57.321598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9306a1444ade4a72b07906bfc813999e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:57.329783 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9306a1444ade4a72b07906bfc813999e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:57.337015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9306a1444ade4a72b07906bfc813999e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:57.338373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9306a1444ade4a72b07906bfc813999e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:57.345575 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1328/2650] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:14:57 2022] DELETE /identity/v3/users/9306a1444ade4a72b07906bfc813999e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:57.350972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919736e-75ef-4155-b2e0-dcea2b6950ac None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:57.352850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919736e-75ef-4155-b2e0-dcea2b6950ac None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:57.352850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919736e-75ef-4155-b2e0-dcea2b6950ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:57.373747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0919736e-75ef-4155-b2e0-dcea2b6950ac None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:57.375102 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0919736e-75ef-4155-b2e0-dcea2b6950ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:57.428991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:57.441834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1323/2651] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:57.452995 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:57.454596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:57.488832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:57.515655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf54b9-3546-4039-a83b-22df44657fe2 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:57.519383 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aabe43-5a27-43a5-a6f4-e909027a7633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:57.520035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aabe43-5a27-43a5-a6f4-e909027a7633 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:57.520317 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aabe43-5a27-43a5-a6f4-e909027a7633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:57.520595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aabe43-5a27-43a5-a6f4-e909027a7633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:57.530028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aabe43-5a27-43a5-a6f4-e909027a7633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:57.531553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aabe43-5a27-43a5-a6f4-e909027a7633 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:57.541067 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1329/2652] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:14:57.829915 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919736e-75ef-4155-b2e0-dcea2b6950ac None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:57.831396 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0919736e-75ef-4155-b2e0-dcea2b6950ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:57.843950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919736e-75ef-4155-b2e0-dcea2b6950ac None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:57.848917 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:57.849554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:57.849861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:57.850095 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] PATH_INFO: `/v3/projects/b51f8b956c2740a8acbd19df4e1867a6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:57.851348 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51f8b956c2740a8acbd19df4e1867a6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:57.853272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:57.901203 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51f8b956c2740a8acbd19df4e1867a6', 'request_id': 'req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:57.907266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51f8b956c2740a8acbd19df4e1867a6', 'request_id': 'req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:57.915621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51f8b956c2740a8acbd19df4e1867a6', 'request_id': 'req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:57.925563 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] The token cache is being invalidate because project b51f8b956c2740a8acbd19df4e1867a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:14:57.925848 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:57.926457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:57.928027 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1324/2653] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:14:57 2022] DELETE /identity/v3/projects/b51f8b956c2740a8acbd19df4e1867a6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:57.932120 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aabe43-5a27-43a5-a6f4-e909027a7633 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:57.941850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aabe43-5a27-43a5-a6f4-e909027a7633 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:58.004263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae2601-c609-4d09-8511-37d0751678a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:58.005132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2601-c609-4d09-8511-37d0751678a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:58.005408 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2601-c609-4d09-8511-37d0751678a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:58.005679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2601-c609-4d09-8511-37d0751678a9 admin admin] PATH_INFO: `/v3/users/fb6eae3b185f4cb083b7c18f32085091` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:58.006923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae2601-c609-4d09-8511-37d0751678a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6eae3b185f4cb083b7c18f32085091)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:58.008876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae2601-c609-4d09-8511-37d0751678a9 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:58.059753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f9ae2601-c609-4d09-8511-37d0751678a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6eae3b185f4cb083b7c18f32085091'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:58.072677 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f9ae2601-c609-4d09-8511-37d0751678a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6eae3b185f4cb083b7c18f32085091'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:58.081770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f9ae2601-c609-4d09-8511-37d0751678a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6eae3b185f4cb083b7c18f32085091'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:58.088915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f9ae2601-c609-4d09-8511-37d0751678a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6eae3b185f4cb083b7c18f32085091'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:58.089604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f9ae2601-c609-4d09-8511-37d0751678a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6eae3b185f4cb083b7c18f32085091'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:58.095586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1330/2654] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:14:57 2022] DELETE /identity/v3/users/fb6eae3b185f4cb083b7c18f32085091 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:58.371010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:58.372570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:58.386339 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bc98f-1db3-4c17-8cd6-8263cc4d4a87 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:58.446167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:58.447037 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:58.447353 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:58.447610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] PATH_INFO: `/v3/projects/8fdcde8676e248b7b9d52e9dcc2578b0` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:58.448875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fdcde8676e248b7b9d52e9dcc2578b0)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:58.450828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:58.501934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fdcde8676e248b7b9d52e9dcc2578b0', 'request_id': 'req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:58.508675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fdcde8676e248b7b9d52e9dcc2578b0', 'request_id': 'req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:58.517377 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fdcde8676e248b7b9d52e9dcc2578b0', 'request_id': 'req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:58.528769 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] The token cache is being invalidate because project 8fdcde8676e248b7b9d52e9dcc2578b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:14:58.529059 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:58.529692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0040eac0-68e0-4ff7-8542-6bd99eb99d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:14:58.531329 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1325/2655] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:14:58 2022] DELETE /identity/v3/projects/8fdcde8676e248b7b9d52e9dcc2578b0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:14:58.536420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613700-4a37-4a48-8832-b136e063c945 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:58.536925 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613700-4a37-4a48-8832-b136e063c945 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:58.537026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613700-4a37-4a48-8832-b136e063c945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:58.555000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-8e613700-4a37-4a48-8832-b136e063c945 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:58.556208 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-8e613700-4a37-4a48-8832-b136e063c945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:58.608714 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:58.626324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1331/2656] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:58.634129 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2f4a7-c583-4cc6-89ed-115ad220fa17 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:58.634416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2f4a7-c583-4cc6-89ed-115ad220fa17 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:58.634702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2f4a7-c583-4cc6-89ed-115ad220fa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:58.653451 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1ae2f4a7-c583-4cc6-89ed-115ad220fa17 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:58.654620 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1ae2f4a7-c583-4cc6-89ed-115ad220fa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:58.662496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1326/2657] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:58.666683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e613700-4a37-4a48-8832-b136e063c945 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:58.676774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e613700-4a37-4a48-8832-b136e063c945 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:58.682118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216d9c5-bc82-4c89-baa2-57fd5da793fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:58.682775 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216d9c5-bc82-4c89-baa2-57fd5da793fb admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:58.683108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216d9c5-bc82-4c89-baa2-57fd5da793fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:58.683389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216d9c5-bc82-4c89-baa2-57fd5da793fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:58.684122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216d9c5-bc82-4c89-baa2-57fd5da793fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:14:58.684432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216d9c5-bc82-4c89-baa2-57fd5da793fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:58.686047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216d9c5-bc82-4c89-baa2-57fd5da793fb admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:58.697811 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1332/2658] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:14:58.702163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2f4a7-c583-4cc6-89ed-115ad220fa17 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:58.706617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:58.712501 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2f4a7-c583-4cc6-89ed-115ad220fa17 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:58.718421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1489a-b184-43ef-a3cd-f1539dc8bdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:58.719121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1489a-b184-43ef-a3cd-f1539dc8bdc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:58.719600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1489a-b184-43ef-a3cd-f1539dc8bdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:58.720091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1489a-b184-43ef-a3cd-f1539dc8bdc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:58.720854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1489a-b184-43ef-a3cd-f1539dc8bdc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:58.723078 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1489a-b184-43ef-a3cd-f1539dc8bdc5 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:58.751110 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1327/2659] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:14:58 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:14:58.755291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216d9c5-bc82-4c89-baa2-57fd5da793fb admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:58.765706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216d9c5-bc82-4c89-baa2-57fd5da793fb admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:58.834039 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3312d8-e46f-4448-bbc4-6c37ab0cbaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:58.834743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3312d8-e46f-4448-bbc4-6c37ab0cbaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:58.835020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3312d8-e46f-4448-bbc4-6c37ab0cbaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:58.835339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3312d8-e46f-4448-bbc4-6c37ab0cbaf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:58.836013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3312d8-e46f-4448-bbc4-6c37ab0cbaf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:58.838032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3312d8-e46f-4448-bbc4-6c37ab0cbaf3 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:58.858884 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1333/2660] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:14:58 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:14:58.862978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1489a-b184-43ef-a3cd-f1539dc8bdc5 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:58.873713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1489a-b184-43ef-a3cd-f1539dc8bdc5 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:58.878727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432e7b-b661-46db-b0f9-25b03ae117d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:58.879420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432e7b-b661-46db-b0f9-25b03ae117d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:58.879830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432e7b-b661-46db-b0f9-25b03ae117d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:58.880159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432e7b-b661-46db-b0f9-25b03ae117d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:58.880894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4432e7b-b661-46db-b0f9-25b03ae117d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:58.882493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4432e7b-b661-46db-b0f9-25b03ae117d3 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:58.893018 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1328/2661] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:14:58.897339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3312d8-e46f-4448-bbc4-6c37ab0cbaf3 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:58.907346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3312d8-e46f-4448-bbc4-6c37ab0cbaf3 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:58.912358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424338e6-ed4d-42db-a2c2-9e0f0ce2066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:58.913017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424338e6-ed4d-42db-a2c2-9e0f0ce2066e admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:58.913297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424338e6-ed4d-42db-a2c2-9e0f0ce2066e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:58.913571 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424338e6-ed4d-42db-a2c2-9e0f0ce2066e admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:58.914279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424338e6-ed4d-42db-a2c2-9e0f0ce2066e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:58.915938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424338e6-ed4d-42db-a2c2-9e0f0ce2066e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:58.925879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1334/2662] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:14:58.930118 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432e7b-b661-46db-b0f9-25b03ae117d3 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:58.940075 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432e7b-b661-46db-b0f9-25b03ae117d3 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:58.944922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f20612-05cf-4f3e-917a-d8d04a9f3f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:58.945806 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20612-05cf-4f3e-917a-d8d04a9f3f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:58.946080 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20612-05cf-4f3e-917a-d8d04a9f3f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:58.946391 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20612-05cf-4f3e-917a-d8d04a9f3f60 admin admin] PATH_INFO: `/v3/projects/498494aebdde41349688373fc2d33244/users/c0715010350e49d58d44c84839d963b6/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:58.960919 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f20612-05cf-4f3e-917a-d8d04a9f3f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498494aebdde41349688373fc2d33244, user_id=c0715010350e49d58d44c84839d963b6, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:58.963585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f20612-05cf-4f3e-917a-d8d04a9f3f60 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:58.980224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1329/2663] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:14:58 2022] PUT /identity/v3/projects/498494aebdde41349688373fc2d33244/users/c0715010350e49d58d44c84839d963b6/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:58.991976 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa385-9baa-45a0-a674-b019a27921d6 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:58.992263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa385-9baa-45a0-a674-b019a27921d6 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:58.992540 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baa385-9baa-45a0-a674-b019a27921d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:59.021266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-58baa385-9baa-45a0-a674-b019a27921d6 None None] MFA Rules not processed for user `c0715010350e49d58d44c84839d963b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:59.022815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-58baa385-9baa-45a0-a674-b019a27921d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:59.090690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1335/2664] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:59.095630 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f20612-05cf-4f3e-917a-d8d04a9f3f60 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:59.162271 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f20612-05cf-4f3e-917a-d8d04a9f3f60 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:59.167336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea025a40-2c4f-42ca-bb3a-a6a5269648bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:59.168000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025a40-2c4f-42ca-bb3a-a6a5269648bf admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:59.168291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025a40-2c4f-42ca-bb3a-a6a5269648bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:59.168573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025a40-2c4f-42ca-bb3a-a6a5269648bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:59.169261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea025a40-2c4f-42ca-bb3a-a6a5269648bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:59.171289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea025a40-2c4f-42ca-bb3a-a6a5269648bf admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:59.199264 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1330/2665] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:14:59 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:14:59.203464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baa385-9baa-45a0-a674-b019a27921d6 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:59.214446 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baa385-9baa-45a0-a674-b019a27921d6 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:59.258545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:59.272226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cf767-3038-4d78-aa32-f58fb72f254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:59.273107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cf767-3038-4d78-aa32-f58fb72f254d admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:59.273563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cf767-3038-4d78-aa32-f58fb72f254d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:59.274028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cf767-3038-4d78-aa32-f58fb72f254d admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:59.275435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cf767-3038-4d78-aa32-f58fb72f254d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:59.278945 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cf767-3038-4d78-aa32-f58fb72f254d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:59.304121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1336/2666] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:14:59 2022] POST /identity/v3/users => generated 306 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:14:59.308456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea025a40-2c4f-42ca-bb3a-a6a5269648bf admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:59.320212 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea025a40-2c4f-42ca-bb3a-a6a5269648bf admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:59.325449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25984df8-50e1-4f62-b273-835e6643c649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:59.326126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25984df8-50e1-4f62-b273-835e6643c649 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:59.326409 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25984df8-50e1-4f62-b273-835e6643c649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:59.326692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25984df8-50e1-4f62-b273-835e6643c649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:59.327440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25984df8-50e1-4f62-b273-835e6643c649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:59.329055 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25984df8-50e1-4f62-b273-835e6643c649 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:59.340294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1331/2667] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:14:59.344426 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cf767-3038-4d78-aa32-f58fb72f254d admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:59.354704 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cf767-3038-4d78-aa32-f58fb72f254d admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:59.360409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120c694-3c92-4933-b141-25ec6e0fe830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:59.361293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120c694-3c92-4933-b141-25ec6e0fe830 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:59.361578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120c694-3c92-4933-b141-25ec6e0fe830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:59.361860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120c694-3c92-4933-b141-25ec6e0fe830 admin admin] PATH_INFO: `/v3/projects/82669cc7c19d41949dcd09e24cf942d3/users/0799b206239f4a029c7d5797e7516fed/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:59.377635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120c694-3c92-4933-b141-25ec6e0fe830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82669cc7c19d41949dcd09e24cf942d3, user_id=0799b206239f4a029c7d5797e7516fed, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:59.380356 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120c694-3c92-4933-b141-25ec6e0fe830 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:59.398035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1337/2668] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:14:59 2022] PUT /identity/v3/projects/82669cc7c19d41949dcd09e24cf942d3/users/0799b206239f4a029c7d5797e7516fed/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:59.402247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25984df8-50e1-4f62-b273-835e6643c649 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:59.412702 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25984df8-50e1-4f62-b273-835e6643c649 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:59.472483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ef95a-8790-4ce0-903d-5b855599ae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:59.473158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef95a-8790-4ce0-903d-5b855599ae8d admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:59.473443 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef95a-8790-4ce0-903d-5b855599ae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:59.473758 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef95a-8790-4ce0-903d-5b855599ae8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:59.474488 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ef95a-8790-4ce0-903d-5b855599ae8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:59.476149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ef95a-8790-4ce0-903d-5b855599ae8d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:59.487045 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1332/2669] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:14:59.491987 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120c694-3c92-4933-b141-25ec6e0fe830 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:59.503808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120c694-3c92-4933-b141-25ec6e0fe830 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:59.511863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056a66-edcb-4f0e-8a8e-751be7aeb6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:59.512770 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056a66-edcb-4f0e-8a8e-751be7aeb6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:59.513044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056a66-edcb-4f0e-8a8e-751be7aeb6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:59.513324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056a66-edcb-4f0e-8a8e-751be7aeb6dd admin admin] PATH_INFO: `/v3/projects/82669cc7c19d41949dcd09e24cf942d3/users/0799b206239f4a029c7d5797e7516fed/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:59.515503 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3056a66-edcb-4f0e-8a8e-751be7aeb6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=82669cc7c19d41949dcd09e24cf942d3, user_id=0799b206239f4a029c7d5797e7516fed, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:59.518170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3056a66-edcb-4f0e-8a8e-751be7aeb6dd admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:59.530217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1338/2670] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:14:59 2022] PUT /identity/v3/projects/82669cc7c19d41949dcd09e24cf942d3/users/0799b206239f4a029c7d5797e7516fed/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:14:59.540635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8556a64-e73d-4c9d-9d2c-2fd6968c4233 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:59.540925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8556a64-e73d-4c9d-9d2c-2fd6968c4233 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:59.541233 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8556a64-e73d-4c9d-9d2c-2fd6968c4233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:59.569916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f8556a64-e73d-4c9d-9d2c-2fd6968c4233 None None] MFA Rules not processed for user `0799b206239f4a029c7d5797e7516fed`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:14:59.571343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f8556a64-e73d-4c9d-9d2c-2fd6968c4233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:59.575699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:14:59.647760 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1333/2671] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:14:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:14:59.662574 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056a66-edcb-4f0e-8a8e-751be7aeb6dd admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:59.664380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a3056a66-edcb-4f0e-8a8e-751be7aeb6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:14:59.725060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056a66-edcb-4f0e-8a8e-751be7aeb6dd admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:59.729149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0b8bd-98a1-495d-82f4-90a92baeab79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:59.729797 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0b8bd-98a1-495d-82f4-90a92baeab79 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:59.730080 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0b8bd-98a1-495d-82f4-90a92baeab79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:59.730358 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0b8bd-98a1-495d-82f4-90a92baeab79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:59.739534 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0b8bd-98a1-495d-82f4-90a92baeab79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:59.740986 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0b8bd-98a1-495d-82f4-90a92baeab79 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:59.750329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1339/2672] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:14:59 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:14:59.826257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8556a64-e73d-4c9d-9d2c-2fd6968c4233 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:14:59.836771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8556a64-e73d-4c9d-9d2c-2fd6968c4233 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:14:59.841174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf51055-c9ee-4229-b7ae-f7e3c321950e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:14:59.841817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf51055-c9ee-4229-b7ae-f7e3c321950e service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:14:59.842098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf51055-c9ee-4229-b7ae-f7e3c321950e service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:14:59.842365 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf51055-c9ee-4229-b7ae-f7e3c321950e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:14:59.901433 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf51055-c9ee-4229-b7ae-f7e3c321950e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:14:59.902875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf51055-c9ee-4229-b7ae-f7e3c321950e service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:14:59.911899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1334/2673] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:14:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:15:04.035577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0b8bd-98a1-495d-82f4-90a92baeab79 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:04.099854 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0b8bd-98a1-495d-82f4-90a92baeab79 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:04.105341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:04.106215 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:04.106496 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:04.106768 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] PATH_INFO: `/v3/users/c0715010350e49d58d44c84839d963b6` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:04.107968 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0715010350e49d58d44c84839d963b6)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:04.109967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:04.156561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:04.159534 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0715010350e49d58d44c84839d963b6'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.172361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0715010350e49d58d44c84839d963b6'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.180647 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0715010350e49d58d44c84839d963b6'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.187406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0715010350e49d58d44c84839d963b6'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.188020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0715010350e49d58d44c84839d963b6'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.193856 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1340/2674] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:15:04 2022] DELETE /identity/v3/users/c0715010350e49d58d44c84839d963b6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:04.198655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aa632-765c-41b5-ac8d-e55268b9f658 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:04.199172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aa632-765c-41b5-ac8d-e55268b9f658 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:04.199287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aa632-765c-41b5-ac8d-e55268b9f658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:04.220477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-374aa632-765c-41b5-ac8d-e55268b9f658 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:04.221671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-374aa632-765c-41b5-ac8d-e55268b9f658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:04.282761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1335/2675] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:15:04.292584 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:04.294090 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:04.353305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315ec7f-7980-46b5-9831-dd8afddf966d admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:04.357702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f651e-c6e4-48fd-97e3-9a3b1951aea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:04.358346 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f651e-c6e4-48fd-97e3-9a3b1951aea7 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:04.358628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f651e-c6e4-48fd-97e3-9a3b1951aea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:04.358908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f651e-c6e4-48fd-97e3-9a3b1951aea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:04.368378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f651e-c6e4-48fd-97e3-9a3b1951aea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:04.369804 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f651e-c6e4-48fd-97e3-9a3b1951aea7 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:04.379552 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1341/2676] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:15:04.670502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374aa632-765c-41b5-ac8d-e55268b9f658 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:04.672195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-374aa632-765c-41b5-ac8d-e55268b9f658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:04.684710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374aa632-765c-41b5-ac8d-e55268b9f658 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:04.689940 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:04.690823 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:04.691249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:04.691532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] PATH_INFO: `/v3/projects/498494aebdde41349688373fc2d33244` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:04.692742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498494aebdde41349688373fc2d33244)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:04.694673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:04.733542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:04.744153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498494aebdde41349688373fc2d33244', 'request_id': 'req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.750252 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498494aebdde41349688373fc2d33244', 'request_id': 'req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.759396 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498494aebdde41349688373fc2d33244', 'request_id': 'req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.772647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] The token cache is being invalidate because project 498494aebdde41349688373fc2d33244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:15:04.772921 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.773667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.775498 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1336/2677] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:15:04 2022] DELETE /identity/v3/projects/498494aebdde41349688373fc2d33244 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:04.782731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f651e-c6e4-48fd-97e3-9a3b1951aea7 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:04.793365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f651e-c6e4-48fd-97e3-9a3b1951aea7 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:04.856755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cca51-d013-46d4-a5b6-e52708a0eab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:04.857736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cca51-d013-46d4-a5b6-e52708a0eab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:04.858014 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cca51-d013-46d4-a5b6-e52708a0eab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:04.858293 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cca51-d013-46d4-a5b6-e52708a0eab4 admin admin] PATH_INFO: `/v3/users/0799b206239f4a029c7d5797e7516fed` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:04.859631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cca51-d013-46d4-a5b6-e52708a0eab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0799b206239f4a029c7d5797e7516fed)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:04.861594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cca51-d013-46d4-a5b6-e52708a0eab4 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:04.913432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c39cca51-d013-46d4-a5b6-e52708a0eab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0799b206239f4a029c7d5797e7516fed'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.926035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c39cca51-d013-46d4-a5b6-e52708a0eab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0799b206239f4a029c7d5797e7516fed'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.927713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:04.935359 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c39cca51-d013-46d4-a5b6-e52708a0eab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0799b206239f4a029c7d5797e7516fed'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.943664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c39cca51-d013-46d4-a5b6-e52708a0eab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0799b206239f4a029c7d5797e7516fed'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.944342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-c39cca51-d013-46d4-a5b6-e52708a0eab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0799b206239f4a029c7d5797e7516fed'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:04.950674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1342/2678] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:15:04 2022] DELETE /identity/v3/users/0799b206239f4a029c7d5797e7516fed => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:05.239760 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:05.241308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:05.255416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c04c0-20aa-4d87-8977-f736c9c02fa4 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:05.323822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:05.324699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:05.324984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:05.325266 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] PATH_INFO: `/v3/projects/82669cc7c19d41949dcd09e24cf942d3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:05.326551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82669cc7c19d41949dcd09e24cf942d3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:05.328584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:05.379861 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82669cc7c19d41949dcd09e24cf942d3', 'request_id': 'req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:05.387152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82669cc7c19d41949dcd09e24cf942d3', 'request_id': 'req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:05.398122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82669cc7c19d41949dcd09e24cf942d3', 'request_id': 'req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:05.409204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] The token cache is being invalidate because project 82669cc7c19d41949dcd09e24cf942d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:15:05.409490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:05.410105 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d4381ca2-c6cc-4f7d-91b4-d0382a086dd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:05.411721 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1337/2679] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:15:05 2022] DELETE /identity/v3/projects/82669cc7c19d41949dcd09e24cf942d3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:05.416881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae945b4-bf85-4743-8024-9b82ce709959 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:05.417479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae945b4-bf85-4743-8024-9b82ce709959 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:05.418914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae945b4-bf85-4743-8024-9b82ce709959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:05.441434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6ae945b4-bf85-4743-8024-9b82ce709959 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:05.442546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6ae945b4-bf85-4743-8024-9b82ce709959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:05.511031 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1343/2680] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:05.519530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fda5f-2b95-4d7e-9931-16477bb08e16 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:05.519892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fda5f-2b95-4d7e-9931-16477bb08e16 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:05.520478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fda5f-2b95-4d7e-9931-16477bb08e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:05.541139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e91fda5f-2b95-4d7e-9931-16477bb08e16 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:05.542350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e91fda5f-2b95-4d7e-9931-16477bb08e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:05.551034 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1338/2681] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:05.555609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae945b4-bf85-4743-8024-9b82ce709959 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:05.566132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae945b4-bf85-4743-8024-9b82ce709959 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:05.572666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1fd5c-7446-4bf3-81cb-cbae167c9e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:05.573330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1fd5c-7446-4bf3-81cb-cbae167c9e27 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:05.573612 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1fd5c-7446-4bf3-81cb-cbae167c9e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:05.573882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1fd5c-7446-4bf3-81cb-cbae167c9e27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:05.574609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1fd5c-7446-4bf3-81cb-cbae167c9e27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:15:05.574911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1fd5c-7446-4bf3-81cb-cbae167c9e27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:05.576561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1fd5c-7446-4bf3-81cb-cbae167c9e27 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:05.588624 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1344/2682] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:15:05.593150 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fda5f-2b95-4d7e-9931-16477bb08e16 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:05.606665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fda5f-2b95-4d7e-9931-16477bb08e16 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:05.615564 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fece9fb-6593-4bee-9d03-7f5d08f44578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:05.616464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fece9fb-6593-4bee-9d03-7f5d08f44578 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:05.616934 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fece9fb-6593-4bee-9d03-7f5d08f44578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:05.617369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fece9fb-6593-4bee-9d03-7f5d08f44578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:05.618388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fece9fb-6593-4bee-9d03-7f5d08f44578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:05.620572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fece9fb-6593-4bee-9d03-7f5d08f44578 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:05.651387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1339/2683] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:15:05 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:15:05.655706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1fd5c-7446-4bf3-81cb-cbae167c9e27 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:05.666462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1fd5c-7446-4bf3-81cb-cbae167c9e27 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:05.725336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0a7eb-898c-4ce9-95e8-a6505c4351f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:05.725941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0a7eb-898c-4ce9-95e8-a6505c4351f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:05.726222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0a7eb-898c-4ce9-95e8-a6505c4351f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:05.726498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0a7eb-898c-4ce9-95e8-a6505c4351f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:05.727209 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0a7eb-898c-4ce9-95e8-a6505c4351f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:05.729241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0a7eb-898c-4ce9-95e8-a6505c4351f7 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:05.751046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1345/2684] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:15:05 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:15:05.755214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fece9fb-6593-4bee-9d03-7f5d08f44578 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:05.766263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fece9fb-6593-4bee-9d03-7f5d08f44578 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:05.774747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfe57c-4384-44db-bcd5-fa7b15c3f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:05.775563 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfe57c-4384-44db-bcd5-fa7b15c3f146 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:05.775840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfe57c-4384-44db-bcd5-fa7b15c3f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:05.776112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfe57c-4384-44db-bcd5-fa7b15c3f146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:05.776867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfe57c-4384-44db-bcd5-fa7b15c3f146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:05.778536 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfe57c-4384-44db-bcd5-fa7b15c3f146 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:05.791835 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1340/2685] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:15:05.797036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0a7eb-898c-4ce9-95e8-a6505c4351f7 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:05.812275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0a7eb-898c-4ce9-95e8-a6505c4351f7 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:05.818722 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46bbbd-a4ee-48df-809c-7788612d866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:05.819429 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46bbbd-a4ee-48df-809c-7788612d866a admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:05.819709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46bbbd-a4ee-48df-809c-7788612d866a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:05.819983 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46bbbd-a4ee-48df-809c-7788612d866a admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:05.820742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46bbbd-a4ee-48df-809c-7788612d866a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:05.822631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46bbbd-a4ee-48df-809c-7788612d866a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:05.833373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1346/2686] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:15:05.837716 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfe57c-4384-44db-bcd5-fa7b15c3f146 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:05.848093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfe57c-4384-44db-bcd5-fa7b15c3f146 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:05.853239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b4512-f0ac-475e-9d0a-072eca092741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:05.854134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4512-f0ac-475e-9d0a-072eca092741 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:05.854415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4512-f0ac-475e-9d0a-072eca092741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:05.854693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4512-f0ac-475e-9d0a-072eca092741 admin admin] PATH_INFO: `/v3/projects/56bcb33da9b747d5885ef000af57b839/users/8e231d938366462cb11c0d1e21402a00/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:05.865780 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:05.870662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b4512-f0ac-475e-9d0a-072eca092741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bcb33da9b747d5885ef000af57b839, user_id=8e231d938366462cb11c0d1e21402a00, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:05.873670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b4512-f0ac-475e-9d0a-072eca092741 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:05.888805 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1341/2687] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:15:05 2022] PUT /identity/v3/projects/56bcb33da9b747d5885ef000af57b839/users/8e231d938366462cb11c0d1e21402a00/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:05.900688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd30ed-d6b2-4396-9bee-69bdcfeba791 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:05.900983 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd30ed-d6b2-4396-9bee-69bdcfeba791 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:05.901265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd30ed-d6b2-4396-9bee-69bdcfeba791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:05.928877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-e0fd30ed-d6b2-4396-9bee-69bdcfeba791 None None] MFA Rules not processed for user `8e231d938366462cb11c0d1e21402a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:05.930085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e0fd30ed-d6b2-4396-9bee-69bdcfeba791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:05.967470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:05.997077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1347/2688] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:06.003122 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b4512-f0ac-475e-9d0a-072eca092741 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:06.069705 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b4512-f0ac-475e-9d0a-072eca092741 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:06.075179 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08e576-7789-4e54-865c-c7d70d0b0a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:06.075849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e576-7789-4e54-865c-c7d70d0b0a53 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:06.076126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e576-7789-4e54-865c-c7d70d0b0a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:06.076404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e576-7789-4e54-865c-c7d70d0b0a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:06.077078 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08e576-7789-4e54-865c-c7d70d0b0a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:06.079014 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08e576-7789-4e54-865c-c7d70d0b0a53 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:06.106298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1342/2689] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:15:06 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:15:06.110386 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd30ed-d6b2-4396-9bee-69bdcfeba791 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:06.121635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd30ed-d6b2-4396-9bee-69bdcfeba791 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:06.177169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18c778-1e6e-4b3d-b24b-01e7c6521005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:06.177865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c778-1e6e-4b3d-b24b-01e7c6521005 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:06.178147 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c778-1e6e-4b3d-b24b-01e7c6521005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:06.178424 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c778-1e6e-4b3d-b24b-01e7c6521005 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:06.179139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18c778-1e6e-4b3d-b24b-01e7c6521005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:06.181201 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18c778-1e6e-4b3d-b24b-01e7c6521005 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:06.204774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1348/2690] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:15:06 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:15:06.208939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08e576-7789-4e54-865c-c7d70d0b0a53 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:06.219453 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08e576-7789-4e54-865c-c7d70d0b0a53 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:06.229844 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc784f91-ab62-480e-aab6-e12475001a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:06.230514 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc784f91-ab62-480e-aab6-e12475001a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:06.230794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc784f91-ab62-480e-aab6-e12475001a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:06.231098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc784f91-ab62-480e-aab6-e12475001a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:06.231832 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc784f91-ab62-480e-aab6-e12475001a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:06.233449 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc784f91-ab62-480e-aab6-e12475001a8a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:06.244463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1343/2691] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:15:06.248994 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18c778-1e6e-4b3d-b24b-01e7c6521005 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:06.259636 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18c778-1e6e-4b3d-b24b-01e7c6521005 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:06.264737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b1c76-5d98-4349-a19d-563e4b15c158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:06.265686 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b1c76-5d98-4349-a19d-563e4b15c158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:06.265971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b1c76-5d98-4349-a19d-563e4b15c158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:06.266241 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b1c76-5d98-4349-a19d-563e4b15c158 admin admin] PATH_INFO: `/v3/projects/7d05dd34842e4f5980f4de119b29d608/users/e4d1bcdac61e41c0969232234a30e811/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:06.282760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b1c76-5d98-4349-a19d-563e4b15c158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d05dd34842e4f5980f4de119b29d608, user_id=e4d1bcdac61e41c0969232234a30e811, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:06.285462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b1c76-5d98-4349-a19d-563e4b15c158 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:06.300493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1349/2692] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:15:06 2022] PUT /identity/v3/projects/7d05dd34842e4f5980f4de119b29d608/users/e4d1bcdac61e41c0969232234a30e811/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:06.304648 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc784f91-ab62-480e-aab6-e12475001a8a admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:06.314683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc784f91-ab62-480e-aab6-e12475001a8a admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:06.372607 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62026c5-e12a-4987-a20e-cb91cdf3e131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:06.373280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62026c5-e12a-4987-a20e-cb91cdf3e131 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:06.373570 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62026c5-e12a-4987-a20e-cb91cdf3e131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:06.373892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62026c5-e12a-4987-a20e-cb91cdf3e131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:06.374622 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62026c5-e12a-4987-a20e-cb91cdf3e131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:06.376284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62026c5-e12a-4987-a20e-cb91cdf3e131 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:06.387587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1344/2693] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:15:06.392118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b1c76-5d98-4349-a19d-563e4b15c158 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:06.403219 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b1c76-5d98-4349-a19d-563e4b15c158 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:06.408444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7512b31-8330-4e9f-a68d-34d7482e1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:06.409342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7512b31-8330-4e9f-a68d-34d7482e1cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:06.409625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7512b31-8330-4e9f-a68d-34d7482e1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:06.409933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7512b31-8330-4e9f-a68d-34d7482e1cbe admin admin] PATH_INFO: `/v3/projects/7d05dd34842e4f5980f4de119b29d608/users/e4d1bcdac61e41c0969232234a30e811/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:06.412174 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7512b31-8330-4e9f-a68d-34d7482e1cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d05dd34842e4f5980f4de119b29d608, user_id=e4d1bcdac61e41c0969232234a30e811, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:06.414837 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7512b31-8330-4e9f-a68d-34d7482e1cbe admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:06.425328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1350/2694] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:15:06 2022] PUT /identity/v3/projects/7d05dd34842e4f5980f4de119b29d608/users/e4d1bcdac61e41c0969232234a30e811/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:15:06.435911 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7838198-1cd5-4e28-9748-174f252aaaec None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:06.436220 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7838198-1cd5-4e28-9748-174f252aaaec None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:06.436489 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7838198-1cd5-4e28-9748-174f252aaaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:06.464100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f7838198-1cd5-4e28-9748-174f252aaaec None None] MFA Rules not processed for user `e4d1bcdac61e41c0969232234a30e811`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:06.465340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f7838198-1cd5-4e28-9748-174f252aaaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:06.520996 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:06.543924 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1345/2695] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:06.555432 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7512b31-8330-4e9f-a68d-34d7482e1cbe admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:06.557545 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-f7512b31-8330-4e9f-a68d-34d7482e1cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:06.616629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7512b31-8330-4e9f-a68d-34d7482e1cbe admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:06.620766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391eb31-a3ee-47ef-b518-2a4fe1e72589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:06.621427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391eb31-a3ee-47ef-b518-2a4fe1e72589 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:06.621703 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391eb31-a3ee-47ef-b518-2a4fe1e72589 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:06.622008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391eb31-a3ee-47ef-b518-2a4fe1e72589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:06.632190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391eb31-a3ee-47ef-b518-2a4fe1e72589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:06.633663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391eb31-a3ee-47ef-b518-2a4fe1e72589 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:06.644107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1351/2696] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:15:07.002592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7838198-1cd5-4e28-9748-174f252aaaec None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:07.067487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7838198-1cd5-4e28-9748-174f252aaaec None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:07.072302 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:07.073184 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:07.073469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:07.073747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] PATH_INFO: `/v3/users/8e231d938366462cb11c0d1e21402a00` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:07.074964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e231d938366462cb11c0d1e21402a00)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:07.076927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:07.131159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e231d938366462cb11c0d1e21402a00'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.143849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e231d938366462cb11c0d1e21402a00'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.144530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e231d938366462cb11c0d1e21402a00'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.152287 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e231d938366462cb11c0d1e21402a00'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.152979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e231d938366462cb11c0d1e21402a00'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.167617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1346/2697] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:15:07 2022] DELETE /identity/v3/users/8e231d938366462cb11c0d1e21402a00 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:07.172298 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cad6d-ebd0-46e3-b240-34af5613408d None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:07.172583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cad6d-ebd0-46e3-b240-34af5613408d None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:07.172860 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cad6d-ebd0-46e3-b240-34af5613408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:07.190495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-543cad6d-ebd0-46e3-b240-34af5613408d None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:07.191703 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-543cad6d-ebd0-46e3-b240-34af5613408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:07.220075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:07.251689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1352/2698] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:15:07.261562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:07.262979 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:07.324481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e78d1f-f49d-41df-bafa-073b9e7aeef4 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:07.328552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878bce-11fb-4918-85d5-71500dcb0214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:07.329194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878bce-11fb-4918-85d5-71500dcb0214 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:07.329474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878bce-11fb-4918-85d5-71500dcb0214 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:07.329750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878bce-11fb-4918-85d5-71500dcb0214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:07.339355 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe878bce-11fb-4918-85d5-71500dcb0214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:07.340798 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe878bce-11fb-4918-85d5-71500dcb0214 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:07.352008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1347/2699] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:15:07.636166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cad6d-ebd0-46e3-b240-34af5613408d None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:07.637576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-543cad6d-ebd0-46e3-b240-34af5613408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:07.653868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cad6d-ebd0-46e3-b240-34af5613408d None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:07.659317 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:07.660150 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:07.660435 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:07.660738 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] PATH_INFO: `/v3/projects/56bcb33da9b747d5885ef000af57b839` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:07.661999 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] RBAC: Authorizing `identity:delete_project(project_id=56bcb33da9b747d5885ef000af57b839)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:07.664040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:07.711764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56bcb33da9b747d5885ef000af57b839', 'request_id': 'req-718c3d5c-1bb8-437f-a588-3c349d94970b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.717936 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56bcb33da9b747d5885ef000af57b839', 'request_id': 'req-718c3d5c-1bb8-437f-a588-3c349d94970b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.726513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56bcb33da9b747d5885ef000af57b839', 'request_id': 'req-718c3d5c-1bb8-437f-a588-3c349d94970b'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.736873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] The token cache is being invalidate because project 56bcb33da9b747d5885ef000af57b839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:15:07.737163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.737866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.739563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1353/2700] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:15:07 2022] DELETE /identity/v3/projects/56bcb33da9b747d5885ef000af57b839 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:07.743904 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878bce-11fb-4918-85d5-71500dcb0214 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:07.753760 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878bce-11fb-4918-85d5-71500dcb0214 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:07.757817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:07.816239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012db841-f178-43c6-9990-f7422cfaba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:07.817146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012db841-f178-43c6-9990-f7422cfaba8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:07.817429 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012db841-f178-43c6-9990-f7422cfaba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:07.817708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012db841-f178-43c6-9990-f7422cfaba8d admin admin] PATH_INFO: `/v3/users/e4d1bcdac61e41c0969232234a30e811` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:07.819126 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012db841-f178-43c6-9990-f7422cfaba8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d1bcdac61e41c0969232234a30e811)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:07.821115 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012db841-f178-43c6-9990-f7422cfaba8d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:07.868710 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-012db841-f178-43c6-9990-f7422cfaba8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d1bcdac61e41c0969232234a30e811'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.880953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-012db841-f178-43c6-9990-f7422cfaba8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d1bcdac61e41c0969232234a30e811'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.881628 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-012db841-f178-43c6-9990-f7422cfaba8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d1bcdac61e41c0969232234a30e811'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.888768 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-012db841-f178-43c6-9990-f7422cfaba8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d1bcdac61e41c0969232234a30e811'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.889372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-012db841-f178-43c6-9990-f7422cfaba8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d1bcdac61e41c0969232234a30e811'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:07.904217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1348/2701] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:15:07 2022] DELETE /identity/v3/users/e4d1bcdac61e41c0969232234a30e811 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:15:08.187829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:08.189372 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:08.205474 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c3d5c-1bb8-437f-a588-3c349d94970b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:08.266602 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:08.268420 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:08.269028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:08.269638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] PATH_INFO: `/v3/projects/7d05dd34842e4f5980f4de119b29d608` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:08.271092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d05dd34842e4f5980f4de119b29d608)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:08.273378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:08.322917 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d05dd34842e4f5980f4de119b29d608', 'request_id': 'req-0e7ff058-6db5-424d-8911-5b206df946e9'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:08.330044 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d05dd34842e4f5980f4de119b29d608', 'request_id': 'req-0e7ff058-6db5-424d-8911-5b206df946e9'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:08.333643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:08.340075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d05dd34842e4f5980f4de119b29d608', 'request_id': 'req-0e7ff058-6db5-424d-8911-5b206df946e9'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:08.354865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] The token cache is being invalidate because project 7d05dd34842e4f5980f4de119b29d608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:15:08.355190 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:08.355839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-0e7ff058-6db5-424d-8911-5b206df946e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:08.357689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1354/2702] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:15:08 2022] DELETE /identity/v3/projects/7d05dd34842e4f5980f4de119b29d608 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:08.362332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf574c60-1cc7-4f36-8474-08d08ffbc131 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:08.362838 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf574c60-1cc7-4f36-8474-08d08ffbc131 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:08.362927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf574c60-1cc7-4f36-8474-08d08ffbc131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:08.381180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-cf574c60-1cc7-4f36-8474-08d08ffbc131 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:08.382322 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cf574c60-1cc7-4f36-8474-08d08ffbc131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:08.442174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1349/2703] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:08.450261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05eb9a-e783-45f7-b99c-e7fd724efb6a None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:08.451385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05eb9a-e783-45f7-b99c-e7fd724efb6a None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:08.451700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05eb9a-e783-45f7-b99c-e7fd724efb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:08.470387 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-4d05eb9a-e783-45f7-b99c-e7fd724efb6a None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:08.471605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4d05eb9a-e783-45f7-b99c-e7fd724efb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:08.480867 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1355/2704] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:08.484888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf574c60-1cc7-4f36-8474-08d08ffbc131 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:08.495410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf574c60-1cc7-4f36-8474-08d08ffbc131 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:08.500415 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f4a77-4542-4567-9a47-b63a588a6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:08.501095 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f4a77-4542-4567-9a47-b63a588a6745 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:08.501378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f4a77-4542-4567-9a47-b63a588a6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:08.501655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f4a77-4542-4567-9a47-b63a588a6745 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:08.502420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f4a77-4542-4567-9a47-b63a588a6745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:15:08.502728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f4a77-4542-4567-9a47-b63a588a6745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:08.504392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f4a77-4542-4567-9a47-b63a588a6745 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:08.516537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1350/2705] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:15:08.521851 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05eb9a-e783-45f7-b99c-e7fd724efb6a None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:08.532909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05eb9a-e783-45f7-b99c-e7fd724efb6a None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:08.538180 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c56d-090b-4f0e-9408-52ed4d995838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:08.538841 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c56d-090b-4f0e-9408-52ed4d995838 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:08.539162 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c56d-090b-4f0e-9408-52ed4d995838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:08.539442 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c56d-090b-4f0e-9408-52ed4d995838 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:08.540142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22c56d-090b-4f0e-9408-52ed4d995838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:08.542075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22c56d-090b-4f0e-9408-52ed4d995838 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:08.569701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1356/2706] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:15:08 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:15:08.574046 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f4a77-4542-4567-9a47-b63a588a6745 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:08.584816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f4a77-4542-4567-9a47-b63a588a6745 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:08.593867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:08.645288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db2b87-da15-41bd-89a5-cf23ff5e1940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:08.645928 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db2b87-da15-41bd-89a5-cf23ff5e1940 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:08.646219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db2b87-da15-41bd-89a5-cf23ff5e1940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:08.646856 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db2b87-da15-41bd-89a5-cf23ff5e1940 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:08.647588 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db2b87-da15-41bd-89a5-cf23ff5e1940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:08.649754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db2b87-da15-41bd-89a5-cf23ff5e1940 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:08.671542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1351/2707] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:15:08 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:15:08.675734 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c56d-090b-4f0e-9408-52ed4d995838 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:08.686182 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c56d-090b-4f0e-9408-52ed4d995838 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:08.690918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbd128-ba5d-408a-acfc-ee97efcb3a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:08.691609 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbd128-ba5d-408a-acfc-ee97efcb3a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:08.691893 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbd128-ba5d-408a-acfc-ee97efcb3a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:08.692168 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbd128-ba5d-408a-acfc-ee97efcb3a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:08.692904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbd128-ba5d-408a-acfc-ee97efcb3a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:08.694525 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbd128-ba5d-408a-acfc-ee97efcb3a98 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:08.705033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1357/2708] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:15:08.709163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db2b87-da15-41bd-89a5-cf23ff5e1940 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:08.719717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db2b87-da15-41bd-89a5-cf23ff5e1940 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:08.725527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cac168-6d88-4fae-87d4-6af07352dee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:08.726185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cac168-6d88-4fae-87d4-6af07352dee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:08.726463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cac168-6d88-4fae-87d4-6af07352dee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:08.726733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cac168-6d88-4fae-87d4-6af07352dee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:08.727506 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cac168-6d88-4fae-87d4-6af07352dee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:08.729152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cac168-6d88-4fae-87d4-6af07352dee1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:08.739522 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1352/2709] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:15:08.744104 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbd128-ba5d-408a-acfc-ee97efcb3a98 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:08.754187 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbd128-ba5d-408a-acfc-ee97efcb3a98 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:08.759005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ae81f-a9ab-4cdd-8346-2828085e7508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:08.759908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ae81f-a9ab-4cdd-8346-2828085e7508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:08.760191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ae81f-a9ab-4cdd-8346-2828085e7508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:08.760473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ae81f-a9ab-4cdd-8346-2828085e7508 admin admin] PATH_INFO: `/v3/projects/ce8ecf9b2f204fbc93c072f7d6e734b2/users/227c3652bf1c49229fe7a3712ed689e8/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:08.775450 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ae81f-a9ab-4cdd-8346-2828085e7508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8ecf9b2f204fbc93c072f7d6e734b2, user_id=227c3652bf1c49229fe7a3712ed689e8, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:08.778121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ae81f-a9ab-4cdd-8346-2828085e7508 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:08.792449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1358/2710] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:15:08 2022] PUT /identity/v3/projects/ce8ecf9b2f204fbc93c072f7d6e734b2/users/227c3652bf1c49229fe7a3712ed689e8/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:08.804452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dd466-23ce-4a2b-b44b-562901fad365 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:08.804830 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dd466-23ce-4a2b-b44b-562901fad365 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:08.805183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dd466-23ce-4a2b-b44b-562901fad365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:08.837404 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ee2dd466-23ce-4a2b-b44b-562901fad365 None None] MFA Rules not processed for user `227c3652bf1c49229fe7a3712ed689e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:08.838586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ee2dd466-23ce-4a2b-b44b-562901fad365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:08.903385 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1353/2711] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:08.908022 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ae81f-a9ab-4cdd-8346-2828085e7508 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:08.970123 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ae81f-a9ab-4cdd-8346-2828085e7508 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:08.975707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0885b-3159-4ac0-adb6-1cd270a2e596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:08.976355 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0885b-3159-4ac0-adb6-1cd270a2e596 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:08.976631 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0885b-3159-4ac0-adb6-1cd270a2e596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:08.976903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0885b-3159-4ac0-adb6-1cd270a2e596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:08.977588 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0885b-3159-4ac0-adb6-1cd270a2e596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:08.979597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0885b-3159-4ac0-adb6-1cd270a2e596 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:09.006840 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1359/2712] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:15:08 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:15:09.011461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dd466-23ce-4a2b-b44b-562901fad365 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:09.027593 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dd466-23ce-4a2b-b44b-562901fad365 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:09.086537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c735a8c-7a38-4c27-9a2d-c09e41eba791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:09.087385 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735a8c-7a38-4c27-9a2d-c09e41eba791 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:09.087666 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735a8c-7a38-4c27-9a2d-c09e41eba791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:09.087941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735a8c-7a38-4c27-9a2d-c09e41eba791 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:09.088645 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c735a8c-7a38-4c27-9a2d-c09e41eba791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:09.090672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c735a8c-7a38-4c27-9a2d-c09e41eba791 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:09.111941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1354/2713] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:15:09 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:15:09.116216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0885b-3159-4ac0-adb6-1cd270a2e596 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:09.126808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0885b-3159-4ac0-adb6-1cd270a2e596 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:09.131782 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ce1c-f414-49c7-a381-19e26134f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:09.132437 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ce1c-f414-49c7-a381-19e26134f065 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:09.132716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ce1c-f414-49c7-a381-19e26134f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:09.132991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ce1c-f414-49c7-a381-19e26134f065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:09.133839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17ce1c-f414-49c7-a381-19e26134f065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:09.135487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17ce1c-f414-49c7-a381-19e26134f065 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:09.146026 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1360/2714] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:15:09.150711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c735a8c-7a38-4c27-9a2d-c09e41eba791 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:09.161763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c735a8c-7a38-4c27-9a2d-c09e41eba791 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:09.167684 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3d0b7-4b52-445a-aba8-7ab875913405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:09.168606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3d0b7-4b52-445a-aba8-7ab875913405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:09.168883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3d0b7-4b52-445a-aba8-7ab875913405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:09.169156 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3d0b7-4b52-445a-aba8-7ab875913405 admin admin] PATH_INFO: `/v3/projects/29131f77664847959c2afa09e8e953a6/users/cfdb5cbee7e044fc9b50d93419fd788d/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:09.178164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:09.186733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3d0b7-4b52-445a-aba8-7ab875913405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29131f77664847959c2afa09e8e953a6, user_id=cfdb5cbee7e044fc9b50d93419fd788d, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:09.189704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3d0b7-4b52-445a-aba8-7ab875913405 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:09.204372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1355/2715] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:15:09 2022] PUT /identity/v3/projects/29131f77664847959c2afa09e8e953a6/users/cfdb5cbee7e044fc9b50d93419fd788d/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:15:09.208413 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ce1c-f414-49c7-a381-19e26134f065 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:09.218674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ce1c-f414-49c7-a381-19e26134f065 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:09.272410 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:09.279434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53792c2-b3f4-4ab8-9df4-320dc34c6d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:09.280093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53792c2-b3f4-4ab8-9df4-320dc34c6d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:09.280570 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53792c2-b3f4-4ab8-9df4-320dc34c6d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:09.281018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53792c2-b3f4-4ab8-9df4-320dc34c6d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:09.282192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53792c2-b3f4-4ab8-9df4-320dc34c6d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:09.283876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53792c2-b3f4-4ab8-9df4-320dc34c6d08 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:09.294222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1361/2716] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:15:09.298956 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3d0b7-4b52-445a-aba8-7ab875913405 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:09.310567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3d0b7-4b52-445a-aba8-7ab875913405 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:09.316554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78a56-a42a-4e60-8bd6-1f570bd5506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:09.317455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78a56-a42a-4e60-8bd6-1f570bd5506d admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:09.317735 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78a56-a42a-4e60-8bd6-1f570bd5506d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:09.318012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78a56-a42a-4e60-8bd6-1f570bd5506d admin admin] PATH_INFO: `/v3/projects/29131f77664847959c2afa09e8e953a6/users/cfdb5cbee7e044fc9b50d93419fd788d/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:09.320336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b78a56-a42a-4e60-8bd6-1f570bd5506d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29131f77664847959c2afa09e8e953a6, user_id=cfdb5cbee7e044fc9b50d93419fd788d, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:09.323011 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b78a56-a42a-4e60-8bd6-1f570bd5506d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:09.334581 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1356/2717] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:15:09 2022] PUT /identity/v3/projects/29131f77664847959c2afa09e8e953a6/users/cfdb5cbee7e044fc9b50d93419fd788d/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:09.344666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254257d-85fc-4fb1-9645-4bfec8a6ffe1 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:09.344955 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254257d-85fc-4fb1-9645-4bfec8a6ffe1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:09.345227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254257d-85fc-4fb1-9645-4bfec8a6ffe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:09.373126 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-1254257d-85fc-4fb1-9645-4bfec8a6ffe1 None None] MFA Rules not processed for user `cfdb5cbee7e044fc9b50d93419fd788d`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:09.374326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1254257d-85fc-4fb1-9645-4bfec8a6ffe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:09.447502 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1362/2718] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:09.459664 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78a56-a42a-4e60-8bd6-1f570bd5506d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:09.461558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-32b78a56-a42a-4e60-8bd6-1f570bd5506d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:09.520676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78a56-a42a-4e60-8bd6-1f570bd5506d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:09.525520 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b6bcf-8d06-4846-b962-522bc757b315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:09.526202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b6bcf-8d06-4846-b962-522bc757b315 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:09.526515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b6bcf-8d06-4846-b962-522bc757b315 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:09.526791 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b6bcf-8d06-4846-b962-522bc757b315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:09.536173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b6bcf-8d06-4846-b962-522bc757b315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:09.537639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b6bcf-8d06-4846-b962-522bc757b315 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:09.547648 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1357/2719] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:15:09.619768 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254257d-85fc-4fb1-9645-4bfec8a6ffe1 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:09.630850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254257d-85fc-4fb1-9645-4bfec8a6ffe1 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:09.635234 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9e11f-90ac-4573-bac6-3a3649b84bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:09.635909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9e11f-90ac-4573-bac6-3a3649b84bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:09.636197 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9e11f-90ac-4573-bac6-3a3649b84bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:09.636471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9e11f-90ac-4573-bac6-3a3649b84bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:09.696863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9e11f-90ac-4573-bac6-3a3649b84bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:09.698543 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9e11f-90ac-4573-bac6-3a3649b84bd8 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:09.707364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1363/2720] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:15:09.988021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b6bcf-8d06-4846-b962-522bc757b315 service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:10.052692 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b6bcf-8d06-4846-b962-522bc757b315 service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:10.057553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:10.059671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:10.061384 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:10.061695 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] PATH_INFO: `/v3/users/227c3652bf1c49229fe7a3712ed689e8` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:10.064176 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=227c3652bf1c49229fe7a3712ed689e8)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:10.066123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:10.115397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227c3652bf1c49229fe7a3712ed689e8'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.127337 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227c3652bf1c49229fe7a3712ed689e8'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.128015 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227c3652bf1c49229fe7a3712ed689e8'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.134927 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227c3652bf1c49229fe7a3712ed689e8'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.135591 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227c3652bf1c49229fe7a3712ed689e8'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.139230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:10.152479 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1358/2721] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:15:09 2022] DELETE /identity/v3/users/227c3652bf1c49229fe7a3712ed689e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:10.157206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a592e6-6432-48dc-b848-e53fb48663f7 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:10.157543 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a592e6-6432-48dc-b848-e53fb48663f7 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:10.157828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a592e6-6432-48dc-b848-e53fb48663f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:10.175185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-59a592e6-6432-48dc-b848-e53fb48663f7 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:10.176379 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-59a592e6-6432-48dc-b848-e53fb48663f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:10.241261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1364/2722] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:10.253137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:10.254673 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:10.316149 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face15e2-e3f5-4319-b4b7-3cbca962c4c4 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:10.320687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95590cb-654e-4491-a333-e381142e697b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:10.321326 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95590cb-654e-4491-a333-e381142e697b service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:10.321671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95590cb-654e-4491-a333-e381142e697b service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:10.321954 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95590cb-654e-4491-a333-e381142e697b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:10.332185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95590cb-654e-4491-a333-e381142e697b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:10.333641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95590cb-654e-4491-a333-e381142e697b service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:10.343734 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1359/2723] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:15:10.619619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a592e6-6432-48dc-b848-e53fb48663f7 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:10.621285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-59a592e6-6432-48dc-b848-e53fb48663f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:10.636434 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a592e6-6432-48dc-b848-e53fb48663f7 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:10.644145 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:10.645189 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:10.645578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:10.645915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] PATH_INFO: `/v3/projects/ce8ecf9b2f204fbc93c072f7d6e734b2` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:10.647633 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8ecf9b2f204fbc93c072f7d6e734b2)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:10.649936 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:10.664377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=100 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:10.703125 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8ecf9b2f204fbc93c072f7d6e734b2', 'request_id': 'req-7b648902-d8c0-4921-bdd2-cb05c650c9f8'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.709692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8ecf9b2f204fbc93c072f7d6e734b2', 'request_id': 'req-7b648902-d8c0-4921-bdd2-cb05c650c9f8'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.718461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8ecf9b2f204fbc93c072f7d6e734b2', 'request_id': 'req-7b648902-d8c0-4921-bdd2-cb05c650c9f8'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.728711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] The token cache is being invalidate because project ce8ecf9b2f204fbc93c072f7d6e734b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:15:10.728993 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.729778 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.731377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1365/2724] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:15:10 2022] DELETE /identity/v3/projects/ce8ecf9b2f204fbc93c072f7d6e734b2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:10.735500 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95590cb-654e-4491-a333-e381142e697b service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:10.745049 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95590cb-654e-4491-a333-e381142e697b service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:10.803482 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942512d6-eb9d-4935-bd1e-5c762da385e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:10.804358 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942512d6-eb9d-4935-bd1e-5c762da385e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:10.804675 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942512d6-eb9d-4935-bd1e-5c762da385e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:10.804946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942512d6-eb9d-4935-bd1e-5c762da385e7 admin admin] PATH_INFO: `/v3/users/cfdb5cbee7e044fc9b50d93419fd788d` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:10.806263 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942512d6-eb9d-4935-bd1e-5c762da385e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdb5cbee7e044fc9b50d93419fd788d)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:10.808227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942512d6-eb9d-4935-bd1e-5c762da385e7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:10.865595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-942512d6-eb9d-4935-bd1e-5c762da385e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdb5cbee7e044fc9b50d93419fd788d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.878437 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-942512d6-eb9d-4935-bd1e-5c762da385e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdb5cbee7e044fc9b50d93419fd788d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.879144 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-942512d6-eb9d-4935-bd1e-5c762da385e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdb5cbee7e044fc9b50d93419fd788d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.886096 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-942512d6-eb9d-4935-bd1e-5c762da385e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdb5cbee7e044fc9b50d93419fd788d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.886788 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-942512d6-eb9d-4935-bd1e-5c762da385e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdb5cbee7e044fc9b50d93419fd788d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:10.902044 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1360/2725] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:15:10 2022] DELETE /identity/v3/users/cfdb5cbee7e044fc9b50d93419fd788d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:11.192391 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:11.194238 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:11.210820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b648902-d8c0-4921-bdd2-cb05c650c9f8 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:11.270363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:11.271266 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:11.271902 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:11.272172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] PATH_INFO: `/v3/projects/29131f77664847959c2afa09e8e953a6` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:11.273342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29131f77664847959c2afa09e8e953a6)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:11.275339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:11.319520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29131f77664847959c2afa09e8e953a6', 'request_id': 'req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:11.325390 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29131f77664847959c2afa09e8e953a6', 'request_id': 'req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:11.334100 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29131f77664847959c2afa09e8e953a6', 'request_id': 'req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:11.345998 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] The token cache is being invalidate because project 29131f77664847959c2afa09e8e953a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:15:11.346283 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:11.346995 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cf2b1d1-10f7-4644-9fdf-0a98e6b5f9b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:11.348660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1366/2726] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:15:11 2022] DELETE /identity/v3/projects/29131f77664847959c2afa09e8e953a6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:11.353644 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ec062-441f-4beb-81c7-787fbbc3ad80 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:11.353936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ec062-441f-4beb-81c7-787fbbc3ad80 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:11.354222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ec062-441f-4beb-81c7-787fbbc3ad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:11.372940 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f85ec062-441f-4beb-81c7-787fbbc3ad80 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:11.374178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f85ec062-441f-4beb-81c7-787fbbc3ad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:11.387754 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:11.447790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1361/2727] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:11.466538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea961-f955-4833-b3c2-334aaac2a6d8 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:11.466823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea961-f955-4833-b3c2-334aaac2a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:11.467120 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea961-f955-4833-b3c2-334aaac2a6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:11.486235 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-2b7ea961-f955-4833-b3c2-334aaac2a6d8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:11.487487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2b7ea961-f955-4833-b3c2-334aaac2a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:11.497129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1367/2728] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:11.501728 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ec062-441f-4beb-81c7-787fbbc3ad80 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:11.511854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ec062-441f-4beb-81c7-787fbbc3ad80 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:11.517119 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f576a02-be93-49fd-9d19-26c721dea163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:11.517802 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576a02-be93-49fd-9d19-26c721dea163 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:11.518074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576a02-be93-49fd-9d19-26c721dea163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:11.518350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576a02-be93-49fd-9d19-26c721dea163 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:11.519163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f576a02-be93-49fd-9d19-26c721dea163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:15:11.519469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f576a02-be93-49fd-9d19-26c721dea163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:11.521151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f576a02-be93-49fd-9d19-26c721dea163 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:11.533779 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1362/2729] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:15:11.538103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea961-f955-4833-b3c2-334aaac2a6d8 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:11.548289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea961-f955-4833-b3c2-334aaac2a6d8 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:11.554129 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da443000-34ed-4fc9-8040-7e24632c999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:11.554822 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da443000-34ed-4fc9-8040-7e24632c999a admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:11.555138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da443000-34ed-4fc9-8040-7e24632c999a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:11.555412 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da443000-34ed-4fc9-8040-7e24632c999a admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:11.556156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da443000-34ed-4fc9-8040-7e24632c999a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:11.558229 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da443000-34ed-4fc9-8040-7e24632c999a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:11.585980 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1368/2730] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:15:11 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:15:11.591731 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f576a02-be93-49fd-9d19-26c721dea163 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:11.602198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f576a02-be93-49fd-9d19-26c721dea163 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:11.657739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132fa67-4c96-4e79-bb8a-3bdbd59beb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:11.658386 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132fa67-4c96-4e79-bb8a-3bdbd59beb42 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:11.658662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132fa67-4c96-4e79-bb8a-3bdbd59beb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:11.658939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132fa67-4c96-4e79-bb8a-3bdbd59beb42 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:11.659654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132fa67-4c96-4e79-bb8a-3bdbd59beb42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:11.661575 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132fa67-4c96-4e79-bb8a-3bdbd59beb42 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:11.683661 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1363/2731] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:15:11 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:15:11.688830 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da443000-34ed-4fc9-8040-7e24632c999a admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:11.697324 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:11.704385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da443000-34ed-4fc9-8040-7e24632c999a admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:11.714904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc985608-3d6b-4f3b-9d40-20f1a7082ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:11.715664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc985608-3d6b-4f3b-9d40-20f1a7082ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:11.715999 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc985608-3d6b-4f3b-9d40-20f1a7082ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:11.716377 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc985608-3d6b-4f3b-9d40-20f1a7082ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:11.717199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc985608-3d6b-4f3b-9d40-20f1a7082ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:11.718889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc985608-3d6b-4f3b-9d40-20f1a7082ce2 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:11.729829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1369/2732] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:15:11.734116 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132fa67-4c96-4e79-bb8a-3bdbd59beb42 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:11.744301 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132fa67-4c96-4e79-bb8a-3bdbd59beb42 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:11.749425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd032c-feec-4ce8-88f6-21a3b3a1fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:11.750116 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd032c-feec-4ce8-88f6-21a3b3a1fc7f admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:11.750397 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd032c-feec-4ce8-88f6-21a3b3a1fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:11.750701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd032c-feec-4ce8-88f6-21a3b3a1fc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:11.751499 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd032c-feec-4ce8-88f6-21a3b3a1fc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:11.753108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd032c-feec-4ce8-88f6-21a3b3a1fc7f admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:11.763146 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1364/2733] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:15:11.767154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc985608-3d6b-4f3b-9d40-20f1a7082ce2 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:11.778094 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc985608-3d6b-4f3b-9d40-20f1a7082ce2 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:11.783618 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a7406-a7d7-401e-8993-e5ffc07f506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:11.784922 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a7406-a7d7-401e-8993-e5ffc07f506c admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:11.785378 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a7406-a7d7-401e-8993-e5ffc07f506c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:11.785866 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a7406-a7d7-401e-8993-e5ffc07f506c admin admin] PATH_INFO: `/v3/projects/91a3b241e74243fe802da80c53e60bc8/users/3319576ad03d4c179252d1c14c1d826e/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:11.806375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a7406-a7d7-401e-8993-e5ffc07f506c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a3b241e74243fe802da80c53e60bc8, user_id=3319576ad03d4c179252d1c14c1d826e, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:11.809186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a7406-a7d7-401e-8993-e5ffc07f506c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:11.823543 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1370/2734] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:15:11 2022] PUT /identity/v3/projects/91a3b241e74243fe802da80c53e60bc8/users/3319576ad03d4c179252d1c14c1d826e/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:11.830502 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7a08-af37-463e-a81f-a2aff7851df2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:11.830794 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7a08-af37-463e-a81f-a2aff7851df2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:11.831100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7a08-af37-463e-a81f-a2aff7851df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:11.849295 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-4c7d7a08-af37-463e-a81f-a2aff7851df2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:11.850496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4c7d7a08-af37-463e-a81f-a2aff7851df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:11.909169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1365/2735] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:11.919028 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a7406-a7d7-401e-8993-e5ffc07f506c admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:11.920859 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c66a7406-a7d7-401e-8993-e5ffc07f506c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:11.980838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a7406-a7d7-401e-8993-e5ffc07f506c admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:11.985114 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe40193-9d02-48cf-b98e-ae413a8fbbfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:11.985755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe40193-9d02-48cf-b98e-ae413a8fbbfd service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:11.986037 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe40193-9d02-48cf-b98e-ae413a8fbbfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:11.986309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe40193-9d02-48cf-b98e-ae413a8fbbfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:11.996319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe40193-9d02-48cf-b98e-ae413a8fbbfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:11.997760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe40193-9d02-48cf-b98e-ae413a8fbbfd service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:12.007369 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1371/2736] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:15:12.931785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daeb9d2-609f-4a8c-843b-dc8eca28f69d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:12.932325 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daeb9d2-609f-4a8c-843b-dc8eca28f69d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:12.932573 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daeb9d2-609f-4a8c-843b-dc8eca28f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:12.960535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2daeb9d2-609f-4a8c-843b-dc8eca28f69d None None] MFA Rules not processed for user `3319576ad03d4c179252d1c14c1d826e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:12.961858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2daeb9d2-609f-4a8c-843b-dc8eca28f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:12.974204 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:13.031725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1366/2737] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:13.036353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe40193-9d02-48cf-b98e-ae413a8fbbfd service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:13.046140 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe40193-9d02-48cf-b98e-ae413a8fbbfd service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:13.051141 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932ce99-fbb5-494d-88fa-3ef32acfa97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:13.051805 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932ce99-fbb5-494d-88fa-3ef32acfa97f admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:13.052089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932ce99-fbb5-494d-88fa-3ef32acfa97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:13.052364 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932ce99-fbb5-494d-88fa-3ef32acfa97f admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:13.053048 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932ce99-fbb5-494d-88fa-3ef32acfa97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:13.054960 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932ce99-fbb5-494d-88fa-3ef32acfa97f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:13.081807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1372/2738] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:15:13 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:15:13.086039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daeb9d2-609f-4a8c-843b-dc8eca28f69d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:13.097017 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daeb9d2-609f-4a8c-843b-dc8eca28f69d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:13.157557 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d3821-3ce7-46e0-8a2c-40e9ed676433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:13.158389 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d3821-3ce7-46e0-8a2c-40e9ed676433 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:13.158672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d3821-3ce7-46e0-8a2c-40e9ed676433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:13.159029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d3821-3ce7-46e0-8a2c-40e9ed676433 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:13.160010 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d3821-3ce7-46e0-8a2c-40e9ed676433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:13.163032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d3821-3ce7-46e0-8a2c-40e9ed676433 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:13.190275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1367/2739] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:15:13 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:15:13.191629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932ce99-fbb5-494d-88fa-3ef32acfa97f admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:13.203264 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932ce99-fbb5-494d-88fa-3ef32acfa97f admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:13.212907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7d999-04c7-4f90-ac80-c3d7c9aa4afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:13.213726 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d999-04c7-4f90-ac80-c3d7c9aa4afd admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:13.214248 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d999-04c7-4f90-ac80-c3d7c9aa4afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:13.214745 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d999-04c7-4f90-ac80-c3d7c9aa4afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:13.216182 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7d999-04c7-4f90-ac80-c3d7c9aa4afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:13.218005 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7d999-04c7-4f90-ac80-c3d7c9aa4afd admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:13.229116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1373/2740] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:15:13.234465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d3821-3ce7-46e0-8a2c-40e9ed676433 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:13.246138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d3821-3ce7-46e0-8a2c-40e9ed676433 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:13.251168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82f3c-5852-48d7-abb8-6743e563986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:13.252124 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82f3c-5852-48d7-abb8-6743e563986d admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:13.252407 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82f3c-5852-48d7-abb8-6743e563986d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:13.252682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82f3c-5852-48d7-abb8-6743e563986d admin admin] PATH_INFO: `/v3/projects/695949eec8884925afdd8eec30833b68/users/21c3312028844622855054b5279c7ef1/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:13.268493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b82f3c-5852-48d7-abb8-6743e563986d admin admin] RBAC: Authorizing `identity:create_grant(project_id=695949eec8884925afdd8eec30833b68, user_id=21c3312028844622855054b5279c7ef1, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:13.271151 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b82f3c-5852-48d7-abb8-6743e563986d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:13.288239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1368/2741] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:15:13 2022] PUT /identity/v3/projects/695949eec8884925afdd8eec30833b68/users/21c3312028844622855054b5279c7ef1/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:13.292331 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7d999-04c7-4f90-ac80-c3d7c9aa4afd admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:13.302469 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7d999-04c7-4f90-ac80-c3d7c9aa4afd admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:13.360695 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1102dd-6b1e-4728-a6a4-085cd8a11503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:13.361348 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1102dd-6b1e-4728-a6a4-085cd8a11503 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:13.361626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1102dd-6b1e-4728-a6a4-085cd8a11503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:13.361909 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1102dd-6b1e-4728-a6a4-085cd8a11503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:13.362627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1102dd-6b1e-4728-a6a4-085cd8a11503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:13.364277 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1102dd-6b1e-4728-a6a4-085cd8a11503 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:13.374022 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1374/2742] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:15:13.378808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82f3c-5852-48d7-abb8-6743e563986d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:13.393216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82f3c-5852-48d7-abb8-6743e563986d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:13.399876 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986af670-5f14-435f-a639-f93c2c3595cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:13.400884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986af670-5f14-435f-a639-f93c2c3595cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:13.401201 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986af670-5f14-435f-a639-f93c2c3595cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:13.401583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986af670-5f14-435f-a639-f93c2c3595cb admin admin] PATH_INFO: `/v3/projects/695949eec8884925afdd8eec30833b68/users/21c3312028844622855054b5279c7ef1/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:13.404828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986af670-5f14-435f-a639-f93c2c3595cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=695949eec8884925afdd8eec30833b68, user_id=21c3312028844622855054b5279c7ef1, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:13.408231 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986af670-5f14-435f-a639-f93c2c3595cb admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:13.420219 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1369/2743] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:15:13 2022] PUT /identity/v3/projects/695949eec8884925afdd8eec30833b68/users/21c3312028844622855054b5279c7ef1/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:14.034221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af010586-1b70-491e-a46d-eba8b1f0470f None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:14.034700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af010586-1b70-491e-a46d-eba8b1f0470f None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:14.034968 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af010586-1b70-491e-a46d-eba8b1f0470f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:14.061546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-af010586-1b70-491e-a46d-eba8b1f0470f None None] MFA Rules not processed for user `21c3312028844622855054b5279c7ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:14.062763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-af010586-1b70-491e-a46d-eba8b1f0470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:14.086843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:14.137335 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1375/2744] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:14.149423 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4d462-2b73-4e44-9532-0cf089c281c5 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:14.149962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4d462-2b73-4e44-9532-0cf089c281c5 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:14.150082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4d462-2b73-4e44-9532-0cf089c281c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:14.167638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7ee4d462-2b73-4e44-9532-0cf089c281c5 None None] MFA Rules not processed for user `3319576ad03d4c179252d1c14c1d826e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:14.168841 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7ee4d462-2b73-4e44-9532-0cf089c281c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:14.226932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1370/2745] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:15:14.239944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af010586-1b70-491e-a46d-eba8b1f0470f None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:14.241576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-af010586-1b70-491e-a46d-eba8b1f0470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:14.317353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af010586-1b70-491e-a46d-eba8b1f0470f None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:14.324342 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50061bc-f15a-436c-ac2c-33e7092947ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:14.325010 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50061bc-f15a-436c-ac2c-33e7092947ba service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:14.325285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50061bc-f15a-436c-ac2c-33e7092947ba service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:14.325558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50061bc-f15a-436c-ac2c-33e7092947ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:14.333637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50061bc-f15a-436c-ac2c-33e7092947ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:14.335306 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50061bc-f15a-436c-ac2c-33e7092947ba service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:14.344373 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1376/2746] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:15:14.375724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4d462-2b73-4e44-9532-0cf089c281c5 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:14.377485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7ee4d462-2b73-4e44-9532-0cf089c281c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:14.394734 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:14.442883 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4d462-2b73-4e44-9532-0cf089c281c5 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:14.446935 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b39f9-cdee-4157-a752-8d2ec0dd7caa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '250c47daff26400c96a6b467d7cf5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:14.447638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b39f9-cdee-4157-a752-8d2ec0dd7caa service glance] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:14.447922 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b39f9-cdee-4157-a752-8d2ec0dd7caa service glance] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:14.448203 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b39f9-cdee-4157-a752-8d2ec0dd7caa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:14.450169 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a10b39f9-cdee-4157-a752-8d2ec0dd7caa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:14.463929 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b39f9-cdee-4157-a752-8d2ec0dd7caa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:14.465370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b39f9-cdee-4157-a752-8d2ec0dd7caa service glance] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:14.476474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1371/2747] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:15:15.259553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50061bc-f15a-436c-ac2c-33e7092947ba service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:15.318195 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50061bc-f15a-436c-ac2c-33e7092947ba service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:15.322261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726cb18-a603-4461-baa1-1ee8cb032711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:15.323185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726cb18-a603-4461-baa1-1ee8cb032711 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:15.323539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726cb18-a603-4461-baa1-1ee8cb032711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:15.323873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726cb18-a603-4461-baa1-1ee8cb032711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:15.325841 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e726cb18-a603-4461-baa1-1ee8cb032711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:15.340297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726cb18-a603-4461-baa1-1ee8cb032711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:15.341820 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726cb18-a603-4461-baa1-1ee8cb032711 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:15.352983 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1377/2748] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:15:16.935139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b39f9-cdee-4157-a752-8d2ec0dd7caa service glance] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:16.950318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b39f9-cdee-4157-a752-8d2ec0dd7caa service glance] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:16.955295 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a104d8-a60f-461a-8723-d9410ca76456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:16.955945 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a104d8-a60f-461a-8723-d9410ca76456 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:16.956229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a104d8-a60f-461a-8723-d9410ca76456 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:16.956495 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a104d8-a60f-461a-8723-d9410ca76456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:16.958818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-50a104d8-a60f-461a-8723-d9410ca76456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:16.970697 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a104d8-a60f-461a-8723-d9410ca76456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:16.972359 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a104d8-a60f-461a-8723-d9410ca76456 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:16.981944 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1372/2749] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:15:25.348032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=79 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:26.977271 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=27 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:27.624414 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726cb18-a603-4461-baa1-1ee8cb032711 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:27.625888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e726cb18-a603-4461-baa1-1ee8cb032711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:27.683682 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726cb18-a603-4461-baa1-1ee8cb032711 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:27.687849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85045286-4645-4737-8989-fad5a411c3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:27.688511 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85045286-4645-4737-8989-fad5a411c3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:27.688865 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85045286-4645-4737-8989-fad5a411c3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:27.689178 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85045286-4645-4737-8989-fad5a411c3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:27.698712 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85045286-4645-4737-8989-fad5a411c3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:27.700206 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85045286-4645-4737-8989-fad5a411c3e5 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:27.710103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1378/2750] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:15:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:15:27.917634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2a00-cfde-4dfa-bcca-234510b8015b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:27.918028 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2a00-cfde-4dfa-bcca-234510b8015b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:27.918278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2a00-cfde-4dfa-bcca-234510b8015b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:27.936851 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-96cb2a00-cfde-4dfa-bcca-234510b8015b None None] MFA Rules not processed for user `b745bccb3ce24ca9bb32b6648a5e17c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:15:27.938098 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-96cb2a00-cfde-4dfa-bcca-234510b8015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:27.996970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1373/2751] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:15:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:15:37.706085 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=26 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:37.989578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=25 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:47.451750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85045286-4645-4737-8989-fad5a411c3e5 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:47.519107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85045286-4645-4737-8989-fad5a411c3e5 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:47.524272 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:47.525158 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:47.525436 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:47.525710 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] PATH_INFO: `/v3/users/3319576ad03d4c179252d1c14c1d826e` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:47.526873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3319576ad03d4c179252d1c14c1d826e)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:47.528845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:47.581043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3319576ad03d4c179252d1c14c1d826e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:47.592808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3319576ad03d4c179252d1c14c1d826e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:47.602142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3319576ad03d4c179252d1c14c1d826e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:47.609092 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3319576ad03d4c179252d1c14c1d826e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:47.609701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3319576ad03d4c179252d1c14c1d826e'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:47.615418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1379/2752] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:15:47 2022] DELETE /identity/v3/users/3319576ad03d4c179252d1c14c1d826e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:47.797816 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb2a00-cfde-4dfa-bcca-234510b8015b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:47.809223 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb2a00-cfde-4dfa-bcca-234510b8015b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:47.865881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:47.866750 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:47.867064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:47.867412 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] PATH_INFO: `/v3/projects/91a3b241e74243fe802da80c53e60bc8` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:47.868635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a3b241e74243fe802da80c53e60bc8)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:47.870571 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:47.916875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a3b241e74243fe802da80c53e60bc8', 'request_id': 'req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:47.922953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a3b241e74243fe802da80c53e60bc8', 'request_id': 'req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:47.932431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a3b241e74243fe802da80c53e60bc8', 'request_id': 'req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:47.942626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] The token cache is being invalidate because project 91a3b241e74243fe802da80c53e60bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:15:47.942913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:47.943555 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:47.945354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1374/2753] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:15:47 2022] DELETE /identity/v3/projects/91a3b241e74243fe802da80c53e60bc8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:47.949186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:47.950628 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:47.964049 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe8366-c318-4ac3-bbde-1f2496031df2 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:48.020223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:48.021101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:48.021385 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:48.021680 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] PATH_INFO: `/v3/users/21c3312028844622855054b5279c7ef1` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:48.023245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c3312028844622855054b5279c7ef1)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:48.025279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:48.046172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:48.071520 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c3312028844622855054b5279c7ef1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:48.083220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c3312028844622855054b5279c7ef1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:48.090518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c3312028844622855054b5279c7ef1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:48.097474 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c3312028844622855054b5279c7ef1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:48.098165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c3312028844622855054b5279c7ef1'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:48.104193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1380/2754] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:15:47 2022] DELETE /identity/v3/users/21c3312028844622855054b5279c7ef1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:48.294447 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:15:48.295997 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:15:48.312503 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e89e90-b7cb-47e3-ad1b-e2d148a94bc2 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:15:48.371524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:15:48.372408 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:15:48.372689 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:15:48.372963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] PATH_INFO: `/v3/projects/695949eec8884925afdd8eec30833b68` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:15:48.374159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] RBAC: Authorizing `identity:delete_project(project_id=695949eec8884925afdd8eec30833b68)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:15:48.376095 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:15:48.411100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:48.425671 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695949eec8884925afdd8eec30833b68', 'request_id': 'req-911aa06e-82f2-45c5-8e0a-950ea595f47d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:48.433781 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695949eec8884925afdd8eec30833b68', 'request_id': 'req-911aa06e-82f2-45c5-8e0a-950ea595f47d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:48.444039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695949eec8884925afdd8eec30833b68', 'request_id': 'req-911aa06e-82f2-45c5-8e0a-950ea595f47d'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:48.455261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] The token cache is being invalidate because project 695949eec8884925afdd8eec30833b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:15:48.455551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:48.456201 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-911aa06e-82f2-45c5-8e0a-950ea595f47d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:15:48.457822 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1375/2755] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:15:48 2022] DELETE /identity/v3/projects/695949eec8884925afdd8eec30833b68 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:15:58.100617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:15:58.452282 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:16:58.480451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:16:58.484958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:16:58.591691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb4e97-ec7d-4922-80eb-b0ef9b8f232b admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:16:58.667871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ce3ab-01d2-4fce-9cbe-e8b26ec0a872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:16:58.668610 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce3ab-01d2-4fce-9cbe-e8b26ec0a872 service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:16:58.668894 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce3ab-01d2-4fce-9cbe-e8b26ec0a872 service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:16:58.669171 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce3ab-01d2-4fce-9cbe-e8b26ec0a872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:16:58.671362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3b4ce3ab-01d2-4fce-9cbe-e8b26ec0a872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:16:58.686838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ce3ab-01d2-4fce-9cbe-e8b26ec0a872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:16:58.689485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ce3ab-01d2-4fce-9cbe-e8b26ec0a872 service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:16:58.701939 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1381/2756] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:16:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:17:07.288618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde982d-0ec3-4f9b-b71a-a44e5956ba2b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:17:07.289230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde982d-0ec3-4f9b-b71a-a44e5956ba2b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:17:07.289230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde982d-0ec3-4f9b-b71a-a44e5956ba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:17:07.308687 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-8fde982d-0ec3-4f9b-b71a-a44e5956ba2b None None] MFA Rules not processed for user `b745bccb3ce24ca9bb32b6648a5e17c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:17:07.309905 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8fde982d-0ec3-4f9b-b71a-a44e5956ba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:17:07.365994 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1376/2757] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:17:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:17:07.695499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ce3ab-01d2-4fce-9cbe-e8b26ec0a872 service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:17:07.697839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3b4ce3ab-01d2-4fce-9cbe-e8b26ec0a872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:17:07.762155 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ce3ab-01d2-4fce-9cbe-e8b26ec0a872 service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:17:07.766060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7ce2a-58b0-4c60-b017-f669cc8f94a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:17:07.766701 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7ce2a-58b0-4c60-b017-f669cc8f94a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:17:07.767000 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7ce2a-58b0-4c60-b017-f669cc8f94a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:17:07.767289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7ce2a-58b0-4c60-b017-f669cc8f94a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:17:07.769068 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-85f7ce2a-58b0-4c60-b017-f669cc8f94a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:17:07.779304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7ce2a-58b0-4c60-b017-f669cc8f94a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:17:07.780849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7ce2a-58b0-4c60-b017-f669cc8f94a7 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:17:07.789004 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1382/2758] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:17:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:17:08.111515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde982d-0ec3-4f9b-b71a-a44e5956ba2b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:17:08.113021 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8fde982d-0ec3-4f9b-b71a-a44e5956ba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:17:08.183737 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde982d-0ec3-4f9b-b71a-a44e5956ba2b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:17:08.189099 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8debe0-73d2-4140-8f8b-6cb8279799d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:17:08.189742 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8debe0-73d2-4140-8f8b-6cb8279799d6 service placement] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:17:08.190020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8debe0-73d2-4140-8f8b-6cb8279799d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:17:08.190323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8debe0-73d2-4140-8f8b-6cb8279799d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:17:08.192164 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8e8debe0-73d2-4140-8f8b-6cb8279799d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:17:08.203613 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8debe0-73d2-4140-8f8b-6cb8279799d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:17:08.205192 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8debe0-73d2-4140-8f8b-6cb8279799d6 service placement] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:17:08.215249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1377/2759] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:17:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:17:17.785394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=88 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:17:17.794172 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7ce2a-58b0-4c60-b017-f669cc8f94a7 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:17:17.795812 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-85f7ce2a-58b0-4c60-b017-f669cc8f94a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:17:17.863944 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7ce2a-58b0-4c60-b017-f669cc8f94a7 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:17:17.869832 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be06382-74ff-46e1-a237-ec6d1664aa8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:17:17.870487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06382-74ff-46e1-a237-ec6d1664aa8a service nova] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:17:17.870776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06382-74ff-46e1-a237-ec6d1664aa8a service nova] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:17:17.871087 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06382-74ff-46e1-a237-ec6d1664aa8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:17:17.873079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4be06382-74ff-46e1-a237-ec6d1664aa8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:17:17.885702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be06382-74ff-46e1-a237-ec6d1664aa8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:17:17.887317 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be06382-74ff-46e1-a237-ec6d1664aa8a service nova] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:17:17.898125 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1383/2760] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:17:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:17:18.211008 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=57 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:17:22.133686 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8debe0-73d2-4140-8f8b-6cb8279799d6 service placement] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:17:22.135309 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8e8debe0-73d2-4140-8f8b-6cb8279799d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:17:22.203658 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8debe0-73d2-4140-8f8b-6cb8279799d6 service placement] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:17:22.209972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e814da8-0519-4d45-8ca0-8c1e01445e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:17:22.210623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814da8-0519-4d45-8ca0-8c1e01445e83 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:17:22.210901 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814da8-0519-4d45-8ca0-8c1e01445e83 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:17:22.211257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814da8-0519-4d45-8ca0-8c1e01445e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:17:22.213167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0e814da8-0519-4d45-8ca0-8c1e01445e83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:17:22.228545 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e814da8-0519-4d45-8ca0-8c1e01445e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:17:22.230178 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e814da8-0519-4d45-8ca0-8c1e01445e83 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:17:22.241401 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1378/2761] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:17:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:17:27.893908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=28 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:17:32.236854 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=28 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:18:35.191862 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be06382-74ff-46e1-a237-ec6d1664aa8a service nova] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:18:35.193371 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-4be06382-74ff-46e1-a237-ec6d1664aa8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:18:35.229366 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be06382-74ff-46e1-a237-ec6d1664aa8a service nova] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:18:35.234530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0e73d-71ca-4c42-86a8-7b0bcc22aac7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:18:35.235227 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0e73d-71ca-4c42-86a8-7b0bcc22aac7 service placement] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:18:35.235489 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0e73d-71ca-4c42-86a8-7b0bcc22aac7 service placement] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:18:35.235765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0e73d-71ca-4c42-86a8-7b0bcc22aac7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:18:35.237518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b0f0e73d-71ca-4c42-86a8-7b0bcc22aac7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:18:35.249744 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0e73d-71ca-4c42-86a8-7b0bcc22aac7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:18:35.251461 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0e73d-71ca-4c42-86a8-7b0bcc22aac7 service placement] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:18:35.262286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1384/2762] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:18:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:18:37.787168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d3159-6a0f-4526-8328-5b951602b3e1 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:18:37.787811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d3159-6a0f-4526-8328-5b951602b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:18:37.787811 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d3159-6a0f-4526-8328-5b951602b3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:18:37.808789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-cf2d3159-6a0f-4526-8328-5b951602b3e1 None None] MFA Rules not processed for user `b745bccb3ce24ca9bb32b6648a5e17c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:18:37.810139 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cf2d3159-6a0f-4526-8328-5b951602b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:18:37.817596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1379/2763] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:18:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:18:38.141920 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0e73d-71ca-4c42-86a8-7b0bcc22aac7 service placement] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:18:38.144394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b0f0e73d-71ca-4c42-86a8-7b0bcc22aac7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:18:38.180889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0e73d-71ca-4c42-86a8-7b0bcc22aac7 service placement] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:18:38.186564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd3e4b-712f-4a84-9908-b6f2c7dfa166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:18:38.187327 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd3e4b-712f-4a84-9908-b6f2c7dfa166 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:18:38.187599 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd3e4b-712f-4a84-9908-b6f2c7dfa166 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:18:38.187868 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd3e4b-712f-4a84-9908-b6f2c7dfa166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:18:38.190464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-88dd3e4b-712f-4a84-9908-b6f2c7dfa166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:18:38.200796 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd3e4b-712f-4a84-9908-b6f2c7dfa166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:18:38.202336 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd3e4b-712f-4a84-9908-b6f2c7dfa166 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:18:38.210538 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1385/2764] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:18:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:18:47.803637 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:18:48.206750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=30 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:19:55.112834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d3159-6a0f-4526-8328-5b951602b3e1 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:19:55.144308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d3159-6a0f-4526-8328-5b951602b3e1 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:19:55.150569 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94059c6a-744b-4377-bec1-de20259a511d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:19:55.151596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94059c6a-744b-4377-bec1-de20259a511d service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:19:55.151884 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94059c6a-744b-4377-bec1-de20259a511d service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:19:55.152163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94059c6a-744b-4377-bec1-de20259a511d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:19:55.154128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-94059c6a-744b-4377-bec1-de20259a511d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:19:55.166111 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94059c6a-744b-4377-bec1-de20259a511d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:19:55.167903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94059c6a-744b-4377-bec1-de20259a511d service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:19:55.179022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1380/2765] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:19:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:05.173682 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=13 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:09.757664 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd3e4b-712f-4a84-9908-b6f2c7dfa166 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:09.767118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd3e4b-712f-4a84-9908-b6f2c7dfa166 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:09.770969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2753a56-40ee-41ce-b4a1-8c857b3f5333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:09.771650 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2753a56-40ee-41ce-b4a1-8c857b3f5333 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:09.771937 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2753a56-40ee-41ce-b4a1-8c857b3f5333 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:09.772217 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2753a56-40ee-41ce-b4a1-8c857b3f5333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:09.774326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c2753a56-40ee-41ce-b4a1-8c857b3f5333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:09.868015 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2753a56-40ee-41ce-b4a1-8c857b3f5333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:09.869473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2753a56-40ee-41ce-b4a1-8c857b3f5333 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:09.888465 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1386/2766] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:12.772076 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94059c6a-744b-4377-bec1-de20259a511d service nova] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:12.784360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94059c6a-744b-4377-bec1-de20259a511d service nova] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:12.789647 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e506356-1425-4bbc-bb50-6a14fdcdee37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:12.790369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e506356-1425-4bbc-bb50-6a14fdcdee37 service placement] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:12.790656 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e506356-1425-4bbc-bb50-6a14fdcdee37 service placement] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:12.790938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e506356-1425-4bbc-bb50-6a14fdcdee37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:12.792853 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7e506356-1425-4bbc-bb50-6a14fdcdee37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:12.804903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e506356-1425-4bbc-bb50-6a14fdcdee37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:12.806805 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e506356-1425-4bbc-bb50-6a14fdcdee37 service placement] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:12.821910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1381/2767] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:12.829731 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2753a56-40ee-41ce-b4a1-8c857b3f5333 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:12.831399 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c2753a56-40ee-41ce-b4a1-8c857b3f5333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:12.851963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2753a56-40ee-41ce-b4a1-8c857b3f5333 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:12.856818 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d28de9-90e1-436c-afe9-e4238c064abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:12.857714 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d28de9-90e1-436c-afe9-e4238c064abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:12.857997 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d28de9-90e1-436c-afe9-e4238c064abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:12.858278 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d28de9-90e1-436c-afe9-e4238c064abe admin admin] PATH_INFO: `/v3/users/b745bccb3ce24ca9bb32b6648a5e17c7` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:12.859498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d28de9-90e1-436c-afe9-e4238c064abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b745bccb3ce24ca9bb32b6648a5e17c7)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:12.861444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d28de9-90e1-436c-afe9-e4238c064abe admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:12.911249 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-42d28de9-90e1-436c-afe9-e4238c064abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b745bccb3ce24ca9bb32b6648a5e17c7'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:12.922445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-42d28de9-90e1-436c-afe9-e4238c064abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b745bccb3ce24ca9bb32b6648a5e17c7'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:12.931101 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-42d28de9-90e1-436c-afe9-e4238c064abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b745bccb3ce24ca9bb32b6648a5e17c7'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:12.937764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-42d28de9-90e1-436c-afe9-e4238c064abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b745bccb3ce24ca9bb32b6648a5e17c7'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:12.938374 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-42d28de9-90e1-436c-afe9-e4238c064abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b745bccb3ce24ca9bb32b6648a5e17c7'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:12.944445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1387/2768] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:20:12 2022] DELETE /identity/v3/users/b745bccb3ce24ca9bb32b6648a5e17c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:13.140243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e506356-1425-4bbc-bb50-6a14fdcdee37 service placement] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:13.152621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e506356-1425-4bbc-bb50-6a14fdcdee37 service placement] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:13.209824 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:13.210693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:13.210978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:13.211293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] PATH_INFO: `/v3/projects/a343b1fea3834e5f86b9109cac7768c2` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:13.212505 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a343b1fea3834e5f86b9109cac7768c2)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:13.214442 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:13.270582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a343b1fea3834e5f86b9109cac7768c2', 'request_id': 'req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:13.277188 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a343b1fea3834e5f86b9109cac7768c2', 'request_id': 'req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:13.286627 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a343b1fea3834e5f86b9109cac7768c2', 'request_id': 'req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:13.297004 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] The token cache is being invalidate because project a343b1fea3834e5f86b9109cac7768c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:20:13.297286 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:13.297949 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-05d629f7-a6a1-4228-9ac5-cb8af2ef40ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:13.299524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1382/2769] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:20:13 2022] DELETE /identity/v3/projects/a343b1fea3834e5f86b9109cac7768c2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:13.304607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17a6fa-d0fe-48fc-84b7-432caaeb4532 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:13.304896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17a6fa-d0fe-48fc-84b7-432caaeb4532 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:13.305193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17a6fa-d0fe-48fc-84b7-432caaeb4532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:13.363494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:13.366676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-3d17a6fa-d0fe-48fc-84b7-432caaeb4532 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:13.368626 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3d17a6fa-d0fe-48fc-84b7-432caaeb4532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:13.430958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1388/2770] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:13.439317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b76d59-c388-4a0f-811f-790db9491ca5 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:13.439613 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b76d59-c388-4a0f-811f-790db9491ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:13.439898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b76d59-c388-4a0f-811f-790db9491ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:13.460399 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-43b76d59-c388-4a0f-811f-790db9491ca5 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:13.461635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-43b76d59-c388-4a0f-811f-790db9491ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:13.470897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1383/2771] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:13.477269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17a6fa-d0fe-48fc-84b7-432caaeb4532 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:13.488065 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17a6fa-d0fe-48fc-84b7-432caaeb4532 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:13.493116 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e7d5a-98ff-4734-977b-70f866734972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:13.493764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e7d5a-98ff-4734-977b-70f866734972 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:13.494033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e7d5a-98ff-4734-977b-70f866734972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:13.494330 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e7d5a-98ff-4734-977b-70f866734972 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:13.495105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e7d5a-98ff-4734-977b-70f866734972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:20:13.495393 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e7d5a-98ff-4734-977b-70f866734972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:13.497032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e7d5a-98ff-4734-977b-70f866734972 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:13.509316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1389/2772] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:20:13.513724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b76d59-c388-4a0f-811f-790db9491ca5 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:13.523081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b76d59-c388-4a0f-811f-790db9491ca5 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:13.528318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694f1d-21d7-4555-a061-615a0dd41afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:13.528978 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694f1d-21d7-4555-a061-615a0dd41afc admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:13.529265 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694f1d-21d7-4555-a061-615a0dd41afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:13.529542 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2694f1d-21d7-4555-a061-615a0dd41afc admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:13.530243 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694f1d-21d7-4555-a061-615a0dd41afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:13.532214 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2694f1d-21d7-4555-a061-615a0dd41afc admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:13.562258 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1384/2773] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:20:13 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:13.566615 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e7d5a-98ff-4734-977b-70f866734972 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:13.578103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e7d5a-98ff-4734-977b-70f866734972 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:13.635926 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873d1e8-0532-4688-ab73-ff47d7fb5cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:13.636527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873d1e8-0532-4688-ab73-ff47d7fb5cfe admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:13.636807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873d1e8-0532-4688-ab73-ff47d7fb5cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:13.637110 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873d1e8-0532-4688-ab73-ff47d7fb5cfe admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:13.637799 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873d1e8-0532-4688-ab73-ff47d7fb5cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:13.639791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873d1e8-0532-4688-ab73-ff47d7fb5cfe admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:13.659598 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1390/2774] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:20:13 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:13.663941 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694f1d-21d7-4555-a061-615a0dd41afc admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:13.674426 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2694f1d-21d7-4555-a061-615a0dd41afc admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:13.679209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21c3bb-7dbe-435e-8987-585ff12fef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:13.679865 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21c3bb-7dbe-435e-8987-585ff12fef28 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:13.680142 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21c3bb-7dbe-435e-8987-585ff12fef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:13.680420 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21c3bb-7dbe-435e-8987-585ff12fef28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:13.681200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21c3bb-7dbe-435e-8987-585ff12fef28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:13.682802 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21c3bb-7dbe-435e-8987-585ff12fef28 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:13.693091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1385/2775] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:13.697154 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873d1e8-0532-4688-ab73-ff47d7fb5cfe admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:13.706954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873d1e8-0532-4688-ab73-ff47d7fb5cfe admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:13.711735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef6416-3ecd-40bc-b744-3abdd621495d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:13.712666 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6416-3ecd-40bc-b744-3abdd621495d admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:13.713137 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6416-3ecd-40bc-b744-3abdd621495d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:13.713600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6416-3ecd-40bc-b744-3abdd621495d admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:13.714826 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef6416-3ecd-40bc-b744-3abdd621495d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:13.717013 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef6416-3ecd-40bc-b744-3abdd621495d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:13.727491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1391/2776] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:20:13.731614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21c3bb-7dbe-435e-8987-585ff12fef28 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:13.741723 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21c3bb-7dbe-435e-8987-585ff12fef28 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:13.747936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e28060-d2c4-4ac1-b285-0309df91c4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:13.748827 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28060-d2c4-4ac1-b285-0309df91c4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:13.749087 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28060-d2c4-4ac1-b285-0309df91c4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:13.749364 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28060-d2c4-4ac1-b285-0309df91c4e3 admin admin] PATH_INFO: `/v3/projects/abf2615177cf4fef90decf6300340694/users/52fc88e4943d4227a671fbfe7183c909/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:13.764378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e28060-d2c4-4ac1-b285-0309df91c4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf2615177cf4fef90decf6300340694, user_id=52fc88e4943d4227a671fbfe7183c909, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:13.767078 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e28060-d2c4-4ac1-b285-0309df91c4e3 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:13.782790 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1386/2777] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:13 2022] PUT /identity/v3/projects/abf2615177cf4fef90decf6300340694/users/52fc88e4943d4227a671fbfe7183c909/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:13.793908 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd649ef-051c-49b8-a34a-a17e82fe64e9 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:13.794200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd649ef-051c-49b8-a34a-a17e82fe64e9 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:13.794510 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd649ef-051c-49b8-a34a-a17e82fe64e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:13.823361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-ffd649ef-051c-49b8-a34a-a17e82fe64e9 None None] MFA Rules not processed for user `52fc88e4943d4227a671fbfe7183c909`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:13.824589 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ffd649ef-051c-49b8-a34a-a17e82fe64e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:13.897050 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1392/2778] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:13.909000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e28060-d2c4-4ac1-b285-0309df91c4e3 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:13.911125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-48e28060-d2c4-4ac1-b285-0309df91c4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:13.929800 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:14.008341 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e28060-d2c4-4ac1-b285-0309df91c4e3 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:14.015356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6f50e-b8a9-44bd-9144-acf7d1374ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24319e5e83ed4caf9dd3ae4b3937b3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:14.015993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6f50e-b8a9-44bd-9144-acf7d1374ee6 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:14.016271 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6f50e-b8a9-44bd-9144-acf7d1374ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:14.016528 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6f50e-b8a9-44bd-9144-acf7d1374ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:14.024763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6f50e-b8a9-44bd-9144-acf7d1374ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:14.026722 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6f50e-b8a9-44bd-9144-acf7d1374ee6 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:14.035672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1387/2779] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:14.366429 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd649ef-051c-49b8-a34a-a17e82fe64e9 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:14.367896 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ffd649ef-051c-49b8-a34a-a17e82fe64e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:14.373864 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:14.436829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd649ef-051c-49b8-a34a-a17e82fe64e9 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:14.440847 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc14612-56ca-4158-ac45-2ae9589eed57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:14.441548 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14612-56ca-4158-ac45-2ae9589eed57 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:14.441821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14612-56ca-4158-ac45-2ae9589eed57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:14.442093 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14612-56ca-4158-ac45-2ae9589eed57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:14.444008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ccc14612-56ca-4158-ac45-2ae9589eed57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:14.458179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc14612-56ca-4158-ac45-2ae9589eed57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:14.459660 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc14612-56ca-4158-ac45-2ae9589eed57 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:14.471022 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1393/2780] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:15.538136 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6f50e-b8a9-44bd-9144-acf7d1374ee6 service nova] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:15.539838 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1cb6f50e-b8a9-44bd-9144-acf7d1374ee6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:15.553872 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6f50e-b8a9-44bd-9144-acf7d1374ee6 service nova] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:15.558416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cb8e1-b176-470d-baf3-180597b3b504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:15.559093 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cb8e1-b176-470d-baf3-180597b3b504 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:15.559368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cb8e1-b176-470d-baf3-180597b3b504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:15.559639 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cb8e1-b176-470d-baf3-180597b3b504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:15.561693 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f42cb8e1-b176-470d-baf3-180597b3b504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:15.576134 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cb8e1-b176-470d-baf3-180597b3b504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:15.577654 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cb8e1-b176-470d-baf3-180597b3b504 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:15.590024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1388/2781] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:19.449014 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc14612-56ca-4158-ac45-2ae9589eed57 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:19.510941 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc14612-56ca-4158-ac45-2ae9589eed57 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:19.515835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:19.516709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:19.516987 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:19.517262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] PATH_INFO: `/v3/users/52fc88e4943d4227a671fbfe7183c909` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:19.518451 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52fc88e4943d4227a671fbfe7183c909)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:19.520433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:19.572714 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52fc88e4943d4227a671fbfe7183c909'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:19.590009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52fc88e4943d4227a671fbfe7183c909'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:19.599193 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52fc88e4943d4227a671fbfe7183c909'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:19.606850 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52fc88e4943d4227a671fbfe7183c909'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:19.607527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52fc88e4943d4227a671fbfe7183c909'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:19.613878 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1394/2782] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:20:19 2022] DELETE /identity/v3/users/52fc88e4943d4227a671fbfe7183c909 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:19.618659 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a354-9688-4c25-a1e5-b4b80cbbb475 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:19.619206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a354-9688-4c25-a1e5-b4b80cbbb475 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:19.619206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a354-9688-4c25-a1e5-b4b80cbbb475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:19.637064 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b894a354-9688-4c25-a1e5-b4b80cbbb475 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:19.638259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b894a354-9688-4c25-a1e5-b4b80cbbb475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:19.700297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1389/2783] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:20:19.710216 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:19.711848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:19.742045 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:19.777563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574d0fc-5559-48e8-ad05-2f7cabb22ce0 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:19.781765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdad34-8fee-4891-8222-527129252973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:19.782410 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdad34-8fee-4891-8222-527129252973 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:19.782691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdad34-8fee-4891-8222-527129252973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:19.782966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdad34-8fee-4891-8222-527129252973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:19.793066 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdad34-8fee-4891-8222-527129252973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:19.794518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdad34-8fee-4891-8222-527129252973 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:19.804166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1395/2784] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:20.088765 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894a354-9688-4c25-a1e5-b4b80cbbb475 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:20.090376 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b894a354-9688-4c25-a1e5-b4b80cbbb475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:20.103170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894a354-9688-4c25-a1e5-b4b80cbbb475 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:20.108248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:20.109183 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.109469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.109748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] PATH_INFO: `/v3/projects/abf2615177cf4fef90decf6300340694` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.111063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf2615177cf4fef90decf6300340694)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:20.112988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:20.162141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf2615177cf4fef90decf6300340694', 'request_id': 'req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:20.168195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf2615177cf4fef90decf6300340694', 'request_id': 'req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:20.176239 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf2615177cf4fef90decf6300340694', 'request_id': 'req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:20.183612 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:20.189256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] The token cache is being invalidate because project abf2615177cf4fef90decf6300340694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:20:20.189603 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:20.190464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f91c70cf-6cc8-42b3-b5bc-7257fe17ec3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:20.192587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1390/2785] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:20:20 2022] DELETE /identity/v3/projects/abf2615177cf4fef90decf6300340694 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:20.197688 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1fd7-0563-4e2f-9da7-95aaa22ea85c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.197975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1fd7-0563-4e2f-9da7-95aaa22ea85c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.198285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1fd7-0563-4e2f-9da7-95aaa22ea85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.216161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-454d1fd7-0563-4e2f-9da7-95aaa22ea85c None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:20.217380 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-454d1fd7-0563-4e2f-9da7-95aaa22ea85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:20.280702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1396/2786] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:20.289398 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614e799-ce80-4212-94ea-d246bacd76bc None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.289762 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614e799-ce80-4212-94ea-d246bacd76bc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.290136 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614e799-ce80-4212-94ea-d246bacd76bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.309878 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9614e799-ce80-4212-94ea-d246bacd76bc None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:20.311096 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9614e799-ce80-4212-94ea-d246bacd76bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:20.320490 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1391/2787] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:20.324842 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d1fd7-0563-4e2f-9da7-95aaa22ea85c None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:20.335156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d1fd7-0563-4e2f-9da7-95aaa22ea85c None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:20.341088 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcfeda-abc2-42b8-8db4-a6a17b89e56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:20.341750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcfeda-abc2-42b8-8db4-a6a17b89e56c admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.342037 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcfeda-abc2-42b8-8db4-a6a17b89e56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.342321 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcfeda-abc2-42b8-8db4-a6a17b89e56c admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.343073 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcfeda-abc2-42b8-8db4-a6a17b89e56c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:20:20.343384 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcfeda-abc2-42b8-8db4-a6a17b89e56c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:20.345001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcfeda-abc2-42b8-8db4-a6a17b89e56c admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:20.356971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1397/2788] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:20:20.361439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614e799-ce80-4212-94ea-d246bacd76bc None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:20.371613 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614e799-ce80-4212-94ea-d246bacd76bc None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:20.377665 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76a3b5-340e-4c64-b3b3-da408303f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:20.378311 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a3b5-340e-4c64-b3b3-da408303f9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.378597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a3b5-340e-4c64-b3b3-da408303f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.378887 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a3b5-340e-4c64-b3b3-da408303f9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.379614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76a3b5-340e-4c64-b3b3-da408303f9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:20.381521 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76a3b5-340e-4c64-b3b3-da408303f9b4 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:20.416047 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1392/2789] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:20:20 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:20.420392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcfeda-abc2-42b8-8db4-a6a17b89e56c admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:20.431060 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcfeda-abc2-42b8-8db4-a6a17b89e56c admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:20.490720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae40ce-bfef-48f0-bd13-b9385c6999b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:20.491447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae40ce-bfef-48f0-bd13-b9385c6999b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.491716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae40ce-bfef-48f0-bd13-b9385c6999b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.491990 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae40ce-bfef-48f0-bd13-b9385c6999b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.492681 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae40ce-bfef-48f0-bd13-b9385c6999b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:20.494721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae40ce-bfef-48f0-bd13-b9385c6999b3 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:20.520769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1398/2790] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:20:20 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:20.522105 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76a3b5-340e-4c64-b3b3-da408303f9b4 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:20.533273 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76a3b5-340e-4c64-b3b3-da408303f9b4 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:20.538337 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b611e-1072-46bd-81f3-a15f8d2217b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:20.539078 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b611e-1072-46bd-81f3-a15f8d2217b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.539317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b611e-1072-46bd-81f3-a15f8d2217b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.539596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b611e-1072-46bd-81f3-a15f8d2217b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.540327 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b611e-1072-46bd-81f3-a15f8d2217b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:20.541946 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b611e-1072-46bd-81f3-a15f8d2217b2 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:20.552758 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1393/2791] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:20.557139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae40ce-bfef-48f0-bd13-b9385c6999b3 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:20.567536 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae40ce-bfef-48f0-bd13-b9385c6999b3 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:20.573009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74ae1-be3a-4605-aab9-a3cacd60571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:20.573674 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74ae1-be3a-4605-aab9-a3cacd60571b admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.573954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74ae1-be3a-4605-aab9-a3cacd60571b admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.574261 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74ae1-be3a-4605-aab9-a3cacd60571b admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.575007 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e74ae1-be3a-4605-aab9-a3cacd60571b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:20.576706 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e74ae1-be3a-4605-aab9-a3cacd60571b admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:20.587309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1399/2792] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:20.591963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b611e-1072-46bd-81f3-a15f8d2217b2 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:20.607332 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b611e-1072-46bd-81f3-a15f8d2217b2 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:20.613829 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce3806-7a75-453f-9030-d5b4b94bd6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:20.615211 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce3806-7a75-453f-9030-d5b4b94bd6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.615583 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce3806-7a75-453f-9030-d5b4b94bd6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.615938 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce3806-7a75-453f-9030-d5b4b94bd6ba admin admin] PATH_INFO: `/v3/projects/257dce6410494071a537a00dcd2f1b7d/users/d33f77cd8ba24c668d96ac11f3728517/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.632662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce3806-7a75-453f-9030-d5b4b94bd6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=257dce6410494071a537a00dcd2f1b7d, user_id=d33f77cd8ba24c668d96ac11f3728517, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:20.635357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce3806-7a75-453f-9030-d5b4b94bd6ba admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:20.652074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1394/2793] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:20 2022] PUT /identity/v3/projects/257dce6410494071a537a00dcd2f1b7d/users/d33f77cd8ba24c668d96ac11f3728517/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:20:20.662600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af850c-8999-48e4-bfe6-c495ac0db99c None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.662888 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af850c-8999-48e4-bfe6-c495ac0db99c None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.663221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af850c-8999-48e4-bfe6-c495ac0db99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.691089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-c7af850c-8999-48e4-bfe6-c495ac0db99c None None] MFA Rules not processed for user `d33f77cd8ba24c668d96ac11f3728517`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:20.692937 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-c7af850c-8999-48e4-bfe6-c495ac0db99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:20.715692 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:20.761326 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1400/2794] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:20.767524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce3806-7a75-453f-9030-d5b4b94bd6ba admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:20.835600 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce3806-7a75-453f-9030-d5b4b94bd6ba admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:20.841486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7912228-a9b3-4a9a-8706-2fddb35ec331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:20.842145 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7912228-a9b3-4a9a-8706-2fddb35ec331 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.842461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7912228-a9b3-4a9a-8706-2fddb35ec331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.842734 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7912228-a9b3-4a9a-8706-2fddb35ec331 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.843462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7912228-a9b3-4a9a-8706-2fddb35ec331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:20.845408 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7912228-a9b3-4a9a-8706-2fddb35ec331 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:20.872873 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1395/2795] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:20:20 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:20.877111 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af850c-8999-48e4-bfe6-c495ac0db99c None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:20.888109 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af850c-8999-48e4-bfe6-c495ac0db99c None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:20.944002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd7434-5ac6-4b68-8718-ea9bd1016514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:20.944595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd7434-5ac6-4b68-8718-ea9bd1016514 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.944876 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd7434-5ac6-4b68-8718-ea9bd1016514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.945152 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd7434-5ac6-4b68-8718-ea9bd1016514 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.945835 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd7434-5ac6-4b68-8718-ea9bd1016514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:20.947848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd7434-5ac6-4b68-8718-ea9bd1016514 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:20.970165 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1401/2796] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:20:20 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:20.974476 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7912228-a9b3-4a9a-8706-2fddb35ec331 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:20.985409 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7912228-a9b3-4a9a-8706-2fddb35ec331 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:20.990198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaed85-6d9e-4953-842b-2bb5ebaecd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:20.990863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaed85-6d9e-4953-842b-2bb5ebaecd24 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:20.991195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaed85-6d9e-4953-842b-2bb5ebaecd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:20.991471 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaed85-6d9e-4953-842b-2bb5ebaecd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:20.992209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabaed85-6d9e-4953-842b-2bb5ebaecd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:20.993831 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabaed85-6d9e-4953-842b-2bb5ebaecd24 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:21.004315 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1396/2797] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:20:21.008362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd7434-5ac6-4b68-8718-ea9bd1016514 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:21.018969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd7434-5ac6-4b68-8718-ea9bd1016514 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:21.025122 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d942e2-d73a-404d-9365-bb480e52d056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:21.026409 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d942e2-d73a-404d-9365-bb480e52d056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:21.026690 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d942e2-d73a-404d-9365-bb480e52d056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:21.026951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d942e2-d73a-404d-9365-bb480e52d056 admin admin] PATH_INFO: `/v3/projects/8b83f964202343179a351d813ab5a23f/users/63255f44bcb04ebdbefbd7668b809b2f/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:21.042887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d942e2-d73a-404d-9365-bb480e52d056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b83f964202343179a351d813ab5a23f, user_id=63255f44bcb04ebdbefbd7668b809b2f, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:21.045577 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d942e2-d73a-404d-9365-bb480e52d056 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:21.061433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1402/2798] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:21 2022] PUT /identity/v3/projects/8b83f964202343179a351d813ab5a23f/users/63255f44bcb04ebdbefbd7668b809b2f/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:21.065561 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaed85-6d9e-4953-842b-2bb5ebaecd24 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:21.075641 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaed85-6d9e-4953-842b-2bb5ebaecd24 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:21.131937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d9468-d9e8-46d2-acb2-ce95ac870b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:21.132602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d9468-d9e8-46d2-acb2-ce95ac870b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:21.132879 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d9468-d9e8-46d2-acb2-ce95ac870b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:21.133159 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d9468-d9e8-46d2-acb2-ce95ac870b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:21.133885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d9468-d9e8-46d2-acb2-ce95ac870b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:21.135524 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d9468-d9e8-46d2-acb2-ce95ac870b42 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:21.145392 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1397/2799] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:21.150021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d942e2-d73a-404d-9365-bb480e52d056 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:21.161365 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d942e2-d73a-404d-9365-bb480e52d056 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:21.167627 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795e01-6a3b-4955-91a6-4a37e883a416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:21.168529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795e01-6a3b-4955-91a6-4a37e883a416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:21.168807 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795e01-6a3b-4955-91a6-4a37e883a416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:21.169075 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795e01-6a3b-4955-91a6-4a37e883a416 admin admin] PATH_INFO: `/v3/projects/8b83f964202343179a351d813ab5a23f/users/63255f44bcb04ebdbefbd7668b809b2f/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:21.171310 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04795e01-6a3b-4955-91a6-4a37e883a416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b83f964202343179a351d813ab5a23f, user_id=63255f44bcb04ebdbefbd7668b809b2f, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:21.173956 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04795e01-6a3b-4955-91a6-4a37e883a416 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:21.184640 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1403/2800] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:21 2022] PUT /identity/v3/projects/8b83f964202343179a351d813ab5a23f/users/63255f44bcb04ebdbefbd7668b809b2f/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:21.196642 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e51a-b093-4f5a-bc87-e167ca8c3878 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:21.196857 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e51a-b093-4f5a-bc87-e167ca8c3878 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:21.197256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e51a-b093-4f5a-bc87-e167ca8c3878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:21.207648 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:21.228898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-abd8e51a-b093-4f5a-bc87-e167ca8c3878 None None] MFA Rules not processed for user `63255f44bcb04ebdbefbd7668b809b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:21.230114 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-abd8e51a-b093-4f5a-bc87-e167ca8c3878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:21.303970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1398/2801] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:21.315904 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795e01-6a3b-4955-91a6-4a37e883a416 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:21.317913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-04795e01-6a3b-4955-91a6-4a37e883a416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:21.378443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795e01-6a3b-4955-91a6-4a37e883a416 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:21.382389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d3e7-a1f2-410b-9bf0-69543a79b071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:21.383055 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d3e7-a1f2-410b-9bf0-69543a79b071 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:21.383339 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d3e7-a1f2-410b-9bf0-69543a79b071 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:21.383617 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d3e7-a1f2-410b-9bf0-69543a79b071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:21.393223 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466d3e7-a1f2-410b-9bf0-69543a79b071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:21.394655 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466d3e7-a1f2-410b-9bf0-69543a79b071 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:21.405163 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1404/2802] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:21.796983 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8e51a-b093-4f5a-bc87-e167ca8c3878 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:21.866554 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8e51a-b093-4f5a-bc87-e167ca8c3878 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:21.871699 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:21.872585 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:21.872871 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:21.873152 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] PATH_INFO: `/v3/users/d33f77cd8ba24c668d96ac11f3728517` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:21.874357 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33f77cd8ba24c668d96ac11f3728517)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:21.876342 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:21.922617 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33f77cd8ba24c668d96ac11f3728517'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:21.934877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33f77cd8ba24c668d96ac11f3728517'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:21.935596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33f77cd8ba24c668d96ac11f3728517'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:21.942381 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33f77cd8ba24c668d96ac11f3728517'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:21.943036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33f77cd8ba24c668d96ac11f3728517'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:21.957314 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1399/2803] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:20:21 2022] DELETE /identity/v3/users/d33f77cd8ba24c668d96ac11f3728517 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:21.961653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d6f6b-64f5-44d9-8260-588a5f8a0103 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:21.962192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d6f6b-64f5-44d9-8260-588a5f8a0103 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:21.962312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d6f6b-64f5-44d9-8260-588a5f8a0103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:21.983537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-5a7d6f6b-64f5-44d9-8260-588a5f8a0103 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:21.984725 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5a7d6f6b-64f5-44d9-8260-588a5f8a0103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:21.997139 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:22.044689 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1405/2804] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:22.054297 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:22.055923 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:22.068634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:22.118474 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb6e08-5b9d-4716-8a8a-cc9e012d16b0 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:22.123658 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882de924-ff8c-4658-b698-ae8c45622249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:22.124300 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de924-ff8c-4658-b698-ae8c45622249 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:22.124584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de924-ff8c-4658-b698-ae8c45622249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:22.124852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de924-ff8c-4658-b698-ae8c45622249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:22.135091 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882de924-ff8c-4658-b698-ae8c45622249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:22.136535 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882de924-ff8c-4658-b698-ae8c45622249 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:22.146200 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1400/2805] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 26 03:20:22.425938 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d6f6b-64f5-44d9-8260-588a5f8a0103 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:22.427445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-5a7d6f6b-64f5-44d9-8260-588a5f8a0103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:22.443583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d6f6b-64f5-44d9-8260-588a5f8a0103 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:22.448699 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:22.449574 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:22.449886 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:22.450222 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] PATH_INFO: `/v3/projects/257dce6410494071a537a00dcd2f1b7d` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:22.451755 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=257dce6410494071a537a00dcd2f1b7d)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:22.453716 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:22.501111 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257dce6410494071a537a00dcd2f1b7d', 'request_id': 'req-7b5c973a-a29b-4500-b319-9b38111929d8'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:22.507107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257dce6410494071a537a00dcd2f1b7d', 'request_id': 'req-7b5c973a-a29b-4500-b319-9b38111929d8'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:22.516115 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257dce6410494071a537a00dcd2f1b7d', 'request_id': 'req-7b5c973a-a29b-4500-b319-9b38111929d8'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:22.526927 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] The token cache is being invalidate because project 257dce6410494071a537a00dcd2f1b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:20:22.527244 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:22.527849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:22.529419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1406/2806] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:20:22 2022] DELETE /identity/v3/projects/257dce6410494071a537a00dcd2f1b7d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:22.533540 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882de924-ff8c-4658-b698-ae8c45622249 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:22.543513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882de924-ff8c-4658-b698-ae8c45622249 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:22.603985 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8636e1-1ac4-48b3-bce4-dc72f3e6f06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:22.605450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8636e1-1ac4-48b3-bce4-dc72f3e6f06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:22.605930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8636e1-1ac4-48b3-bce4-dc72f3e6f06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:22.606417 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8636e1-1ac4-48b3-bce4-dc72f3e6f06c admin admin] PATH_INFO: `/v3/users/63255f44bcb04ebdbefbd7668b809b2f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:22.608290 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8636e1-1ac4-48b3-bce4-dc72f3e6f06c admin admin] RBAC: Authorizing `identity:delete_user(user_id=63255f44bcb04ebdbefbd7668b809b2f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:22.610246 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8636e1-1ac4-48b3-bce4-dc72f3e6f06c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:22.667691 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0c8636e1-1ac4-48b3-bce4-dc72f3e6f06c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63255f44bcb04ebdbefbd7668b809b2f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:22.681635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0c8636e1-1ac4-48b3-bce4-dc72f3e6f06c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63255f44bcb04ebdbefbd7668b809b2f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:22.682411 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0c8636e1-1ac4-48b3-bce4-dc72f3e6f06c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63255f44bcb04ebdbefbd7668b809b2f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:22.689700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0c8636e1-1ac4-48b3-bce4-dc72f3e6f06c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63255f44bcb04ebdbefbd7668b809b2f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:22.690356 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0c8636e1-1ac4-48b3-bce4-dc72f3e6f06c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63255f44bcb04ebdbefbd7668b809b2f'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:22.704810 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1401/2807] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:20:22 2022] DELETE /identity/v3/users/63255f44bcb04ebdbefbd7668b809b2f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:22.989954 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:22.991709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:23.005949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c973a-a29b-4500-b319-9b38111929d8 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:23.069316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:23.070096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.070376 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.070656 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] PATH_INFO: `/v3/projects/8b83f964202343179a351d813ab5a23f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.071977 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b83f964202343179a351d813ab5a23f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:23.073907 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:23.119713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:23.123604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b83f964202343179a351d813ab5a23f', 'request_id': 'req-5f281890-dc59-44f4-b4c0-a15ef43c8e90'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:23.129813 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b83f964202343179a351d813ab5a23f', 'request_id': 'req-5f281890-dc59-44f4-b4c0-a15ef43c8e90'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:23.138973 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b83f964202343179a351d813ab5a23f', 'request_id': 'req-5f281890-dc59-44f4-b4c0-a15ef43c8e90'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:23.149047 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] The token cache is being invalidate because project 8b83f964202343179a351d813ab5a23f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:20:23.149363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:23.149975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-5f281890-dc59-44f4-b4c0-a15ef43c8e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:23.151918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1407/2808] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:20:22 2022] DELETE /identity/v3/projects/8b83f964202343179a351d813ab5a23f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:23.156986 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c516-d016-4d60-99a2-7bb262dc2f4e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.157480 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c516-d016-4d60-99a2-7bb262dc2f4e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.157581 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c516-d016-4d60-99a2-7bb262dc2f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.175828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ee08c516-d016-4d60-99a2-7bb262dc2f4e None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:23.177023 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ee08c516-d016-4d60-99a2-7bb262dc2f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:23.203005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:23.241165 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1402/2809] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:23.249375 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646394a2-cc3d-4e73-a7a4-5446b5c72787 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.249668 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646394a2-cc3d-4e73-a7a4-5446b5c72787 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.249951 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646394a2-cc3d-4e73-a7a4-5446b5c72787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.268405 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-646394a2-cc3d-4e73-a7a4-5446b5c72787 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:23.269605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-646394a2-cc3d-4e73-a7a4-5446b5c72787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:23.278523 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1408/2810] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:23.282947 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08c516-d016-4d60-99a2-7bb262dc2f4e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:23.293494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08c516-d016-4d60-99a2-7bb262dc2f4e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:23.298461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e428a-e285-451f-aaf2-da9a29d34faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:23.299157 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e428a-e285-451f-aaf2-da9a29d34faf admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.299440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e428a-e285-451f-aaf2-da9a29d34faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.299729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e428a-e285-451f-aaf2-da9a29d34faf admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.300456 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e428a-e285-451f-aaf2-da9a29d34faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:20:23.300763 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e428a-e285-451f-aaf2-da9a29d34faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:23.302421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e428a-e285-451f-aaf2-da9a29d34faf admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:23.314193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1403/2811] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:20:23.318518 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646394a2-cc3d-4e73-a7a4-5446b5c72787 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:23.327863 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646394a2-cc3d-4e73-a7a4-5446b5c72787 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:23.332767 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbe14c-9589-4e66-8333-239bb47e3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:23.333417 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbe14c-9589-4e66-8333-239bb47e3553 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.333736 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbe14c-9589-4e66-8333-239bb47e3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.333985 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbe14c-9589-4e66-8333-239bb47e3553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.334679 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbe14c-9589-4e66-8333-239bb47e3553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:23.336652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbe14c-9589-4e66-8333-239bb47e3553 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:23.373987 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1409/2812] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:20:23 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:23.378610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e428a-e285-451f-aaf2-da9a29d34faf admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:23.388880 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e428a-e285-451f-aaf2-da9a29d34faf admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:23.459308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88978015-99bf-4ef2-9e37-09cd81899b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:23.460298 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88978015-99bf-4ef2-9e37-09cd81899b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.460711 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88978015-99bf-4ef2-9e37-09cd81899b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.461112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88978015-99bf-4ef2-9e37-09cd81899b29 admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.462143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88978015-99bf-4ef2-9e37-09cd81899b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:23.464160 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88978015-99bf-4ef2-9e37-09cd81899b29 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:23.487597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1404/2813] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:20:23 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:23.493857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbe14c-9589-4e66-8333-239bb47e3553 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:23.504933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbe14c-9589-4e66-8333-239bb47e3553 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:23.510419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952cb8d-776d-4149-9e6d-0b2ee84562d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:23.511112 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952cb8d-776d-4149-9e6d-0b2ee84562d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.511392 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952cb8d-776d-4149-9e6d-0b2ee84562d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.511672 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952cb8d-776d-4149-9e6d-0b2ee84562d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.512388 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952cb8d-776d-4149-9e6d-0b2ee84562d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:23.514021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952cb8d-776d-4149-9e6d-0b2ee84562d4 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:23.525595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1410/2814] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:23.530135 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88978015-99bf-4ef2-9e37-09cd81899b29 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:23.540454 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88978015-99bf-4ef2-9e37-09cd81899b29 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:23.545605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e71e6-44c4-4bef-a0ab-2015f8d9c1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:23.546261 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e71e6-44c4-4bef-a0ab-2015f8d9c1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.546544 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e71e6-44c4-4bef-a0ab-2015f8d9c1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.546817 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e71e6-44c4-4bef-a0ab-2015f8d9c1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.547576 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e71e6-44c4-4bef-a0ab-2015f8d9c1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:23.549173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e71e6-44c4-4bef-a0ab-2015f8d9c1d1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:23.559839 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1405/2815] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:23.564560 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952cb8d-776d-4149-9e6d-0b2ee84562d4 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:23.579319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952cb8d-776d-4149-9e6d-0b2ee84562d4 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:23.586040 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d236fc-c743-4408-8a45-1f1960c9d071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:23.587025 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d236fc-c743-4408-8a45-1f1960c9d071 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.587329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d236fc-c743-4408-8a45-1f1960c9d071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.587602 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d236fc-c743-4408-8a45-1f1960c9d071 admin admin] PATH_INFO: `/v3/projects/3508153191714e1888c0280963e904ed/users/05a56a6157da4bec825a7b7bb0cafa87/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.602507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d236fc-c743-4408-8a45-1f1960c9d071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3508153191714e1888c0280963e904ed, user_id=05a56a6157da4bec825a7b7bb0cafa87, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:23.605186 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d236fc-c743-4408-8a45-1f1960c9d071 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:23.619890 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1411/2816] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:23 2022] PUT /identity/v3/projects/3508153191714e1888c0280963e904ed/users/05a56a6157da4bec825a7b7bb0cafa87/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:20:23.630168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd907-3ef8-4236-b9ec-0dd52eca40db None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.630462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd907-3ef8-4236-b9ec-0dd52eca40db None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.630743 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd907-3ef8-4236-b9ec-0dd52eca40db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.659370 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-8e2fd907-3ef8-4236-b9ec-0dd52eca40db None None] MFA Rules not processed for user `05a56a6157da4bec825a7b7bb0cafa87`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:23.660677 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8e2fd907-3ef8-4236-b9ec-0dd52eca40db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:23.725000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1406/2817] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:23.729774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d236fc-c743-4408-8a45-1f1960c9d071 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:23.800459 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d236fc-c743-4408-8a45-1f1960c9d071 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:23.807265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38690332-e6a6-4cc7-9936-d55c1378b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:23.807687 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38690332-e6a6-4cc7-9936-d55c1378b47f admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.807971 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38690332-e6a6-4cc7-9936-d55c1378b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.808250 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38690332-e6a6-4cc7-9936-d55c1378b47f admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.809002 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38690332-e6a6-4cc7-9936-d55c1378b47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:23.811103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38690332-e6a6-4cc7-9936-d55c1378b47f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:23.837743 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1412/2818] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:20:23 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:23.841748 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fd907-3ef8-4236-b9ec-0dd52eca40db None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:23.852670 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fd907-3ef8-4236-b9ec-0dd52eca40db None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:23.876818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:23.910636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef31cd-0714-4f50-80d2-f74ed36bdfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:23.911336 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef31cd-0714-4f50-80d2-f74ed36bdfcd admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.911618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef31cd-0714-4f50-80d2-f74ed36bdfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.911895 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef31cd-0714-4f50-80d2-f74ed36bdfcd admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.912590 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef31cd-0714-4f50-80d2-f74ed36bdfcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:23.914526 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef31cd-0714-4f50-80d2-f74ed36bdfcd admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:23.939045 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1407/2819] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:20:23 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:20:23.941132 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38690332-e6a6-4cc7-9936-d55c1378b47f admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:23.953981 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38690332-e6a6-4cc7-9936-d55c1378b47f admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:23.959659 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8547c3-cd58-4b85-b09d-7aa5a62f9e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:23.960320 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8547c3-cd58-4b85-b09d-7aa5a62f9e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.960606 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8547c3-cd58-4b85-b09d-7aa5a62f9e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.960889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8547c3-cd58-4b85-b09d-7aa5a62f9e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:23.961623 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8547c3-cd58-4b85-b09d-7aa5a62f9e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:23.963303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8547c3-cd58-4b85-b09d-7aa5a62f9e47 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:23.973827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1413/2820] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:23.978026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef31cd-0714-4f50-80d2-f74ed36bdfcd admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:23.988198 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef31cd-0714-4f50-80d2-f74ed36bdfcd admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:23.993968 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bf6b3-50f2-4e7e-b6d8-e53f8668bea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:23.994849 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf6b3-50f2-4e7e-b6d8-e53f8668bea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:23.995172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf6b3-50f2-4e7e-b6d8-e53f8668bea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:23.995446 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf6b3-50f2-4e7e-b6d8-e53f8668bea1 admin admin] PATH_INFO: `/v3/projects/08e9ba19c9424ca687d7359832844229/users/8b364a3d3f014eeb96dd105e095a36dc/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:24.010586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bf6b3-50f2-4e7e-b6d8-e53f8668bea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e9ba19c9424ca687d7359832844229, user_id=8b364a3d3f014eeb96dd105e095a36dc, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:24.013273 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bf6b3-50f2-4e7e-b6d8-e53f8668bea1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:24.027613 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1408/2821] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:23 2022] PUT /identity/v3/projects/08e9ba19c9424ca687d7359832844229/users/8b364a3d3f014eeb96dd105e095a36dc/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:24.033332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8547c3-cd58-4b85-b09d-7aa5a62f9e47 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:24.045975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8547c3-cd58-4b85-b09d-7aa5a62f9e47 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:24.091732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:24.119335 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c8b7a-ce7c-4c80-a13c-5c80d6a2824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:24.120096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c8b7a-ce7c-4c80-a13c-5c80d6a2824f admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:24.120494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c8b7a-ce7c-4c80-a13c-5c80d6a2824f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:24.120849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c8b7a-ce7c-4c80-a13c-5c80d6a2824f admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:24.121966 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c8b7a-ce7c-4c80-a13c-5c80d6a2824f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:24.124580 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c8b7a-ce7c-4c80-a13c-5c80d6a2824f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:24.140567 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1414/2822] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:24.146249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bf6b3-50f2-4e7e-b6d8-e53f8668bea1 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:24.158033 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bf6b3-50f2-4e7e-b6d8-e53f8668bea1 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:24.163769 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352034-1612-4844-92d4-a707167e59f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:24.164683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352034-1612-4844-92d4-a707167e59f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:24.164966 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352034-1612-4844-92d4-a707167e59f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:24.165276 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352034-1612-4844-92d4-a707167e59f5 admin admin] PATH_INFO: `/v3/projects/08e9ba19c9424ca687d7359832844229/users/8b364a3d3f014eeb96dd105e095a36dc/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:24.167755 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67352034-1612-4844-92d4-a707167e59f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e9ba19c9424ca687d7359832844229, user_id=8b364a3d3f014eeb96dd105e095a36dc, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:24.170527 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67352034-1612-4844-92d4-a707167e59f5 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:24.181624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1409/2823] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:24 2022] PUT /identity/v3/projects/08e9ba19c9424ca687d7359832844229/users/8b364a3d3f014eeb96dd105e095a36dc/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:24.193204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b6c9-9dd8-4201-abf5-322d161253d5 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:24.193493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b6c9-9dd8-4201-abf5-322d161253d5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:24.193769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30b6c9-9dd8-4201-abf5-322d161253d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:24.220696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-1e30b6c9-9dd8-4201-abf5-322d161253d5 None None] MFA Rules not processed for user `8b364a3d3f014eeb96dd105e095a36dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:24.221895 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1e30b6c9-9dd8-4201-abf5-322d161253d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:24.302138 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1415/2824] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:24.313776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352034-1612-4844-92d4-a707167e59f5 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:24.315903 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-67352034-1612-4844-92d4-a707167e59f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:24.377538 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352034-1612-4844-92d4-a707167e59f5 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:24.381537 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93d66d-951a-4745-a1ec-bcbc9bac1a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:24.382194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93d66d-951a-4745-a1ec-bcbc9bac1a8a service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:24.382477 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93d66d-951a-4745-a1ec-bcbc9bac1a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:24.382759 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93d66d-951a-4745-a1ec-bcbc9bac1a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:24.396553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93d66d-951a-4745-a1ec-bcbc9bac1a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:24.398023 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93d66d-951a-4745-a1ec-bcbc9bac1a8a service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:24.408914 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1410/2825] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:24.437670 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30b6c9-9dd8-4201-abf5-322d161253d5 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:24.509108 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30b6c9-9dd8-4201-abf5-322d161253d5 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:24.514825 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:24.515762 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:24.516059 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:24.516343 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] PATH_INFO: `/v3/users/05a56a6157da4bec825a7b7bb0cafa87` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:24.517594 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a56a6157da4bec825a7b7bb0cafa87)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:24.519590 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:24.570113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a56a6157da4bec825a7b7bb0cafa87'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:24.582274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a56a6157da4bec825a7b7bb0cafa87'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:24.583967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:24.592308 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a56a6157da4bec825a7b7bb0cafa87'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:24.599578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a56a6157da4bec825a7b7bb0cafa87'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:24.600196 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a56a6157da4bec825a7b7bb0cafa87'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:24.606281 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1416/2826] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:20:24 2022] DELETE /identity/v3/users/05a56a6157da4bec825a7b7bb0cafa87 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:24.611041 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4a20d-b2be-4aff-a33f-55967364c28f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:24.611419 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4a20d-b2be-4aff-a33f-55967364c28f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:24.611749 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4a20d-b2be-4aff-a33f-55967364c28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:24.629725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1ef4a20d-b2be-4aff-a33f-55967364c28f None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:24.630874 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1ef4a20d-b2be-4aff-a33f-55967364c28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:24.693732 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1411/2827] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:24.704291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:24.706790 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:24.787074 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dca46-df11-42b4-b48e-047e4913f0ab admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:24.792848 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58a1a8-425a-4325-bba6-f07d2e214a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:24.793526 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58a1a8-425a-4325-bba6-f07d2e214a0a service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:24.793791 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58a1a8-425a-4325-bba6-f07d2e214a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:24.794084 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58a1a8-425a-4325-bba6-f07d2e214a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:24.804226 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58a1a8-425a-4325-bba6-f07d2e214a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:24.805766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58a1a8-425a-4325-bba6-f07d2e214a0a service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:24.815440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1417/2828] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:25.099082 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4a20d-b2be-4aff-a33f-55967364c28f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:25.100568 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1ef4a20d-b2be-4aff-a33f-55967364c28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:25.113199 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4a20d-b2be-4aff-a33f-55967364c28f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:25.117930 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:25.118860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:25.119162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:25.119452 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] PATH_INFO: `/v3/projects/3508153191714e1888c0280963e904ed` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:25.120633 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3508153191714e1888c0280963e904ed)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:25.122572 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:25.139634 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:25.172441 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3508153191714e1888c0280963e904ed', 'request_id': 'req-abd56e72-3175-4566-9490-c3f32ec86843'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.179045 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3508153191714e1888c0280963e904ed', 'request_id': 'req-abd56e72-3175-4566-9490-c3f32ec86843'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.188724 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3508153191714e1888c0280963e904ed', 'request_id': 'req-abd56e72-3175-4566-9490-c3f32ec86843'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.199036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] The token cache is being invalidate because project 3508153191714e1888c0280963e904ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:20:25.199317 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.199926 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.201481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1412/2829] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:20:25 2022] DELETE /identity/v3/projects/3508153191714e1888c0280963e904ed => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:20:25.205554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58a1a8-425a-4325-bba6-f07d2e214a0a service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:25.215793 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58a1a8-425a-4325-bba6-f07d2e214a0a service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:25.276351 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac8f42-51ed-4933-adc8-a5ee38a36b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:25.277235 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac8f42-51ed-4933-adc8-a5ee38a36b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:25.277519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac8f42-51ed-4933-adc8-a5ee38a36b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:25.277796 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac8f42-51ed-4933-adc8-a5ee38a36b4a admin admin] PATH_INFO: `/v3/users/8b364a3d3f014eeb96dd105e095a36dc` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:25.279097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac8f42-51ed-4933-adc8-a5ee38a36b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b364a3d3f014eeb96dd105e095a36dc)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:25.281033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac8f42-51ed-4933-adc8-a5ee38a36b4a admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:25.331870 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4cac8f42-51ed-4933-adc8-a5ee38a36b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b364a3d3f014eeb96dd105e095a36dc'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.343440 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4cac8f42-51ed-4933-adc8-a5ee38a36b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b364a3d3f014eeb96dd105e095a36dc'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.353676 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4cac8f42-51ed-4933-adc8-a5ee38a36b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b364a3d3f014eeb96dd105e095a36dc'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.360821 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4cac8f42-51ed-4933-adc8-a5ee38a36b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b364a3d3f014eeb96dd105e095a36dc'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.361488 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-4cac8f42-51ed-4933-adc8-a5ee38a36b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b364a3d3f014eeb96dd105e095a36dc'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.367477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1418/2830] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:20:25 2022] DELETE /identity/v3/users/8b364a3d3f014eeb96dd105e095a36dc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:25.645795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:25.647346 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:25.662217 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd56e72-3175-4566-9490-c3f32ec86843 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:25.723074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:25.723881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:25.724158 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:25.724440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] PATH_INFO: `/v3/projects/08e9ba19c9424ca687d7359832844229` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:25.725681 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e9ba19c9424ca687d7359832844229)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:25.727709 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:25.778063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e9ba19c9424ca687d7359832844229', 'request_id': 'req-72102ad7-d683-466e-b577-c8bd5da9c5a4'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.784120 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e9ba19c9424ca687d7359832844229', 'request_id': 'req-72102ad7-d683-466e-b577-c8bd5da9c5a4'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.793072 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e9ba19c9424ca687d7359832844229', 'request_id': 'req-72102ad7-d683-466e-b577-c8bd5da9c5a4'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.805638 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] The token cache is being invalidate because project 08e9ba19c9424ca687d7359832844229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:20:25.805932 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.806610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-72102ad7-d683-466e-b577-c8bd5da9c5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:25.808229 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1413/2831] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:20:25 2022] DELETE /identity/v3/projects/08e9ba19c9424ca687d7359832844229 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:25.813449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4683752-e4ff-42d0-abef-d0bec12848a2 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:25.813742 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4683752-e4ff-42d0-abef-d0bec12848a2 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:25.814035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4683752-e4ff-42d0-abef-d0bec12848a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:25.821700 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:25.835105 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-b4683752-e4ff-42d0-abef-d0bec12848a2 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:25.836551 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-b4683752-e4ff-42d0-abef-d0bec12848a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:25.896849 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1419/2832] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:20:25.906242 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ad987-5874-41b3-8680-7abb36c1b183 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:25.906607 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ad987-5874-41b3-8680-7abb36c1b183 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:25.906898 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ad987-5874-41b3-8680-7abb36c1b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:25.927464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0b0ad987-5874-41b3-8680-7abb36c1b183 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:25.928694 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0b0ad987-5874-41b3-8680-7abb36c1b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:25.938330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1414/2833] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:25.943348 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4683752-e4ff-42d0-abef-d0bec12848a2 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:25.954494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4683752-e4ff-42d0-abef-d0bec12848a2 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:25.960113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06080936-0a94-4ec8-b0c2-073e9389d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:25.960771 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06080936-0a94-4ec8-b0c2-073e9389d7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:25.961057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06080936-0a94-4ec8-b0c2-073e9389d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:25.961329 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06080936-0a94-4ec8-b0c2-073e9389d7c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:25.962053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06080936-0a94-4ec8-b0c2-073e9389d7c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:20:25.962362 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06080936-0a94-4ec8-b0c2-073e9389d7c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:25.964024 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06080936-0a94-4ec8-b0c2-073e9389d7c0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:25.976161 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1420/2834] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:20:25.980513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ad987-5874-41b3-8680-7abb36c1b183 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:25.990039 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ad987-5874-41b3-8680-7abb36c1b183 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:25.995960 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661444a2-8d51-476b-8c8c-9b71bcc2b7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:25.996614 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661444a2-8d51-476b-8c8c-9b71bcc2b7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:25.996888 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661444a2-8d51-476b-8c8c-9b71bcc2b7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:25.997174 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661444a2-8d51-476b-8c8c-9b71bcc2b7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:25.998293 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661444a2-8d51-476b-8c8c-9b71bcc2b7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:26.000284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661444a2-8d51-476b-8c8c-9b71bcc2b7b4 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:26.029131 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1415/2835] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:20:25 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:26.033447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06080936-0a94-4ec8-b0c2-073e9389d7c0 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:26.043930 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06080936-0a94-4ec8-b0c2-073e9389d7c0 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:26.115033 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da413e-a426-4669-a2e6-03616aa80d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:26.115732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da413e-a426-4669-a2e6-03616aa80d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.116016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da413e-a426-4669-a2e6-03616aa80d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.116289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da413e-a426-4669-a2e6-03616aa80d0d admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.116986 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da413e-a426-4669-a2e6-03616aa80d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:26.118952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da413e-a426-4669-a2e6-03616aa80d0d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:26.141017 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1421/2836] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:20:26 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:26.145234 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661444a2-8d51-476b-8c8c-9b71bcc2b7b4 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:26.156191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661444a2-8d51-476b-8c8c-9b71bcc2b7b4 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:26.161050 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02936e5c-0f35-43bb-9202-b06837de438c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:26.161704 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02936e5c-0f35-43bb-9202-b06837de438c admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.161984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02936e5c-0f35-43bb-9202-b06837de438c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.162259 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02936e5c-0f35-43bb-9202-b06837de438c admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.163074 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02936e5c-0f35-43bb-9202-b06837de438c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:26.164674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02936e5c-0f35-43bb-9202-b06837de438c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:26.165976 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:26.177124 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1416/2837] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:26.180685 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da413e-a426-4669-a2e6-03616aa80d0d admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:26.190963 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da413e-a426-4669-a2e6-03616aa80d0d admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:26.196513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20374ad2-ac6b-42b3-ad9d-ec0c2b5e82a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:26.197205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20374ad2-ac6b-42b3-ad9d-ec0c2b5e82a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.197487 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20374ad2-ac6b-42b3-ad9d-ec0c2b5e82a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.197761 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20374ad2-ac6b-42b3-ad9d-ec0c2b5e82a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.198486 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20374ad2-ac6b-42b3-ad9d-ec0c2b5e82a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:26.200133 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20374ad2-ac6b-42b3-ad9d-ec0c2b5e82a7 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:26.210319 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1422/2838] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:26.214701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02936e5c-0f35-43bb-9202-b06837de438c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:26.224818 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02936e5c-0f35-43bb-9202-b06837de438c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:26.230019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e410f58-8447-4570-9c9c-aadcbdbff48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:26.230828 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410f58-8447-4570-9c9c-aadcbdbff48a admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.231137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410f58-8447-4570-9c9c-aadcbdbff48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.231416 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410f58-8447-4570-9c9c-aadcbdbff48a admin admin] PATH_INFO: `/v3/projects/070b75215d3d491fb8de078441e9259b/users/8727d858648a425d850a9e57a1f810ff/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.246667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e410f58-8447-4570-9c9c-aadcbdbff48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=070b75215d3d491fb8de078441e9259b, user_id=8727d858648a425d850a9e57a1f810ff, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:26.249361 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e410f58-8447-4570-9c9c-aadcbdbff48a admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:26.266166 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1417/2839] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:26 2022] PUT /identity/v3/projects/070b75215d3d491fb8de078441e9259b/users/8727d858648a425d850a9e57a1f810ff/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:20:26.276871 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda25f15-e592-4530-a7bc-d306cfb873fc None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.277159 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda25f15-e592-4530-a7bc-d306cfb873fc None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.277433 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda25f15-e592-4530-a7bc-d306cfb873fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.305630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-bda25f15-e592-4530-a7bc-d306cfb873fc None None] MFA Rules not processed for user `8727d858648a425d850a9e57a1f810ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:26.306839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-bda25f15-e592-4530-a7bc-d306cfb873fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:26.371757 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:26.375827 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1423/2840] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:26.381249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e410f58-8447-4570-9c9c-aadcbdbff48a admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:26.469773 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e410f58-8447-4570-9c9c-aadcbdbff48a admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:26.476341 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721e30d-0eec-4d59-8418-455710105b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:26.477019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721e30d-0eec-4d59-8418-455710105b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.477303 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721e30d-0eec-4d59-8418-455710105b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.477587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721e30d-0eec-4d59-8418-455710105b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.478304 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721e30d-0eec-4d59-8418-455710105b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:26.480323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721e30d-0eec-4d59-8418-455710105b56 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:26.508465 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1418/2841] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:20:26 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:20:26.512763 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda25f15-e592-4530-a7bc-d306cfb873fc None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:26.526708 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda25f15-e592-4530-a7bc-d306cfb873fc None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:26.585239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73adb7-edd7-494a-afed-ae1e8c9c0413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:26.586053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73adb7-edd7-494a-afed-ae1e8c9c0413 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.586347 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73adb7-edd7-494a-afed-ae1e8c9c0413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.586780 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73adb7-edd7-494a-afed-ae1e8c9c0413 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.587495 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73adb7-edd7-494a-afed-ae1e8c9c0413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:26.589467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73adb7-edd7-494a-afed-ae1e8c9c0413 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:26.610564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1424/2842] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:20:26 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 26 03:20:26.614808 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721e30d-0eec-4d59-8418-455710105b56 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:26.625663 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721e30d-0eec-4d59-8418-455710105b56 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:26.631301 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616509-c603-490e-9267-ce4881830cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:26.631964 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616509-c603-490e-9267-ce4881830cff admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.632248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616509-c603-490e-9267-ce4881830cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.632495 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616509-c603-490e-9267-ce4881830cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.633248 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96616509-c603-490e-9267-ce4881830cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:26.634868 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96616509-c603-490e-9267-ce4881830cff admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:26.645787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1419/2843] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:26.649962 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73adb7-edd7-494a-afed-ae1e8c9c0413 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:26.660843 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73adb7-edd7-494a-afed-ae1e8c9c0413 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:26.665970 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611f62-f4f0-48fa-a90b-e3101aebcd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:26.666881 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611f62-f4f0-48fa-a90b-e3101aebcd93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.667192 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611f62-f4f0-48fa-a90b-e3101aebcd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.667470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611f62-f4f0-48fa-a90b-e3101aebcd93 admin admin] PATH_INFO: `/v3/projects/ed425b9a29544b3694e656716ca866c2/users/2abdc9ef99be4429a09a7db484a900eb/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.681983 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1611f62-f4f0-48fa-a90b-e3101aebcd93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed425b9a29544b3694e656716ca866c2, user_id=2abdc9ef99be4429a09a7db484a900eb, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:26.684723 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1611f62-f4f0-48fa-a90b-e3101aebcd93 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:26.700997 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1425/2844] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:26 2022] PUT /identity/v3/projects/ed425b9a29544b3694e656716ca866c2/users/2abdc9ef99be4429a09a7db484a900eb/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:26.705041 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616509-c603-490e-9267-ce4881830cff admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:26.715202 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616509-c603-490e-9267-ce4881830cff admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:26.788858 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf54d63-e155-48a4-b1bb-21033f4d4213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:26.789532 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf54d63-e155-48a4-b1bb-21033f4d4213 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.789813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf54d63-e155-48a4-b1bb-21033f4d4213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.790181 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf54d63-e155-48a4-b1bb-21033f4d4213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.791024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf54d63-e155-48a4-b1bb-21033f4d4213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:26.792655 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf54d63-e155-48a4-b1bb-21033f4d4213 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:26.804609 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1420/2845] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:26.808957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611f62-f4f0-48fa-a90b-e3101aebcd93 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:26.819527 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611f62-f4f0-48fa-a90b-e3101aebcd93 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:26.825198 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f61e94-2816-47ea-b6ee-4b311779b6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:26.826089 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61e94-2816-47ea-b6ee-4b311779b6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.826381 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61e94-2816-47ea-b6ee-4b311779b6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.826661 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f61e94-2816-47ea-b6ee-4b311779b6f1 admin admin] PATH_INFO: `/v3/projects/ed425b9a29544b3694e656716ca866c2/users/2abdc9ef99be4429a09a7db484a900eb/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.828879 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f61e94-2816-47ea-b6ee-4b311779b6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed425b9a29544b3694e656716ca866c2, user_id=2abdc9ef99be4429a09a7db484a900eb, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:26.831572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f61e94-2816-47ea-b6ee-4b311779b6f1 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:26.841882 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1426/2846] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:26 2022] PUT /identity/v3/projects/ed425b9a29544b3694e656716ca866c2/users/2abdc9ef99be4429a09a7db484a900eb/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:26.853228 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379829bc-9b61-4cd8-8563-e03ccfe8ae0f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:26.853519 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379829bc-9b61-4cd8-8563-e03ccfe8ae0f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:26.853803 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379829bc-9b61-4cd8-8563-e03ccfe8ae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:26.881464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-379829bc-9b61-4cd8-8563-e03ccfe8ae0f None None] MFA Rules not processed for user `2abdc9ef99be4429a09a7db484a900eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:26.882672 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-379829bc-9b61-4cd8-8563-e03ccfe8ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:26.919002 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:26.957485 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1421/2847] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:26.968778 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f61e94-2816-47ea-b6ee-4b311779b6f1 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:26.970869 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-20f61e94-2816-47ea-b6ee-4b311779b6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:27.029341 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f61e94-2816-47ea-b6ee-4b311779b6f1 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:27.033476 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d632bd-c821-4f94-91c4-7a0828708f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:27.034117 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d632bd-c821-4f94-91c4-7a0828708f8d service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:27.034401 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d632bd-c821-4f94-91c4-7a0828708f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:27.034675 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d632bd-c821-4f94-91c4-7a0828708f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:27.044012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d632bd-c821-4f94-91c4-7a0828708f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:27.045389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d632bd-c821-4f94-91c4-7a0828708f8d service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:27.054578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1427/2848] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:27.111100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379829bc-9b61-4cd8-8563-e03ccfe8ae0f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:27.112618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-379829bc-9b61-4cd8-8563-e03ccfe8ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:27.125787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379829bc-9b61-4cd8-8563-e03ccfe8ae0f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:27.130295 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0b277-ff95-4a68-ae5f-7648ed4170b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:27.130939 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0b277-ff95-4a68-ae5f-7648ed4170b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:27.131255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0b277-ff95-4a68-ae5f-7648ed4170b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:27.131530 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0b277-ff95-4a68-ae5f-7648ed4170b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:27.191580 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0b277-ff95-4a68-ae5f-7648ed4170b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:27.193029 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0b277-ff95-4a68-ae5f-7648ed4170b8 service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:27.202012 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1422/2849] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:30.544651 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d632bd-c821-4f94-91c4-7a0828708f8d service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:30.603927 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:30.610185 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d632bd-c821-4f94-91c4-7a0828708f8d service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:30.615097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:30.615982 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:30.616262 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:30.616537 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] PATH_INFO: `/v3/users/8727d858648a425d850a9e57a1f810ff` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:30.617728 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8727d858648a425d850a9e57a1f810ff)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:30.619753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:30.671072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8727d858648a425d850a9e57a1f810ff'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:30.682839 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8727d858648a425d850a9e57a1f810ff'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:30.691053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8727d858648a425d850a9e57a1f810ff'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:30.697996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8727d858648a425d850a9e57a1f810ff'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:30.698717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8727d858648a425d850a9e57a1f810ff'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:30.704546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1428/2850] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:20:30 2022] DELETE /identity/v3/users/8727d858648a425d850a9e57a1f810ff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:30.709296 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83634dc-c82d-412b-9a30-fc304c5a9309 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:30.709796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83634dc-c82d-412b-9a30-fc304c5a9309 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:30.709907 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83634dc-c82d-412b-9a30-fc304c5a9309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:30.727141 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f83634dc-c82d-412b-9a30-fc304c5a9309 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:30.728450 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f83634dc-c82d-412b-9a30-fc304c5a9309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:30.794056 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1423/2851] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:30.803942 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:30.805596 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:30.873220 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8187ba-5f56-4bc9-8cad-f4745a394c5f admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:30.877194 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dc66a-45b2-49e3-82c2-d873f4c603c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:30.877838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dc66a-45b2-49e3-82c2-d873f4c603c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:30.878118 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dc66a-45b2-49e3-82c2-d873f4c603c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:30.878394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dc66a-45b2-49e3-82c2-d873f4c603c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:30.888018 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dc66a-45b2-49e3-82c2-d873f4c603c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:30.889471 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dc66a-45b2-49e3-82c2-d873f4c603c2 service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:30.900625 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1429/2852] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:31.173586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83634dc-c82d-412b-9a30-fc304c5a9309 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:31.175245 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f83634dc-c82d-412b-9a30-fc304c5a9309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:31.187650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83634dc-c82d-412b-9a30-fc304c5a9309 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:31.193100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:31.193963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:31.194279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:31.194552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] PATH_INFO: `/v3/projects/070b75215d3d491fb8de078441e9259b` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:31.196350 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070b75215d3d491fb8de078441e9259b)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:31.198343 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:31.246224 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070b75215d3d491fb8de078441e9259b', 'request_id': 'req-0a1fbcf4-2671-4896-a759-3cef4144d5c8'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.252562 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070b75215d3d491fb8de078441e9259b', 'request_id': 'req-0a1fbcf4-2671-4896-a759-3cef4144d5c8'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.261143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070b75215d3d491fb8de078441e9259b', 'request_id': 'req-0a1fbcf4-2671-4896-a759-3cef4144d5c8'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.262413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:31.274194 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] The token cache is being invalidate because project 070b75215d3d491fb8de078441e9259b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:20:31.274531 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.275193 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.277125 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1424/2853] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:20:31 2022] DELETE /identity/v3/projects/070b75215d3d491fb8de078441e9259b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:31.281304 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dc66a-45b2-49e3-82c2-d873f4c603c2 service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:31.291427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dc66a-45b2-49e3-82c2-d873f4c603c2 service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:31.351301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94006491-99b2-44d1-a0f0-7de93d95faa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:31.352179 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006491-99b2-44d1-a0f0-7de93d95faa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:31.352449 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006491-99b2-44d1-a0f0-7de93d95faa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:31.352779 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006491-99b2-44d1-a0f0-7de93d95faa0 admin admin] PATH_INFO: `/v3/users/2abdc9ef99be4429a09a7db484a900eb` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:31.354020 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94006491-99b2-44d1-a0f0-7de93d95faa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2abdc9ef99be4429a09a7db484a900eb)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:31.356030 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94006491-99b2-44d1-a0f0-7de93d95faa0 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:31.377713 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:31.406301 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-94006491-99b2-44d1-a0f0-7de93d95faa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2abdc9ef99be4429a09a7db484a900eb'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.418764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-94006491-99b2-44d1-a0f0-7de93d95faa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2abdc9ef99be4429a09a7db484a900eb'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.427605 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-94006491-99b2-44d1-a0f0-7de93d95faa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2abdc9ef99be4429a09a7db484a900eb'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.435058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-94006491-99b2-44d1-a0f0-7de93d95faa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2abdc9ef99be4429a09a7db484a900eb'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.435737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-94006491-99b2-44d1-a0f0-7de93d95faa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2abdc9ef99be4429a09a7db484a900eb'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.441739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1430/2854] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:20:31 2022] DELETE /identity/v3/users/2abdc9ef99be4429a09a7db484a900eb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:31.713504 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:31.715137 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:31.728551 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fbcf4-2671-4896-a759-3cef4144d5c8 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:31.789175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:31.790147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:31.790432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:31.790712 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] PATH_INFO: `/v3/projects/ed425b9a29544b3694e656716ca866c2` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:31.791962 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed425b9a29544b3694e656716ca866c2)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:31.794368 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:31.847700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed425b9a29544b3694e656716ca866c2', 'request_id': 'req-53210977-0410-45e5-86dc-3756da130f62'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.854334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed425b9a29544b3694e656716ca866c2', 'request_id': 'req-53210977-0410-45e5-86dc-3756da130f62'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.865121 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed425b9a29544b3694e656716ca866c2', 'request_id': 'req-53210977-0410-45e5-86dc-3756da130f62'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.876175 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] The token cache is being invalidate because project ed425b9a29544b3694e656716ca866c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:20:31.876461 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.877069 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-53210977-0410-45e5-86dc-3756da130f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:31.878676 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1425/2855] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:20:31 2022] DELETE /identity/v3/projects/ed425b9a29544b3694e656716ca866c2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:31.883768 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12480d-a664-4884-8e72-a22f14102ece None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:31.884257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12480d-a664-4884-8e72-a22f14102ece None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:31.884352 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12480d-a664-4884-8e72-a22f14102ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:31.902911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-db12480d-a664-4884-8e72-a22f14102ece None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:31.904221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-db12480d-a664-4884-8e72-a22f14102ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:31.966064 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1431/2856] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:31.974948 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4643e-c035-4ac2-9080-c2a85d6692a0 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:31.975323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4643e-c035-4ac2-9080-c2a85d6692a0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:31.975733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4643e-c035-4ac2-9080-c2a85d6692a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:31.996071 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-d6a4643e-c035-4ac2-9080-c2a85d6692a0 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:31.997284 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d6a4643e-c035-4ac2-9080-c2a85d6692a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:32.006970 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1426/2857] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:32.011603 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12480d-a664-4884-8e72-a22f14102ece None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:32.021829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12480d-a664-4884-8e72-a22f14102ece None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:32.027671 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683990c-fcc6-4027-ad1b-a79bfe9fdae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:32.028327 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683990c-fcc6-4027-ad1b-a79bfe9fdae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.028607 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683990c-fcc6-4027-ad1b-a79bfe9fdae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.028883 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683990c-fcc6-4027-ad1b-a79bfe9fdae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.029600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683990c-fcc6-4027-ad1b-a79bfe9fdae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80129) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:20:32.029910 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683990c-fcc6-4027-ad1b-a79bfe9fdae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:32.031582 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683990c-fcc6-4027-ad1b-a79bfe9fdae6 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:32.043711 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1432/2858] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:20:32.048019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4643e-c035-4ac2-9080-c2a85d6692a0 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:32.057587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4643e-c035-4ac2-9080-c2a85d6692a0 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:32.063658 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a74a0-5397-4d12-b41a-82bd02d188d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:32.064291 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a74a0-5397-4d12-b41a-82bd02d188d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.064567 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a74a0-5397-4d12-b41a-82bd02d188d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.064840 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a74a0-5397-4d12-b41a-82bd02d188d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.065517 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a74a0-5397-4d12-b41a-82bd02d188d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:32.067457 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a74a0-5397-4d12-b41a-82bd02d188d1 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:32.096153 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1427/2859] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:20:32 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:32.100464 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683990c-fcc6-4027-ad1b-a79bfe9fdae6 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:32.110952 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683990c-fcc6-4027-ad1b-a79bfe9fdae6 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:32.167616 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d9609-b800-423f-a21f-c52032442d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:32.168274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9609-b800-423f-a21f-c52032442d0e admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.168554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9609-b800-423f-a21f-c52032442d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.168833 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9609-b800-423f-a21f-c52032442d0e admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.169504 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d9609-b800-423f-a21f-c52032442d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:32.171480 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d9609-b800-423f-a21f-c52032442d0e admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:32.191683 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1433/2860] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:20:32 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:32.196051 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a74a0-5397-4d12-b41a-82bd02d188d1 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:32.206717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a74a0-5397-4d12-b41a-82bd02d188d1 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:32.212425 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c15c86-0d1b-40df-a214-ecbd8c5ce030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:32.213113 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c15c86-0d1b-40df-a214-ecbd8c5ce030 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.213378 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c15c86-0d1b-40df-a214-ecbd8c5ce030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.213650 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c15c86-0d1b-40df-a214-ecbd8c5ce030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.214380 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c15c86-0d1b-40df-a214-ecbd8c5ce030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:32.216026 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c15c86-0d1b-40df-a214-ecbd8c5ce030 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:32.226581 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1428/2861] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:32.230733 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d9609-b800-423f-a21f-c52032442d0e admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:32.240709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d9609-b800-423f-a21f-c52032442d0e admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:32.245557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2dcf6-1a47-4c5c-a74e-4e642c096bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:32.246212 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dcf6-1a47-4c5c-a74e-4e642c096bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.246477 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dcf6-1a47-4c5c-a74e-4e642c096bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.246750 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dcf6-1a47-4c5c-a74e-4e642c096bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.247513 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2dcf6-1a47-4c5c-a74e-4e642c096bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:32.249107 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2dcf6-1a47-4c5c-a74e-4e642c096bd8 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:32.259012 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1434/2862] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:32.263131 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c15c86-0d1b-40df-a214-ecbd8c5ce030 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:32.273197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c15c86-0d1b-40df-a214-ecbd8c5ce030 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:32.278611 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ac73-cb06-4753-9e4e-3b74ab665936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:32.279582 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ac73-cb06-4753-9e4e-3b74ab665936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.279863 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ac73-cb06-4753-9e4e-3b74ab665936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.280140 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ac73-cb06-4753-9e4e-3b74ab665936 admin admin] PATH_INFO: `/v3/projects/8e6bbd44cc2545fc8e20e5fed56e8205/users/61c06089cb824dfca415347b68cf38de/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.294478 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578ac73-cb06-4753-9e4e-3b74ab665936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6bbd44cc2545fc8e20e5fed56e8205, user_id=61c06089cb824dfca415347b68cf38de, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:32.297163 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578ac73-cb06-4753-9e4e-3b74ab665936 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:32.312852 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1429/2863] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:32 2022] PUT /identity/v3/projects/8e6bbd44cc2545fc8e20e5fed56e8205/users/61c06089cb824dfca415347b68cf38de/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:32.324431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ba78-8b29-4c32-ae80-01101f4b73b1 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.324721 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ba78-8b29-4c32-ae80-01101f4b73b1 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.324996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ba78-8b29-4c32-ae80-01101f4b73b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.331231 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:32.354515 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-60a7ba78-8b29-4c32-ae80-01101f4b73b1 None None] MFA Rules not processed for user `61c06089cb824dfca415347b68cf38de`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:32.355781 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-60a7ba78-8b29-4c32-ae80-01101f4b73b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:32.421553 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1435/2864] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:32.428143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ac73-cb06-4753-9e4e-3b74ab665936 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:32.448207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:32.497925 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ac73-cb06-4753-9e4e-3b74ab665936 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:32.502761 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ad57b-ed5e-4c1b-97fa-92f4405f3c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:32.503462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad57b-ed5e-4c1b-97fa-92f4405f3c3b admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.503747 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad57b-ed5e-4c1b-97fa-92f4405f3c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.504042 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ad57b-ed5e-4c1b-97fa-92f4405f3c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.504733 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ad57b-ed5e-4c1b-97fa-92f4405f3c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:32.506770 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ad57b-ed5e-4c1b-97fa-92f4405f3c3b admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:32.534387 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1430/2865] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:20:32 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:32.538629 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7ba78-8b29-4c32-ae80-01101f4b73b1 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:32.550011 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7ba78-8b29-4c32-ae80-01101f4b73b1 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:32.611988 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d0974-573d-4a7e-aa62-d9fd384f7854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:32.612696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0974-573d-4a7e-aa62-d9fd384f7854 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.612983 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0974-573d-4a7e-aa62-d9fd384f7854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.613263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d0974-573d-4a7e-aa62-d9fd384f7854 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.613965 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d0974-573d-4a7e-aa62-d9fd384f7854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:32.615961 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d0974-573d-4a7e-aa62-d9fd384f7854 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:32.638533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1436/2866] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:20:32 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:32.642596 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ad57b-ed5e-4c1b-97fa-92f4405f3c3b admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:32.653587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ad57b-ed5e-4c1b-97fa-92f4405f3c3b admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:32.658541 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7fcbf-9624-4e4d-aaf7-ba445b242804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:32.659230 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7fcbf-9624-4e4d-aaf7-ba445b242804 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.659516 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7fcbf-9624-4e4d-aaf7-ba445b242804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.659860 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7fcbf-9624-4e4d-aaf7-ba445b242804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.660592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7fcbf-9624-4e4d-aaf7-ba445b242804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:32.662209 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7fcbf-9624-4e4d-aaf7-ba445b242804 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:32.673123 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1431/2867] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:32.676975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d0974-573d-4a7e-aa62-d9fd384f7854 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:32.687213 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d0974-573d-4a7e-aa62-d9fd384f7854 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:32.692079 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5b634-1ec6-48da-a853-92d7c5cddc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:32.692733 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5b634-1ec6-48da-a853-92d7c5cddc92 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.693016 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5b634-1ec6-48da-a853-92d7c5cddc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.693290 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5b634-1ec6-48da-a853-92d7c5cddc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.694043 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5b634-1ec6-48da-a853-92d7c5cddc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:32.695698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5b634-1ec6-48da-a853-92d7c5cddc92 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:32.705630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1437/2868] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:32.709439 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7fcbf-9624-4e4d-aaf7-ba445b242804 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:32.719216 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7fcbf-9624-4e4d-aaf7-ba445b242804 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:32.724459 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46cb69-d476-4f35-ab9a-e5f1a90f11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:32.725340 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46cb69-d476-4f35-ab9a-e5f1a90f11f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.725623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46cb69-d476-4f35-ab9a-e5f1a90f11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.725897 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46cb69-d476-4f35-ab9a-e5f1a90f11f7 admin admin] PATH_INFO: `/v3/projects/3e4608e9988e403cb2851bc2242b2068/users/3815ff995257437d93e2cb3842e312a5/roles/729faf69df60450caeada9c53520224f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.740951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46cb69-d476-4f35-ab9a-e5f1a90f11f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4608e9988e403cb2851bc2242b2068, user_id=3815ff995257437d93e2cb3842e312a5, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:32.743657 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46cb69-d476-4f35-ab9a-e5f1a90f11f7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:32.758550 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1432/2869] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:32 2022] PUT /identity/v3/projects/3e4608e9988e403cb2851bc2242b2068/users/3815ff995257437d93e2cb3842e312a5/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:20:32.820959 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a1ab7-5c6c-4f20-b543-a712f85fc0a5 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:32.821257 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a1ab7-5c6c-4f20-b543-a712f85fc0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:32.821554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a1ab7-5c6c-4f20-b543-a712f85fc0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:32.860443 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-3f1a1ab7-5c6c-4f20-b543-a712f85fc0a5 None None] MFA Rules not processed for user `3815ff995257437d93e2cb3842e312a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:32.861667 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-3f1a1ab7-5c6c-4f20-b543-a712f85fc0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:32.924914 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:32.928931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1438/2870] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:32.933864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46cb69-d476-4f35-ab9a-e5f1a90f11f7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:33.007334 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46cb69-d476-4f35-ab9a-e5f1a90f11f7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:33.013795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f70953-8a93-42b0-87eb-a7b203bff5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:33.014396 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70953-8a93-42b0-87eb-a7b203bff5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:33.014679 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70953-8a93-42b0-87eb-a7b203bff5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:33.014953 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70953-8a93-42b0-87eb-a7b203bff5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:33.015688 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f70953-8a93-42b0-87eb-a7b203bff5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:33.017623 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f70953-8a93-42b0-87eb-a7b203bff5f5 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:33.045483 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1433/2871] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:20:32 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:33.049911 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a1ab7-5c6c-4f20-b543-a712f85fc0a5 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:33.061218 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a1ab7-5c6c-4f20-b543-a712f85fc0a5 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:33.116753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb6c26-4e35-411b-91d7-2ac8c36232a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:33.117415 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6c26-4e35-411b-91d7-2ac8c36232a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:33.117694 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6c26-4e35-411b-91d7-2ac8c36232a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:33.117969 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6c26-4e35-411b-91d7-2ac8c36232a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:33.118717 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb6c26-4e35-411b-91d7-2ac8c36232a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:33.120764 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb6c26-4e35-411b-91d7-2ac8c36232a9 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:33.141765 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1439/2872] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:20:33 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:33.145813 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f70953-8a93-42b0-87eb-a7b203bff5f5 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:33.157173 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f70953-8a93-42b0-87eb-a7b203bff5f5 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:33.162581 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1f92d-b63e-40a0-8772-8e060ac75265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:33.163289 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1f92d-b63e-40a0-8772-8e060ac75265 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:33.163608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1f92d-b63e-40a0-8772-8e060ac75265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:33.163889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1f92d-b63e-40a0-8772-8e060ac75265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:33.164619 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1f92d-b63e-40a0-8772-8e060ac75265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:33.166275 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1f92d-b63e-40a0-8772-8e060ac75265 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:33.177544 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1434/2873] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:20:33.181792 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb6c26-4e35-411b-91d7-2ac8c36232a9 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:33.192291 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb6c26-4e35-411b-91d7-2ac8c36232a9 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:33.197546 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c47d-61c8-458a-a266-175c5ee27211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:33.198462 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c47d-61c8-458a-a266-175c5ee27211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:33.198739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c47d-61c8-458a-a266-175c5ee27211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:33.199008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c47d-61c8-458a-a266-175c5ee27211 admin admin] PATH_INFO: `/v3/projects/16c8782a06bc43af9c65872ca2e2b746/users/f2435eab6b32439bbf346c5de3fcb73c/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:33.214097 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2c47d-61c8-458a-a266-175c5ee27211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c8782a06bc43af9c65872ca2e2b746, user_id=f2435eab6b32439bbf346c5de3fcb73c, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:33.216828 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2c47d-61c8-458a-a266-175c5ee27211 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:33.231198 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1440/2874] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:33 2022] PUT /identity/v3/projects/16c8782a06bc43af9c65872ca2e2b746/users/f2435eab6b32439bbf346c5de3fcb73c/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:33.235118 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1f92d-b63e-40a0-8772-8e060ac75265 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:33.245424 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1f92d-b63e-40a0-8772-8e060ac75265 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:33.284560 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:33.306589 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b9d42-3370-4704-8530-881332d4b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:33.307299 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9d42-3370-4704-8530-881332d4b410 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:33.307591 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9d42-3370-4704-8530-881332d4b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:33.307875 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9d42-3370-4704-8530-881332d4b410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:33.308605 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b9d42-3370-4704-8530-881332d4b410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:33.310218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b9d42-3370-4704-8530-881332d4b410 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:33.320448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1435/2875] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 26 03:20:33.324758 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c47d-61c8-458a-a266-175c5ee27211 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:33.335305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c47d-61c8-458a-a266-175c5ee27211 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:33.340311 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58852b0-8c6e-485f-958a-ef5d5f07cc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:33.341200 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58852b0-8c6e-485f-958a-ef5d5f07cc63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:33.341484 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58852b0-8c6e-485f-958a-ef5d5f07cc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:33.341760 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58852b0-8c6e-485f-958a-ef5d5f07cc63 admin admin] PATH_INFO: `/v3/projects/16c8782a06bc43af9c65872ca2e2b746/users/f2435eab6b32439bbf346c5de3fcb73c/roles/a2abb9e58ac7444ca36727a2bc258f58` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:33.343887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58852b0-8c6e-485f-958a-ef5d5f07cc63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c8782a06bc43af9c65872ca2e2b746, user_id=f2435eab6b32439bbf346c5de3fcb73c, role_id=a2abb9e58ac7444ca36727a2bc258f58)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:33.346600 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58852b0-8c6e-485f-958a-ef5d5f07cc63 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:33.357204 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1441/2876] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:33 2022] PUT /identity/v3/projects/16c8782a06bc43af9c65872ca2e2b746/users/f2435eab6b32439bbf346c5de3fcb73c/roles/a2abb9e58ac7444ca36727a2bc258f58 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:33.370836 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876287-39a4-4ace-8b84-648bdf572d3d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:33.371170 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876287-39a4-4ace-8b84-648bdf572d3d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:33.371455 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876287-39a4-4ace-8b84-648bdf572d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:33.398383 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2e876287-39a4-4ace-8b84-648bdf572d3d None None] MFA Rules not processed for user `f2435eab6b32439bbf346c5de3fcb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:33.399729 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2e876287-39a4-4ace-8b84-648bdf572d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:33.469191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1436/2877] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:33.480479 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58852b0-8c6e-485f-958a-ef5d5f07cc63 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:33.482246 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a58852b0-8c6e-485f-958a-ef5d5f07cc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:33.541739 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58852b0-8c6e-485f-958a-ef5d5f07cc63 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:33.545673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a226-c81a-461f-9a06-d5f5d5e62c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:33.546316 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a226-c81a-461f-9a06-d5f5d5e62c7c service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:33.546595 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a226-c81a-461f-9a06-d5f5d5e62c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:33.546873 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a226-c81a-461f-9a06-d5f5d5e62c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:33.603927 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60a226-c81a-461f-9a06-d5f5d5e62c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:33.605389 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60a226-c81a-461f-9a06-d5f5d5e62c7c service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:33.614498 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1442/2878] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:35.126354 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876287-39a4-4ace-8b84-648bdf572d3d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:35.128022 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2e876287-39a4-4ace-8b84-648bdf572d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:35.141231 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876287-39a4-4ace-8b84-648bdf572d3d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:35.145916 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138ce6b-dc70-45b7-b3d1-84da651dc0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:35.146608 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ce6b-dc70-45b7-b3d1-84da651dc0ac service cinder] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:35.146867 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ce6b-dc70-45b7-b3d1-84da651dc0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:35.147207 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ce6b-dc70-45b7-b3d1-84da651dc0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:35.206838 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138ce6b-dc70-45b7-b3d1-84da651dc0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:35.208257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138ce6b-dc70-45b7-b3d1-84da651dc0ac service cinder] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:35.217584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1437/2879] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:35.763766 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a226-c81a-461f-9a06-d5f5d5e62c7c service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:35.772958 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a226-c81a-461f-9a06-d5f5d5e62c7c service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:35.778032 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f05c0-6e93-4587-90c6-b56a13c54fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:35.778670 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f05c0-6e93-4587-90c6-b56a13c54fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:35.778949 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f05c0-6e93-4587-90c6-b56a13c54fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:35.779250 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f05c0-6e93-4587-90c6-b56a13c54fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:35.786009 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:35.791831 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f05c0-6e93-4587-90c6-b56a13c54fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:35.793419 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f05c0-6e93-4587-90c6-b56a13c54fc5 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:35.803967 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1443/2880] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:39.710913 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138ce6b-dc70-45b7-b3d1-84da651dc0ac service cinder] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:39.784192 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138ce6b-dc70-45b7-b3d1-84da651dc0ac service cinder] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:39.789552 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:39.790431 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:39.790708 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:39.791007 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] PATH_INFO: `/v3/users/61c06089cb824dfca415347b68cf38de` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:39.792335 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c06089cb824dfca415347b68cf38de)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:39.794254 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:39.795899 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=100 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:39.843278 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c06089cb824dfca415347b68cf38de'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:39.857513 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c06089cb824dfca415347b68cf38de'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:39.858372 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c06089cb824dfca415347b68cf38de'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:39.868893 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c06089cb824dfca415347b68cf38de'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:39.869621 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c06089cb824dfca415347b68cf38de'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:39.887463 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1438/2881] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:20:39 2022] DELETE /identity/v3/users/61c06089cb824dfca415347b68cf38de => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:39.891841 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77194b9c-a50a-4283-8cd6-10dbacd53920 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:39.892360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77194b9c-a50a-4283-8cd6-10dbacd53920 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:39.892360 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77194b9c-a50a-4283-8cd6-10dbacd53920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:39.910382 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-77194b9c-a50a-4283-8cd6-10dbacd53920 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:39.911663 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-77194b9c-a50a-4283-8cd6-10dbacd53920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:39.992250 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1444/2882] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:40.003701 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:40.005218 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:40.064906 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e57a4-fd4f-445c-87e4-9fbb17686b16 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:40.069714 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166537c-95c1-4ae8-adc4-670aab60b3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:40.070597 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166537c-95c1-4ae8-adc4-670aab60b3df service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:40.070877 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166537c-95c1-4ae8-adc4-670aab60b3df service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:40.071167 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166537c-95c1-4ae8-adc4-670aab60b3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:40.081377 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166537c-95c1-4ae8-adc4-670aab60b3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:40.082833 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166537c-95c1-4ae8-adc4-670aab60b3df service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:40.092789 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1439/2883] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:40.388198 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77194b9c-a50a-4283-8cd6-10dbacd53920 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:40.390053 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-77194b9c-a50a-4283-8cd6-10dbacd53920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:40.403467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77194b9c-a50a-4283-8cd6-10dbacd53920 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:40.408808 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:40.409691 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:40.409981 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:40.410265 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] PATH_INFO: `/v3/projects/8e6bbd44cc2545fc8e20e5fed56e8205` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:40.412263 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6bbd44cc2545fc8e20e5fed56e8205)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:40.414274 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:40.463349 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6bbd44cc2545fc8e20e5fed56e8205', 'request_id': 'req-29e3f3e2-a29c-4d32-8be7-1c3054663a07'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:40.469632 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6bbd44cc2545fc8e20e5fed56e8205', 'request_id': 'req-29e3f3e2-a29c-4d32-8be7-1c3054663a07'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:40.480732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6bbd44cc2545fc8e20e5fed56e8205', 'request_id': 'req-29e3f3e2-a29c-4d32-8be7-1c3054663a07'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:40.491507 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] The token cache is being invalidate because project 8e6bbd44cc2545fc8e20e5fed56e8205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:20:40.491787 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:40.492454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:40.494082 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1445/2884] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:20:40 2022] DELETE /identity/v3/projects/8e6bbd44cc2545fc8e20e5fed56e8205 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:40.498249 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166537c-95c1-4ae8-adc4-670aab60b3df service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:40.508236 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166537c-95c1-4ae8-adc4-670aab60b3df service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:40.570850 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:40.571771 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:40.572053 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:40.572333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] PATH_INFO: `/v3/users/3815ff995257437d93e2cb3842e312a5` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:40.573553 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3815ff995257437d93e2cb3842e312a5)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:40.575533 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:40.598764 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:40.632333 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3815ff995257437d93e2cb3842e312a5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:40.652197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3815ff995257437d93e2cb3842e312a5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:40.653000 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3815ff995257437d93e2cb3842e312a5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:40.661662 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3815ff995257437d93e2cb3842e312a5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:40.662369 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3815ff995257437d93e2cb3842e312a5'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:40.686227 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1440/2885] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:20:40 2022] DELETE /identity/v3/users/3815ff995257437d93e2cb3842e312a5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:40.975123 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:40.976568 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:40.995036 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3f3e2-a29c-4d32-8be7-1c3054663a07 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:41.058776 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:41.059579 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:41.059877 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:41.060152 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] PATH_INFO: `/v3/projects/3e4608e9988e403cb2851bc2242b2068` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:41.061522 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4608e9988e403cb2851bc2242b2068)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:41.063509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:41.085254 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:41.112978 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4608e9988e403cb2851bc2242b2068', 'request_id': 'req-1cbb63f2-e23e-43b6-9644-7085bf8c4184'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:41.119715 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4608e9988e403cb2851bc2242b2068', 'request_id': 'req-1cbb63f2-e23e-43b6-9644-7085bf8c4184'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:41.129499 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4608e9988e403cb2851bc2242b2068', 'request_id': 'req-1cbb63f2-e23e-43b6-9644-7085bf8c4184'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:41.142467 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] The token cache is being invalidate because project 3e4608e9988e403cb2851bc2242b2068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:20:41.142754 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:41.143473 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:41.145164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1446/2886] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:20:40 2022] DELETE /identity/v3/projects/3e4608e9988e403cb2851bc2242b2068 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:41.149464 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:41.151418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:41.164595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ea7f7-5e82-43f8-9455-83862225f207 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:41.223700 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de92808-90f5-411e-a39a-703027c8f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:41.224584 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de92808-90f5-411e-a39a-703027c8f48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:41.224869 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de92808-90f5-411e-a39a-703027c8f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:41.225150 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de92808-90f5-411e-a39a-703027c8f48e admin admin] PATH_INFO: `/v3/users/f2435eab6b32439bbf346c5de3fcb73c` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:41.226400 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de92808-90f5-411e-a39a-703027c8f48e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2435eab6b32439bbf346c5de3fcb73c)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:41.228379 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de92808-90f5-411e-a39a-703027c8f48e admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:41.280624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5de92808-90f5-411e-a39a-703027c8f48e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2435eab6b32439bbf346c5de3fcb73c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:41.293636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5de92808-90f5-411e-a39a-703027c8f48e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2435eab6b32439bbf346c5de3fcb73c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:41.294342 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5de92808-90f5-411e-a39a-703027c8f48e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2435eab6b32439bbf346c5de3fcb73c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:41.301241 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5de92808-90f5-411e-a39a-703027c8f48e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2435eab6b32439bbf346c5de3fcb73c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:41.301887 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-5de92808-90f5-411e-a39a-703027c8f48e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2435eab6b32439bbf346c5de3fcb73c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:41.315304 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1441/2887] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:20:41 2022] DELETE /identity/v3/users/f2435eab6b32439bbf346c5de3fcb73c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:41.857975 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:41.859587 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:41.872751 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb63f2-e23e-43b6-9644-7085bf8c4184 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:41.938635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:41.939531 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:41.939817 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:41.940072 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] PATH_INFO: `/v3/projects/16c8782a06bc43af9c65872ca2e2b746` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:41.941256 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c8782a06bc43af9c65872ca2e2b746)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:41.943219 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:41.990478 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c8782a06bc43af9c65872ca2e2b746', 'request_id': 'req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:41.996453 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c8782a06bc43af9c65872ca2e2b746', 'request_id': 'req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:42.005038 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c8782a06bc43af9c65872ca2e2b746', 'request_id': 'req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:42.015735 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] The token cache is being invalidate because project 16c8782a06bc43af9c65872ca2e2b746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:20:42.016027 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:42.016694 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-839feb4a-cbb3-4419-ba0b-d6389a1fc8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:20:42.018239 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1447/2888] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:20:41 2022] DELETE /identity/v3/projects/16c8782a06bc43af9c65872ca2e2b746 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 26 03:20:42.023486 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710f687-5741-4730-8c24-c4306acf60b8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:42.023717 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710f687-5741-4730-8c24-c4306acf60b8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:42.023995 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710f687-5741-4730-8c24-c4306acf60b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:42.042393 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e710f687-5741-4730-8c24-c4306acf60b8 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:42.043618 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e710f687-5741-4730-8c24-c4306acf60b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:42.056894 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:42.105586 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1442/2889] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:20:42.114532 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2519e-032a-4008-9c4c-d8b9c4aa0eb9 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:42.114829 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2519e-032a-4008-9c4c-d8b9c4aa0eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:42.115170 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2519e-032a-4008-9c4c-d8b9c4aa0eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:42.134286 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-afa2519e-032a-4008-9c4c-d8b9c4aa0eb9 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:42.135539 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-afa2519e-032a-4008-9c4c-d8b9c4aa0eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:42.144363 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1448/2890] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:20:42.148642 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710f687-5741-4730-8c24-c4306acf60b8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:42.159889 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710f687-5741-4730-8c24-c4306acf60b8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:42.165112 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f5310-7b81-472d-b74a-c2a87de03402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:42.165806 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5310-7b81-472d-b74a-c2a87de03402 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:42.166100 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5310-7b81-472d-b74a-c2a87de03402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:42.166410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5310-7b81-472d-b74a-c2a87de03402 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:42.167186 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f5310-7b81-472d-b74a-c2a87de03402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:20:42.167503 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f5310-7b81-472d-b74a-c2a87de03402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:42.169168 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f5310-7b81-472d-b74a-c2a87de03402 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:42.182348 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1443/2891] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 26 03:20:42.186794 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2519e-032a-4008-9c4c-d8b9c4aa0eb9 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:42.196205 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2519e-032a-4008-9c4c-d8b9c4aa0eb9 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:42.201008 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec53740-11e3-410c-91ab-15667d47ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:42.201643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53740-11e3-410c-91ab-15667d47ccf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:42.201923 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53740-11e3-410c-91ab-15667d47ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:42.202207 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53740-11e3-410c-91ab-15667d47ccf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:42.202905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec53740-11e3-410c-91ab-15667d47ccf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:42.204852 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec53740-11e3-410c-91ab-15667d47ccf9 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:42.237597 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1449/2892] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:20:42 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:42.243322 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f5310-7b81-472d-b74a-c2a87de03402 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:42.253547 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f5310-7b81-472d-b74a-c2a87de03402 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:42.311251 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d0fc8-433b-4903-96a6-6301c4dbac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:42.311845 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d0fc8-433b-4903-96a6-6301c4dbac7d admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:42.312138 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d0fc8-433b-4903-96a6-6301c4dbac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:42.312410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d0fc8-433b-4903-96a6-6301c4dbac7d admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:42.313106 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d0fc8-433b-4903-96a6-6301c4dbac7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:42.315088 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d0fc8-433b-4903-96a6-6301c4dbac7d admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:42.337052 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1444/2893] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:20:42 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:20:42.340642 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec53740-11e3-410c-91ab-15667d47ccf9 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:42.356057 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec53740-11e3-410c-91ab-15667d47ccf9 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:42.362933 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd512a0-1e63-4afb-8d4b-a316074cc0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:42.363638 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd512a0-1e63-4afb-8d4b-a316074cc0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:42.363918 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd512a0-1e63-4afb-8d4b-a316074cc0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:42.364191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd512a0-1e63-4afb-8d4b-a316074cc0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:42.364931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd512a0-1e63-4afb-8d4b-a316074cc0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:42.366562 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd512a0-1e63-4afb-8d4b-a316074cc0a6 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:42.369619 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:42.384870 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1450/2894] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:42.389440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d0fc8-433b-4903-96a6-6301c4dbac7d admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:42.401674 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d0fc8-433b-4903-96a6-6301c4dbac7d admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:42.406626 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55d9ac-d792-4516-bcc1-98119012a6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:42.407319 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55d9ac-d792-4516-bcc1-98119012a6ad admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:42.407606 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55d9ac-d792-4516-bcc1-98119012a6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:42.407881 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55d9ac-d792-4516-bcc1-98119012a6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:42.408610 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55d9ac-d792-4516-bcc1-98119012a6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:42.410222 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55d9ac-d792-4516-bcc1-98119012a6ad admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:42.420036 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1445/2895] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:20:42.424724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd512a0-1e63-4afb-8d4b-a316074cc0a6 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:42.435643 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd512a0-1e63-4afb-8d4b-a316074cc0a6 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:42.441275 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a4676-ea2c-47f3-8d8c-a8700162afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:42.442169 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a4676-ea2c-47f3-8d8c-a8700162afae admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:42.442468 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a4676-ea2c-47f3-8d8c-a8700162afae admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:42.442724 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a4676-ea2c-47f3-8d8c-a8700162afae admin admin] PATH_INFO: `/v3/projects/0df84283586a46cba20cc99b5a94ea4f/users/789fc34389414ab9b28be63441269cf3/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:42.458431 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a4676-ea2c-47f3-8d8c-a8700162afae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df84283586a46cba20cc99b5a94ea4f, user_id=789fc34389414ab9b28be63441269cf3, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:42.461128 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a4676-ea2c-47f3-8d8c-a8700162afae admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:42.478995 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1451/2896] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:20:42 2022] PUT /identity/v3/projects/0df84283586a46cba20cc99b5a94ea4f/users/789fc34389414ab9b28be63441269cf3/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:20:42.490019 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01e942-ceab-44ff-ab3c-72e6619b226b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:42.490313 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01e942-ceab-44ff-ab3c-72e6619b226b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:42.490587 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01e942-ceab-44ff-ab3c-72e6619b226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:42.518195 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ed01e942-ceab-44ff-ab3c-72e6619b226b None None] MFA Rules not processed for user `789fc34389414ab9b28be63441269cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:20:42.519448 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ed01e942-ceab-44ff-ab3c-72e6619b226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:42.591063 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1446/2897] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:20:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 26 03:20:42.602303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a4676-ea2c-47f3-8d8c-a8700162afae admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:20:42.604103 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-be3a4676-ea2c-47f3-8d8c-a8700162afae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:20:42.661242 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a4676-ea2c-47f3-8d8c-a8700162afae admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:20:42.666447 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7cada-d32d-4001-95e0-04a89cd35383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:20:42.667113 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7cada-d32d-4001-95e0-04a89cd35383 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:20:42.667494 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7cada-d32d-4001-95e0-04a89cd35383 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:20:42.667774 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7cada-d32d-4001-95e0-04a89cd35383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:20:42.677582 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7cada-d32d-4001-95e0-04a89cd35383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:20:42.679035 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7cada-d32d-4001-95e0-04a89cd35383 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:20:42.689164 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1452/2898] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:20:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:20:52.587820 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:20:52.684395 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:16.856984 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01e942-ceab-44ff-ab3c-72e6619b226b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:16.929725 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01e942-ceab-44ff-ab3c-72e6619b226b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:16.934834 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:16.935739 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:16.936020 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:16.936308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] PATH_INFO: `/v3/users/789fc34389414ab9b28be63441269cf3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:16.937511 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=789fc34389414ab9b28be63441269cf3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:16.939515 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:16.990484 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789fc34389414ab9b28be63441269cf3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:17.002323 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789fc34389414ab9b28be63441269cf3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:17.003006 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789fc34389414ab9b28be63441269cf3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:17.010522 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789fc34389414ab9b28be63441269cf3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:17.011294 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789fc34389414ab9b28be63441269cf3'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:17.026005 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1447/2899] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:21:16 2022] DELETE /identity/v3/users/789fc34389414ab9b28be63441269cf3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:21:17.030892 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9961537-dadb-47cf-af90-aa108837d6fc None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:17.031439 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9961537-dadb-47cf-af90-aa108837d6fc None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:17.031554 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9961537-dadb-47cf-af90-aa108837d6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:17.049931 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-a9961537-dadb-47cf-af90-aa108837d6fc None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:21:17.051427 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a9961537-dadb-47cf-af90-aa108837d6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:17.117957 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1453/2900] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:21:17.127775 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:17.129558 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:17.194864 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a19698-8ad3-49e8-ba47-e1bd069d9e8c admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:17.199255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e0902-39e2-4c9a-a1b4-6ee776a5b57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:17.199910 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0902-39e2-4c9a-a1b4-6ee776a5b57c service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:17.200206 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0902-39e2-4c9a-a1b4-6ee776a5b57c service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:17.200493 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0902-39e2-4c9a-a1b4-6ee776a5b57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:17.209912 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e0902-39e2-4c9a-a1b4-6ee776a5b57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:17.211413 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e0902-39e2-4c9a-a1b4-6ee776a5b57c service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:17.221070 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1448/2901] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:21:17.513533 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9961537-dadb-47cf-af90-aa108837d6fc None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:17.515149 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-a9961537-dadb-47cf-af90-aa108837d6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:17.527591 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9961537-dadb-47cf-af90-aa108837d6fc None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:17.532361 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:17.533269 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:17.533549 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:17.533823 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] PATH_INFO: `/v3/projects/0df84283586a46cba20cc99b5a94ea4f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:17.535297 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df84283586a46cba20cc99b5a94ea4f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:17.537001 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:17.585588 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df84283586a46cba20cc99b5a94ea4f', 'request_id': 'req-aedb552a-903e-4280-81c1-8b98ad141eb5'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:17.591703 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df84283586a46cba20cc99b5a94ea4f', 'request_id': 'req-aedb552a-903e-4280-81c1-8b98ad141eb5'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:17.601583 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df84283586a46cba20cc99b5a94ea4f', 'request_id': 'req-aedb552a-903e-4280-81c1-8b98ad141eb5'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:17.612406 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] The token cache is being invalidate because project 0df84283586a46cba20cc99b5a94ea4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:21:17.612698 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:17.613328 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-aedb552a-903e-4280-81c1-8b98ad141eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:17.614903 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1454/2902] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:21:17 2022] DELETE /identity/v3/projects/0df84283586a46cba20cc99b5a94ea4f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:21:17.619951 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa5e47-f823-4493-8c43-35ee3fd87aa4 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:17.620205 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa5e47-f823-4493-8c43-35ee3fd87aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:17.620481 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa5e47-f823-4493-8c43-35ee3fd87aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:17.639727 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e5fa5e47-f823-4493-8c43-35ee3fd87aa4 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:21:17.640921 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e5fa5e47-f823-4493-8c43-35ee3fd87aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:17.657980 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:17.701782 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1449/2903] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:21:17.710252 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a67b2-06b1-407f-a2ff-16484798e584 None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:17.710530 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a67b2-06b1-407f-a2ff-16484798e584 None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:17.710815 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a67b2-06b1-407f-a2ff-16484798e584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:17.730454 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-074a67b2-06b1-407f-a2ff-16484798e584 None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:21:17.731696 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-074a67b2-06b1-407f-a2ff-16484798e584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:17.739753 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1455/2904] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:21:17.743785 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa5e47-f823-4493-8c43-35ee3fd87aa4 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:17.755364 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa5e47-f823-4493-8c43-35ee3fd87aa4 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:17.761321 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39579a25-f78e-41bc-87a6-573095e2ca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:17.761975 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39579a25-f78e-41bc-87a6-573095e2ca31 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:17.762257 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39579a25-f78e-41bc-87a6-573095e2ca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:17.762529 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39579a25-f78e-41bc-87a6-573095e2ca31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:17.763288 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39579a25-f78e-41bc-87a6-573095e2ca31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 26 03:21:17.763594 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39579a25-f78e-41bc-87a6-573095e2ca31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:17.765197 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39579a25-f78e-41bc-87a6-573095e2ca31 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:17.777963 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1450/2905] 10.222.0.36 () {58 vars in 1152 bytes} [Sun Jun 26 03:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 26 03:21:17.782166 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a67b2-06b1-407f-a2ff-16484798e584 None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:17.791915 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a67b2-06b1-407f-a2ff-16484798e584 None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:17.797630 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c564d7-ae9e-46af-aa5f-401384077e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:17.798279 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c564d7-ae9e-46af-aa5f-401384077e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:17.798561 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c564d7-ae9e-46af-aa5f-401384077e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:17.798838 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c564d7-ae9e-46af-aa5f-401384077e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:17.799557 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c564d7-ae9e-46af-aa5f-401384077e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:17.801578 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c564d7-ae9e-46af-aa5f-401384077e83 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:17.829058 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1456/2906] 10.222.0.36 () {60 vars in 1152 bytes} [Sun Jun 26 03:21:17 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:21:17.833496 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39579a25-f78e-41bc-87a6-573095e2ca31 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:17.843936 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39579a25-f78e-41bc-87a6-573095e2ca31 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:17.913187 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57d23d-ca5c-46a8-b801-70a11e3620be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:17.913802 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57d23d-ca5c-46a8-b801-70a11e3620be admin admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:17.914032 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57d23d-ca5c-46a8-b801-70a11e3620be admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:17.914308 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57d23d-ca5c-46a8-b801-70a11e3620be admin admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:17.915024 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57d23d-ca5c-46a8-b801-70a11e3620be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:17.916950 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57d23d-ca5c-46a8-b801-70a11e3620be admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:17.940240 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1451/2907] 10.222.0.36 () {60 vars in 1143 bytes} [Sun Jun 26 03:21:17 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 26 03:21:17.944493 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c564d7-ae9e-46af-aa5f-401384077e83 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:17.954652 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c564d7-ae9e-46af-aa5f-401384077e83 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:17.959887 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5db8b0-1f7d-4fa9-b26b-75254f7361d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:17.960563 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db8b0-1f7d-4fa9-b26b-75254f7361d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:17.960845 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db8b0-1f7d-4fa9-b26b-75254f7361d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:17.961121 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db8b0-1f7d-4fa9-b26b-75254f7361d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:17.961857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5db8b0-1f7d-4fa9-b26b-75254f7361d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:17.963521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5db8b0-1f7d-4fa9-b26b-75254f7361d4 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:17.974156 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1457/2908] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:21:17.978119 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57d23d-ca5c-46a8-b801-70a11e3620be admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:17.988162 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57d23d-ca5c-46a8-b801-70a11e3620be admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:17.994937 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b2691-43c1-4c44-8705-b85203eb65fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:17.995905 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2691-43c1-4c44-8705-b85203eb65fa admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:17.996279 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2691-43c1-4c44-8705-b85203eb65fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:17.996885 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2691-43c1-4c44-8705-b85203eb65fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:17.997990 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b2691-43c1-4c44-8705-b85203eb65fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:18.000418 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b2691-43c1-4c44-8705-b85203eb65fa admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:18.016191 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1452/2909] 10.222.0.36 () {58 vars in 1121 bytes} [Sun Jun 26 03:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 26 03:21:18.020444 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5db8b0-1f7d-4fa9-b26b-75254f7361d4 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:18.031396 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5db8b0-1f7d-4fa9-b26b-75254f7361d4 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:18.037353 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcbbe2-0c6d-4423-ba8c-c2f6b7016767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:18.038236 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcbbe2-0c6d-4423-ba8c-c2f6b7016767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:18.038509 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcbbe2-0c6d-4423-ba8c-c2f6b7016767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:18.038789 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcbbe2-0c6d-4423-ba8c-c2f6b7016767 admin admin] PATH_INFO: `/v3/projects/89c7bdc8b83745128d782342707461a3/users/692bbc7c204a436880c4cd3304159d9c/roles/729faf69df60450caeada9c53520224f` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:18.054572 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcbbe2-0c6d-4423-ba8c-c2f6b7016767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c7bdc8b83745128d782342707461a3, user_id=692bbc7c204a436880c4cd3304159d9c, role_id=729faf69df60450caeada9c53520224f)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:18.057305 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcbbe2-0c6d-4423-ba8c-c2f6b7016767 admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:18.073184 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1458/2910] 10.222.0.36 () {60 vars in 1482 bytes} [Sun Jun 26 03:21:18 2022] PUT /identity/v3/projects/89c7bdc8b83745128d782342707461a3/users/692bbc7c204a436880c4cd3304159d9c/roles/729faf69df60450caeada9c53520224f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:21:18.086635 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba2357-519b-4250-b180-a24d0bcd8a4e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:18.086924 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba2357-519b-4250-b180-a24d0bcd8a4e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:18.087253 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba2357-519b-4250-b180-a24d0bcd8a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:18.115272 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ddba2357-519b-4250-b180-a24d0bcd8a4e None None] MFA Rules not processed for user `692bbc7c204a436880c4cd3304159d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:21:18.116472 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ddba2357-519b-4250-b180-a24d0bcd8a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:18.180957 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1453/2911] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:21:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:21:18.192312 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcbbe2-0c6d-4423-ba8c-c2f6b7016767 admin admin] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:18.194337 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-9bbcbbe2-0c6d-4423-ba8c-c2f6b7016767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:18.219314 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:18.287303 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcbbe2-0c6d-4423-ba8c-c2f6b7016767 admin admin] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:18.291519 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33de06-090d-4ba4-af15-c292faba0d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '892be7ed998840de8b325316db3fdde4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:18.292199 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33de06-090d-4ba4-af15-c292faba0d21 service cinder] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:18.292485 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33de06-090d-4ba4-af15-c292faba0d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:18.292768 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33de06-090d-4ba4-af15-c292faba0d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:18.301470 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33de06-090d-4ba4-af15-c292faba0d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:18.302913 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33de06-090d-4ba4-af15-c292faba0d21 service cinder] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:18.311702 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1459/2912] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:21:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:21:19.668280 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef708cc-ade4-4b35-9b5e-70d06aa20cfd None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:19.668792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef708cc-ade4-4b35-9b5e-70d06aa20cfd None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:19.668792 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef708cc-ade4-4b35-9b5e-70d06aa20cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:19.691256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0ef708cc-ade4-4b35-9b5e-70d06aa20cfd None None] MFA Rules not processed for user `692bbc7c204a436880c4cd3304159d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:21:19.692602 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0ef708cc-ade4-4b35-9b5e-70d06aa20cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:19.700988 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1454/2913] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:21:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:21:22.149801 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33de06-090d-4ba4-af15-c292faba0d21 service cinder] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:22.151709 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-1a33de06-090d-4ba4-af15-c292faba0d21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:22.212999 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33de06-090d-4ba4-af15-c292faba0d21 service cinder] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:22.217191 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87f792-f508-41b0-9ed1-8c41a45eafce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:22.217857 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87f792-f508-41b0-9ed1-8c41a45eafce service neutron] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:22.218142 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87f792-f508-41b0-9ed1-8c41a45eafce service neutron] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:22.218423 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87f792-f508-41b0-9ed1-8c41a45eafce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:22.220300 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ed87f792-f508-41b0-9ed1-8c41a45eafce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:22.231719 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87f792-f508-41b0-9ed1-8c41a45eafce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:22.233309 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87f792-f508-41b0-9ed1-8c41a45eafce service neutron] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:22.241737 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1460/2914] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:21:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:21:29.682250 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:32.238023 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=52 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:33.444421 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232c47d-e3f9-454e-a5e6-728a9cb59e09 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:33.444933 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232c47d-e3f9-454e-a5e6-728a9cb59e09 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:33.445066 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232c47d-e3f9-454e-a5e6-728a9cb59e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:33.505255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7232c47d-e3f9-454e-a5e6-728a9cb59e09 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:21:33.506487 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7232c47d-e3f9-454e-a5e6-728a9cb59e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:33.572410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1455/2915] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:21:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:21:33.620991 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87f792-f508-41b0-9ed1-8c41a45eafce service neutron] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:33.622637 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-ed87f792-f508-41b0-9ed1-8c41a45eafce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:33.715294 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87f792-f508-41b0-9ed1-8c41a45eafce service neutron] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:33.721905 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f80cb-d4f9-4bda-b62f-11eee2f0fb76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:33.722558 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f80cb-d4f9-4bda-b62f-11eee2f0fb76 service swift] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:33.722834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f80cb-d4f9-4bda-b62f-11eee2f0fb76 service swift] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:33.723136 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f80cb-d4f9-4bda-b62f-11eee2f0fb76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:33.736591 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f80cb-d4f9-4bda-b62f-11eee2f0fb76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:33.739046 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f80cb-d4f9-4bda-b62f-11eee2f0fb76 service swift] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:33.747992 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1461/2916] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:21:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:21:34.257892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03390a1-0818-4bfc-8dbc-66eed6c767ea None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:34.258185 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03390a1-0818-4bfc-8dbc-66eed6c767ea None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:34.258469 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03390a1-0818-4bfc-8dbc-66eed6c767ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:34.277862 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a03390a1-0818-4bfc-8dbc-66eed6c767ea None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:21:34.279108 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a03390a1-0818-4bfc-8dbc-66eed6c767ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:34.287255 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1456/2917] 10.222.0.36 () {58 vars in 967 bytes} [Sun Jun 26 03:21:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:21:34.299299 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f80cb-d4f9-4bda-b62f-11eee2f0fb76 service swift] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:34.310491 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f80cb-d4f9-4bda-b62f-11eee2f0fb76 service swift] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:34.316707 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a2550-7280-44dc-90fd-c1db84357985 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:34.317345 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2550-7280-44dc-90fd-c1db84357985 service swift] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:34.317635 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2550-7280-44dc-90fd-c1db84357985 service swift] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:34.317901 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2550-7280-44dc-90fd-c1db84357985 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:34.326394 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a2550-7280-44dc-90fd-c1db84357985 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:34.328021 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a2550-7280-44dc-90fd-c1db84357985 service swift] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:34.336095 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1462/2918] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:21:34.544180 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4270a-a05a-488f-9f0c-147a77ac246a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:34.544683 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4270a-a05a-488f-9f0c-147a77ac246a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:34.544796 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4270a-a05a-488f-9f0c-147a77ac246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:34.569825 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-49e4270a-a05a-488f-9f0c-147a77ac246a None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:21:34.571172 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-49e4270a-a05a-488f-9f0c-147a77ac246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:34.578776 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1457/2919] 10.222.0.36 () {58 vars in 1009 bytes} [Sun Jun 26 03:21:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:21:34.590769 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a2550-7280-44dc-90fd-c1db84357985 service swift] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:34.601653 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a2550-7280-44dc-90fd-c1db84357985 service swift] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:34.607564 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c50f5-d121-4d7d-8fa1-5c58776c7ee8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:34.608243 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c50f5-d121-4d7d-8fa1-5c58776c7ee8 service swift] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:34.608521 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c50f5-d121-4d7d-8fa1-5c58776c7ee8 service swift] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:34.608819 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c50f5-d121-4d7d-8fa1-5c58776c7ee8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:34.617296 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c50f5-d121-4d7d-8fa1-5c58776c7ee8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:34.618932 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c50f5-d121-4d7d-8fa1-5c58776c7ee8 service swift] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:34.626916 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1463/2920] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:21:34.948147 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe77e-0a9d-441b-832c-5ec8c60c6f62 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:34.948440 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe77e-0a9d-441b-832c-5ec8c60c6f62 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:34.948719 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe77e-0a9d-441b-832c-5ec8c60c6f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:34.969273 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1eebe77e-0a9d-441b-832c-5ec8c60c6f62 None None] MFA Rules not processed for user `d78da06180d0420f82074fa5e3cbc71e`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:21:34.970595 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1eebe77e-0a9d-441b-832c-5ec8c60c6f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:34.978624 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1458/2921] 10.222.0.36 () {58 vars in 967 bytes} [Sun Jun 26 03:21:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:21:34.993285 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c50f5-d121-4d7d-8fa1-5c58776c7ee8 service swift] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:35.007576 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c50f5-d121-4d7d-8fa1-5c58776c7ee8 service swift] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:35.017289 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3365e3-f63d-41ea-baa5-c22d04b69490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd585280109eb4773adf7d56fd722a4b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:35.018077 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3365e3-f63d-41ea-baa5-c22d04b69490 service swift] REQUEST_METHOD: `GET` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:35.018445 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3365e3-f63d-41ea-baa5-c22d04b69490 service swift] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:35.018749 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3365e3-f63d-41ea-baa5-c22d04b69490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:35.030245 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3365e3-f63d-41ea-baa5-c22d04b69490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:35.031880 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3365e3-f63d-41ea-baa5-c22d04b69490 service swift] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:35.040403 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1464/2922] 10.222.0.36 () {60 vars in 1384 bytes} [Sun Jun 26 03:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 26 03:21:37.137667 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebe77e-0a9d-441b-832c-5ec8c60c6f62 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:37.212330 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebe77e-0a9d-441b-832c-5ec8c60c6f62 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:37.217892 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:37.218774 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:37.219103 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:37.219388 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] PATH_INFO: `/v3/users/692bbc7c204a436880c4cd3304159d9c` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:37.220578 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=692bbc7c204a436880c4cd3304159d9c)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:37.222494 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:37.270787 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:37.272467 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692bbc7c204a436880c4cd3304159d9c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:37.285972 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692bbc7c204a436880c4cd3304159d9c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:37.286636 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692bbc7c204a436880c4cd3304159d9c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:37.293438 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692bbc7c204a436880c4cd3304159d9c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:37.294060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.notifications [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692bbc7c204a436880c4cd3304159d9c'} {{(pid=80128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:37.309238 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1459/2923] 10.222.0.36 () {58 vars in 1223 bytes} [Sun Jun 26 03:21:37 2022] DELETE /identity/v3/users/692bbc7c204a436880c4cd3304159d9c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:21:37.314076 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9ae56-6168-488b-bf9d-9fea8eda5fbe None None] REQUEST_METHOD: `POST` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:37.314604 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9ae56-6168-488b-bf9d-9fea8eda5fbe None None] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:37.314733 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9ae56-6168-488b-bf9d-9fea8eda5fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:37.333189 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.auth.core [None req-6cc9ae56-6168-488b-bf9d-9fea8eda5fbe None None] MFA Rules not processed for user `7e9333f1aa1b4eae9a0f479d3c29fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80129) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 26 03:21:37.334391 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6cc9ae56-6168-488b-bf9d-9fea8eda5fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:37.402332 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1465/2924] 10.222.0.36 () {58 vars in 957 bytes} [Sun Jun 26 03:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 26 03:21:37.411991 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:37.413462 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:37.469101 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fa806-bc96-4a6f-a0ba-54fb305d06d7 admin admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:37.472795 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d72bd-91b0-49ae-a036-fd175d90d194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4169682bfc5043a3a3d4c638dae2a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:37.473432 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d72bd-91b0-49ae-a036-fd175d90d194 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:37.473713 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d72bd-91b0-49ae-a036-fd175d90d194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:37.473989 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d72bd-91b0-49ae-a036-fd175d90d194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:37.484143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d72bd-91b0-49ae-a036-fd175d90d194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:37.485592 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d72bd-91b0-49ae-a036-fd175d90d194 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:37.495318 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1460/2925] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:21:37.677720 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9ae56-6168-488b-bf9d-9fea8eda5fbe None None] Authenticating user token {{(pid=80129) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:21:37.679418 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.fernet_utils [None req-6cc9ae56-6168-488b-bf9d-9fea8eda5fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80129) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:21:37.691996 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9ae56-6168-488b-bf9d-9fea8eda5fbe None None] Validating token access rules against request {{(pid=80129) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:21:37.697096 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e9333f1aa1b4eae9a0f479d3c29fb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '898f4bc074784aa394c0f3456d694f9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80129) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:21:37.697972 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:21:37.698253 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:21:37.698529 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] PATH_INFO: `/v3/projects/89c7bdc8b83745128d782342707461a3` {{(pid=80129) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:21:37.699889 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c7bdc8b83745128d782342707461a3)` {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:21:37.701816 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] RBAC: Authorization granted {{(pid=80129) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:21:37.736874 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:37.753732 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c7bdc8b83745128d782342707461a3', 'request_id': 'req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:37.759834 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c7bdc8b83745128d782342707461a3', 'request_id': 'req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:37.768673 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c7bdc8b83745128d782342707461a3', 'request_id': 'req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d'} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:37.779335 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] The token cache is being invalidate because project 89c7bdc8b83745128d782342707461a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80129) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 26 03:21:37.779620 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:37.780221 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG keystone.notifications [None req-f643b3e6-ebdb-4ac6-aad7-6766beb0f81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80129) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 26 03:21:37.781756 dv-cinder-846842-4-smb devstack@keystone.service[80129]: [pid: 80129|app: 0|req: 1466/2926] 10.222.0.36 () {58 vars in 1232 bytes} [Sun Jun 26 03:21:37 2022] DELETE /identity/v3/projects/89c7bdc8b83745128d782342707461a3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 26 03:21:47.491247 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=39,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:21:47.776586 dv-cinder-846842-4-smb devstack@keystone.service[80129]: DEBUG dbcounter [-] [80129] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 26 03:23:59.249256 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d72bd-91b0-49ae-a036-fd175d90d194 service neutron] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 26 03:23:59.250973 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-291d72bd-91b0-49ae-a036-fd175d90d194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:23:59.322128 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d72bd-91b0-49ae-a036-fd175d90d194 service neutron] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 26 03:23:59.385143 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd36f5e-03f2-4bd8-88ff-7db2d145958f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ae5f8f789424969bd575f7360847261', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a0022e70eb947cf8419191744dd7ec2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 26 03:23:59.385797 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd36f5e-03f2-4bd8-88ff-7db2d145958f service placement] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 26 03:23:59.386081 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd36f5e-03f2-4bd8-88ff-7db2d145958f service placement] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 26 03:23:59.386360 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd36f5e-03f2-4bd8-88ff-7db2d145958f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 26 03:23:59.388427 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-acd36f5e-03f2-4bd8-88ff-7db2d145958f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 26 03:23:59.400410 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd36f5e-03f2-4bd8-88ff-7db2d145958f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 26 03:23:59.401993 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd36f5e-03f2-4bd8-88ff-7db2d145958f service placement] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 26 03:23:59.412060 dv-cinder-846842-4-smb devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1461/2927] 10.222.0.36 () {60 vars in 1365 bytes} [Sun Jun 26 03:23:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 26 03:24:09.408073 dv-cinder-846842-4-smb devstack@keystone.service[80128]: DEBUG dbcounter [-] [80128] Writing DB stats keystone:SELECT=58 {{(pid=80128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}